Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “storage benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

SFCOMPO Database of Spent Nuclear Fuel Assay Data – the Next Frontier

SFCOMPO is the world’s largest database for measured spent nuclear fuel assay data. An international effort coordinated by the Nuclear Energy Agency (NEA) resulted in a significant expansion of the database and its release online in 2017 as a downloadable application. The SFCOMPO Technical Review Group (TRG) was recently formed under the direction of NEA’s Nuclear Science Committee/Working Party on Nuclear Criticality Safety and was mandated to maintain and further coordinate the development of SFCOMPO. This TRG is currently focused on (1) critical evaluation of the experimental assay data by independent experts and (2) development of benchmarks and benchmark models that can be applied to validate burnup codes. This will improve the quality and documentation of the experimental datasets and enable their use by the international community to support code validation for design and safety analysis of spent nuclear fuel transportation, storage, and repository applications. It follows the precedent and draws on the experience gained from similar NEA efforts in the International Reactor Physics Experiment Evaluation Project and the International Criticality Safety Benchmark Experiment Project. Ongoing SFCOMPO evaluations have served as a test bed to develop templates for documenting evaluations, develop review guidance, improve approaches for a global uncertainty analysis, and devise a strategy focused on providing practical information of highest value to the user community. The current effort, status, and associated challenges are discussed.

Ilas, Germina↗

Evidence of Zintl Intermediate Phase and Its Impacts on Li and Na Storage Performance of Pb-Based Alloying Anodes

Anode materials based on conversion and alloying reactions are promising to achieve high energy density of advanced sodium-ion batteries (SIBs). While the chemical similarities between sodium and lithium as alkali elements make the benchmarking strategy practical in developing new high-performance anodes, simply borrowing the anode material from one system to the other does not always guarantee success unless it is based on sound understanding of both Li- and Na-reaction mechanisms. In this work, we report the Na storage performance of a Pb-based anode and its fundamental reaction dynamics. In contrast to its excellent electrochemical performances in Li cells (reversible ~600 mAh/g), the newly developed Pb@PbO–C nanocomposite anode has limited electrochemical Na reaction properties showing moderate capacity and rate performances (~300 mAh/g at 20 mA/g). Synchrotron-based X-ray diffraction and absorption spectroscopy studies reveal the fundamental differences in the Na and Li reaction mechanism of the Pb-based anode. Further, unlike Li reaction, the unique Na reaction mechanism involves the formation of a highly ionic NaPb Zintl phase, which comprises tetrahedral Pb 4 clusters, as an intermediate phase. The strong covalent character of the Pb 4 Zintl clusters adversely affects the electronic conductivity and thus limits the electrochemical performance of the Pb-based anode in Na cells. These findings provide new insights applicable to developing high-performance alloying anode materials.

25 ENERGY STORAGE↗

Benchmarking Density Functional Theory Methods for Efficient Calculations of a Strongly Correlated Li 1– x Ni 1– y O 2−δ System

Transition metal oxides (TMOs), such as LiNiO 2 , are promising candidates for energy storage and electronic devices due to their unique electronic properties, exceptional physical and chemical characteristics, and ability to adopt multiple oxidation states. However, accurately predicting their properties using mean-field density functional theory (DFT) is challenging due to the presence of strongly correlated d-electrons and the complex interplay between their structural, electronic, and magnetic responses. These challenges are further exacerbated by the need to model defects, surfaces, and interfaces, which require computationally efficient, large-scale simulations. To address these issues, we carry out a benchmark study on the Li 1–x NiO 2 system, evaluating the performance of several popular functionals. Our findings demonstrate that combining SCAN functional relaxation with single-step HSE calculations provides a practical and scalable computational strategy. This approach balances accuracy and efficiency, enabling high-throughput simulations of strongly correlated TMOs and improved predictive modeling capability of TMOs for practical applications.

25 ENERGY STORAGE↗

Optimal control of large quantum systems: assessing memory and runtime performance of GRAPE

Abstract Gradient Ascent Pulse Engineering (GRAPE) is a popular technique in quantum optimal control, and can be combined with automatic differentiation (AD) to facilitate on-the-fly evaluation of cost-function gradients. We illustrate that the convenience of AD comes at a significant memory cost due to the cumulative storage of a large number of states and propagators. For quantum systems of increasing Hilbert space size, this imposes a significant bottleneck. We revisit the strategy of hard-coding gradients in a scheme that fully avoids propagator storage and significantly reduces memory requirements. Separately, we present improvements to numerical state propagation to enhance runtime performance. We benchmark runtime and memory usage and compare this approach to AD-based implementations, with a focus on pushing towards larger Hilbert space sizes. The results confirm that the AD-free approach facilitates the application of optimal control for large quantum systems which would otherwise be difficult to tackle.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Distribution Grid Impacts of Community Solar [Slides]

Community solar (CS) projects often face uncertain interconnection costs and fees associated with distribution grid infrastructure upgrades required to connect the project. These costs can determine the economic viability of a CS project, but they are difficult to assess. Cost uncertainty can discourage new projects and prevent communities from accessing the benefits of community solar projects. At the same time, CS deployment strategies hold potential to defer or avoid some distribution costs due to new loads. To mitigate CS interconnection costs, it is important to find least-cost combinations of distribution system infrastructure solutions (transformer upgrades, reconductoring, voltage regulators, storage), and to understand how location of CS projects within a feeder impact distribution grid upgrade costs. This study aims to quantify CS impacts on the distribution grid and provide policy and regulatory insights and CS deployment strategies to address them. It is the first analysis that has systematically studied the technical impacts of community solar projects on a wide range of distribution feeders using state-of-the-art optimization and power flow tools. The analysis employs Berkeley Lab’s novel Least-cost Optimal Distribution Grid Expansion (LODGE) model, a deterministic version of the REPAIR model, that optimally upgrades hundreds or even thousands of distribution circuits or feeders. This is the first application of the LODGE model. LODGE finds the least-cost portfolio of traditional distribution system upgrades to integrate CS in combination with alternative solutions, such as utility-owned storage and downsizing CS capacity. Working with a set of least-cost solutions per feeder allows us to benchmark, compare and find techno-economic trends in CS interconnection.

14 SOLAR ENERGY↗

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗

Radiation-resistant metal-organic framework enables efficient separation of krypton fission gas from spent nuclear fuel

Capture and storage of volatile radionuclides that result from processing of used nuclear fuel is a major challenge. Solid adsorbents, in particular ultra-microporous metal-organic frameworks, could be effective in capturing these volatile radionuclides, including 85 Kr. However, metal-organic frameworks are found to have higher affinity for xenon than for krypton, and have comparable affinity for Kr and N 2 . Also, the adsorbent needs to have high radiation stability. To address these challenges, here we evaluate a series of ultra-microporous metal-organic frameworks, SIFSIX-3-M (M = Zn, Cu, Ni, Co, or Fe) for their capability in 85 Kr separation and storage using a two-bed breakthrough method. These materials were found to have higher Kr/N 2 selectivity than current benchmark materials, which leads to a notable decrease in the nuclear waste volume. The materials were systematically studied for gamma and beta irradiation stability, and SIFSIX-3-Cu is found to be the most radiation resistant.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Advancing Concentrating Solar Thermal Modeling Using System Advisor Model (SAM)

Concentrating solar thermal (CST) technologies play a critical role in enabling dispatchable power and high-temperature industrial heat applications. Accurate and flexible modeling tools are essential for evaluating system performance, guiding technology research and development, and informing investment decisions. The National Laboratory of the Rockies's System Advisor Model (SAM) is a widely used techno-economic simulation platform for CST systems, providing detailed performance and financial modeling capabilities for multiple CST system configurations. SAM integrates physics-based performance models with financial analysis to simulate the behavior of complex energy systems under realistic operating conditions. For CST technologies (including tower, parabolic trough, and linear Fresnel), SAM enables hourly simulations using site-specific weather data that ensure feasible operating conditions and convergence of mass and energy between core system components (i.e., solar field, receiver, thermal energy storage, and power cycle). These capabilities allow researchers and developers to evaluate annual energy production, capacity factors, levelized cost of energy (LCOE), and system dispatch strategies. A key advantage of SAM lies in its flexibility for parametric analysis and large-scale computational studies. Users can vary system design parameters such as heliostat field layout, receiver dimensions, thermal energy storage capacity, power block sizing, and installation cost assumptions to investigate their impact on system performance and financial metrics. When combined with automated scripting through LK, SDKTool, or Python interfaces, SAM enables high-throughput simulation workflows that support sensitivity analysis, technology benchmarking, and optimization studies. These approaches are particularly valuable for next-generation CST concepts, where design spaces are large and system interactions are complex. Another important capability of SAM is its support for dispatch optimization and thermal energy storage modeling, which are central to the value proposition of CST technologies. The ability to simulate integrated storage and flexible power generation allows researchers to explore strategies that maximize grid value, improve capacity utilization, and enhance integration with variable resources such as photovoltaic and wind generation. This poster will present an overview of SAM's thermal system modeling capabilities including concentrating solar. Additionally, we will highlight new feature developments including: 1) implementing Google's OR-Tools optimization platform for faster and more robust dispatch optimization, 2) developing a new power load following controller for modeling behind-the-meter applications, 3) enabling direct modeling of CSP-PV hybrid systems with the inclusion of battery storage, and 4) developing a multi-receiver falling particle Gen3 system model.

14 SOLAR ENERGY↗

Computational fluid dynamic analysis of a novel particle-to-air fluidized-bed heat exchanger for particle-based thermal energy storage applications

Long-duration energy storage technologies are being targeted to enable cost-effective, decarbonized energy systems. Particle-based thermal energy storage systems are one promising technology by storing excess electricity or heat as sensible thermal energy in inexpensive, solid, inert particles. These systems are only possible if an effective and economical particle-to-working fluid heat exchanger exists. This study predicts the performance of a proposed, direct-contact, particle-to-air, pressurized fluidized-bed heat exchanger using computational fluid dynamics. The common Eulerian-Eulerian framework for modeling fluidized beds is first benchmarked to experimental results at a previously untested operating condition and application. Then, the benchmarked model evaluates the performance of a proposed design for a commercial-scale version of the novel particle-to-air heat exchanger. The results show pressure drop and gas-phase approach temperatures are advantageous compared to other proposed designs for particle-to-air heat exchangers in the literature; approach temperatures were less than 5 °C and gas-phase pressure drop across the fluidized bed was 32 kPa. The model also highlights the importance of gas distributor design and representation in the Eulerian-Eulerian framework to control fluidization behavior. In conclusion, the model built and benchmarked in this study can be leveraged to advance the design and analysis of these heat exchangers critical to the deployment of a promising long-duration energy storage technology.

25 ENERGY STORAGE↗

Operating Reserves in ReEDS

This presentation provides an overview of the formulation for operating reserves in the Regional Energy Deployment System (ReEDS), a capacity expansion model. It describes the three reserve products modeled in ReEDS--regulation, spinning (contingency), and flexibility--and highlights recent updates to the modeling approach, including modifications to how storage provides reserves, the constraints on commitment for generators that provide reserves, and the costs for thermal units to provide spinning reserve. The presentation benchmarks operating reserve provision in ReEDS against comparable simulations in PLEXOS, finding that the improved formulation is different but yields results that are holistically similar to those in production cost modeling. In this presentation we also investigate the impact of different reserve options in the model (e.g., allowing wind and solar to provide operating reserves) on the solution. The results thus far indicate that most switches related to operating reserves exert little influence on the outcome on the results. Future work will continue to explore operating reserves in capacity expansion models, particularly for models with different temporal resolution.

14 SOLAR ENERGY↗

Performance Improvements of the Griffin Solvers in FY24

The Griffin code is a MOOSE-based reactor physics application jointly developed by Idaho National Laboratory and Argonne National Laboratory under the Department of Energy Office of Nuclear Energy Nuclear Energy Advanced Modeling and Simulation Program. This fiscal year, we have made significant efforts to improve the performance of transport solver options and cross-section generation for the efficient use of Griffin in advanced reactor applications. For the HFEM-PN solver, the residual evaluations of HFEM kernels were optimized by utilizing the pre- computed averaged cross sections for individual elements. Numerical integration involving the evaluation of basis functions at quadrature points was bypassed by facilitating precomputed element mass matrices for response matrices. Red-black iterations were improved by introducing a new generalized minimum residual based solver. The memory usage of response matrix storage was significantly reduced by applying basis function rotations on interfaces and calculating volumetric odd-parity moments on the fly. Additionally, the adjoint flux and transient calculation capabilities of the HFEM-PN solver were successfully implemented and verified using the TWIGL benchmark problem. For the DFEM-SN solver, memory footprint and computation time were significantly reduced by not treating angular flux vectors as the MOOSE nonlinear system vectors. Specifically for IQS, scalar adjoint weighting was introduced to further eliminate angular adjoint flux storage in the MOOSE auxiliary system. It was demonstrated through the three-dimensional Advanced Burner Test Reactor core problem that the memory usage for transient calculations with the IQS method was reduced by over 7.5× compared to before the optimizations. For the self-shielding application programming interface, a new double-heterogeneity treatment method, named the Bell Function-Based Analytic Two-Region Slowing Down Method, was developed to efficiently flux-volume homogenize TRISO particles with the matrix. Additionally, optimizations were made to hyper- fine group (HFG) slowing down calculations by pretabulating collision probability coefficients and grouping isotopes, significantly reducing the computational time for calculating scattering sources per HFG. Lastly, the pin power reconstruction module was extended to account for temporal behavior in a microreactor analysis problem, specifically for a control drum transient. Verification tests for each of these improvements demonstrated significant performance enhancements and memory reduction.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Metal hydride composition-derived parameters as machine learning features for material design and H 2 storage

Though hydrogen is a promising energy carrier for a green future, many challenges persist. One is the difficulty in engineering storage solutions, with metal hydrides being a leading contender among solid-state strategies. To facilitate efficient searching of candidate materials, ridge regression, simple decision trees, random forest ensembles, and gradient boosting ensembles were employed to predict the energy of formation, with the random forest ensemble resulting in the lowest test set error. First, two public databases, Materials Project and HydPark, were searched for metal hydrides. Feature engineering was performed before the models were developed, resulting in electronegativity, density, atomic density, d-character, f-character, band gap, hydrogen weight fraction, magnetization, temperature, and pressure being retained. The models were then benchmarked by the lowest test error before a random forest ensemble was used to populate entries missing energy of formation. Furthermore, all were then scored by hydrogen storage capacity and energy of formation suitability. Readily available features including several derived from only the chemical formula which were found to be highly predictive. and so are promising for high-throughput screening of arbitrary novel hydride formulations and blends for thermodynamic feasibility.

25 ENERGY STORAGE↗

Destabilizing high-capacity high entropy hydrides via earth abundant substitutions: From predictions to experimental validation

The vast chemical space of high entropy alloys (HEAs) makes trial-and-error experimental approaches for materials discovery intractable and often necessitates data-driven and/or first principles computational insights to successfully target materials with desired properties. In the context of materials discovery for hydrogen storage applications, a theoretical prediction-experimental validation approach can vastly accelerate the search for substitution strategies to destabilize high-capacity hydrides based on benchmark HEAs, e.g. TiVNbCr alloys. Here, in this study, machine learning predictions, corroborated by density functional theory calculations, predict substantial hydride destabilization with increasing substitution of earth-abundant Fe content in the (TiVNb) 75 Cr 25-x Fe x system. The as-prepared alloys crystallize in a single-phase bcc lattice for limited Fe content x < 7, while larger Fe content favors the formation of a secondary C14 Laves phase intermetallic. Short range order for alloys with x < 7 can be well described by a random distribution of atoms within the bcc lattice without lattice distortion. Hydrogen absorption experiments performed on selected alloys validate the predicted thermodynamic destabilization of the corresponding fcc hydrides and demonstrate promising lifecycle performance through reversible absorption/desorption. This demonstrates the potential of computationally expedited hydride discovery and points to further opportunities for optimizing bcc alloy ↔ fcc hydrides for practical hydrogen storage applications.

36 MATERIALS SCIENCE↗

Development of Low-Cost, High-Performance, Easy-To-Apply, Non-Flammable, Inorganic Phase Change Material (PCM) Technology (Project Final Report)

This report describes a 45-months long research program focused on the development of novel, easy-to-apply, non-flammable, and high-performance inorganic phase change materials (PCMs) for building and industrial applications. The University of Massachusetts Lowell (UML) formed a world-class team consisting of researchers form InsolCorp (only N. American manufacturer of inorganic PCM systems for building applications), and a group of industrial advisors, to develop a universal/multipurpose, simple-to-manufacture and cost-effective PCM technology. The project team expects that the results of this work will spur in the future the adoption of thermal storage materials – a key building energy saving technology as identified by DOE BTO – for a variety of building envelope applications. The main goal of this project was to demonstrate a suite of low-cost, multipurpose, and durable inorganic PCM formulations with phase transition temperatures encompassing typical building applications (between +5 o C and +55 o C). The first objective was to design, fabricate, and experimentally validate a performance of inexpensive, durable, highly efficient, non-flammable, and easy to manufacture PCMs. To allow a variety of building applications, the project team focused on formulations that exhibit repeatable phase transitions between +5 o C and +55 o C. To follow the DOE BTO cost efficiency target without compromising thermal performance, our work was based on inorganic compounds (mostly salt hydrates) and their blends, which represent a fraction of the cost of most of organic PCMs with about twice as high density as well as significantly higher thermal conductivity and phase change enthalpy. The second objective was to develop easy-to-manufacture and -install packaging/encapsulation designs that are 1) a superior barrier to current state-of-the-art macro-packaging, which significantly reduces the risk of loss of hydration water and PCM leak, and 2) optimal in enhancing the heat exchange rates with the surroundings and within the PCM core to ensure complete charging/discharging of the entire PCM within the product. Finally, the project’s intend was to scale-up the fabrication process to demonstrate installation on system-scale applications, and to validate the performance under field conditions. This work aimed at developing low-cost, high-energy storage, and reliable latent heat storage technology for building applications. This development was realized by formulating and integrating the following two technology components: 1) inorganic salt hydrate based PCMs that have high latent enthalpies and are low-cost and durable, and 2) PCM encapsulation (packaging) technology that maximizes PCM concentration and enhances heat transport characteristics in the product and with the external environment/materials. High thermal storage capacity, low cost and fire resistance are key to the building market entry for PCM technology. Therefore, the project’s focus was on salt-hydrate-based formulations which satisfy all these criteria. Packaging and/or encapsulation of PCM is a key processing step. The project team recognized that a low-cost and simple-to-manufacture salt hydrate-based PCM technology holds the best chance to be successful in the building construction market, a market which is traditionally extremely sensitive to cost and where commodity thermal insulations are the benchmark for envelope-related energy saving measures. That is why, in this project, the main intention was to minimize the production cost and maximize the product energy storage density without sacrificing the PCM performance. It was achieved through: 1. Minimizing the non-PCM components (plastics, additives, packaging/encapsulation materials, etc.) because they are significantly more expensive than salt hydrates, 2. Using highly thermally conductive and lightweight PCM carrier (packaging material) to facilitate more complete phase cycling, and 3. Optimizing the thickness and minimizing air spaces in product design (such as in pouched PCM). For this purpose, our approach was to enable an easy system design, including selection of the PCM operating temperatures, optimizing the necessary heat storage capacity (by stacking together several layers of PCM products), and if needed, a synchronized usage of PCM products of different temperatures. A specially designed, robust, highly thermally conducting and highly impermeable packaging (to retain salt hydrate water during phase transition cycles) was designed and tested to increase the overall system thermal performance and durability. All PCM products developed during this project were tested in both lab scale and in full scale field conditions. It is expected that, after further developments and commercialization, the developed PCM technologies may be also applied in space conditioning, energy storage technologies, and heat transfer applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Blind Benchmark Exercise for Spent Nuclear Fuel Decay Heat

The decay heat rate of five spent nuclear fuel assemblies of the pressurized water reactor type were measured by calorimetry at the interim storage for spent nuclear fuel in Sweden. Calculations of the decay heat rate of the five assemblies were performed by 20 organizations using different codes and nuclear data libraries resulting in 31 results for each assembly, spanning most of the current state-of-the-art practice. The calculations were based on a selected subset of information, such as reactor operating history and fuel assembly properties. The relative difference between the measured and average calculated decay heat rate ranged from 0.6% to 3.3% for the five assemblies. The standard deviation of these relative differences ranged from 1.9% to 2.4%.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Impact of battery cell imbalance on electric vehicle range

Due to manufacturing variation, battery cells often possess heterogeneous characteristics, leading to battery state-of-charge variation in real-time. Since the lowest cell state-of-charge determines the useful life of battery pack, such variation can negatively impact the battery performance and electric vehicles range. Existing research has been focused on control design to mitigate cell imbalance. However, it is yet unclear how much impacts the cell imbalance can have on electric vehicle range. This paper closes this knowledge gap by using a simulation environment consisting of real-world driving speed data, vehicle longitudinal control, propulsion and vehicle dynamics, and cell level battery modeling. In particular, each battery cell is modeled as an equivalent circuit model, and variations among cell parameters are introduced to assess their impact on electric vehicles range and to identify the most influential parameter variations. Simulation results and analysis can be used to assist balancing control design and to benchmark control performance.

25 ENERGY STORAGE↗

Computational Fluid Dynamic Modeling of Dry Cask Simulator with Crosswind

The purpose of this study is to create a STAR-CCM+ model of a Belowground Vertical Dry Cask Simulator (BVDCS) at Sandia National Laboratories (SNL) and validate the model with SNL’s experimental results. The BVDCS consists of a single boiling water reactor assembly fitted with electric heaters encompassed by a containment vessel and shell to represent a belowground spent nuclear fuel (SNF) dry storage system. Blowers are located near the inlet and outlet of the BVDCS to simulate crosswind conditions. In addition to the experimental results, the STAR-CCM+ model developed for this study is compared with a previous computational fluid dynamics (CFD) model in a different software program, which is used as a software-to-software benchmark. The experimental results provide a dataset to compare the STAR-CCM+ model results for a variety of different conditions. The main objective is to validate and improve STAR-CCM+ CFD models for spent nuclear fuel storage systems with explicitly modeled external environments and “wind driven” crossflows. These CFD models aide in the study of external particle deposition in spent nuclear fuel storage systems, which is important to predicting the significance of chloride induced stress corrosion cracking (CISCC). In addition to experimental comparison, a sensitivity analysis study is performed using the STAR-CCM+ model. The sensitivity analysis provides a quantitative assessment of the sensitivity of various parameters. This helps provide information on various parameters that are of particular importance to constructing a model representative of real life systems. The STAR-CCM+ model compared well to the experimental results showing similar responses to changes in cross wind flow, and a number of parameters are identified for model improvement.

Jensen, Ben J.↗

Using Computational Storage Devices: OpenMP/MPI and Charliecloud [Slides]

Originally used Spark and HadoopFS. Collected interesting results, but this method had its issues: limited application, too much overhead to gauge CSDs’ raw performance. Solution? Rewrite our benchmarks without Spark using Serial Python and Serial & Parallel C++ (Combinations of OpenMP & OpenMPI). Compared to Spark and Python, C++ implementation is a lot faster. Caveat: an expert with Spark or Python would likely be able to improve the performance of those implementations. Computational power of our CSDs seem to be much lower than the host machine. Using all 4 cores of a single CSD, the job takes ~6.8x longer than using just one core on the host machine. Host also seems to scale better with increasing file size. Resulting Question: When, if ever, would it make sense to use CSDs for compute rather than a much-faster host?

97 MATHEMATICS AND COMPUTING↗