Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “storage throughput”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Low-Temperature Plasma-Based Metrology of Lithium-Ion Battery Electrode Materials (CRADA Final Report)

As part of the Cyclotron Road program, SirenOpt Inc. evaluated its low-temperature plasma-based metrology sensor prototype for measuring multiple critical properties of lithium-ion battery electrode materials in parallel and in real-time. Cost-effective, minimal-waste manufacturing of high-performance battery electrode materials will be vital for achieving society’s net-zero carbon emission goals. Because existing electrode metrology sensors cannot operate within most sections of manufacturing lines, manufacturers often complete hundreds of processing steps before they can test their products and detect problems. When manufacturers perform these offline tests, they typically only test a small portion of the manufactured products. Current electrode manufacturing thus often yields many low-quality products, or off-spec products that must be thrown away all together. For example, at least 6% of the total lithium-ion battery manufacturing cost (i.e., over $250 million/year for the average gigafactory) is devoted to processing defective electrodes that are not scrapped until performance tests are failed during late-stage quality control checks. Electrode variability also leads manufacturers to build extra cells into battery packs to reduce the risk of poor performance. For example, many electric vehicle (EV) manufacturers include up to 10% more cells than needed, which substantially increases the cost and weight of the final EV product. The SirenOpt sensor can potentially enable early detection of poorly manufactured electrodes and allow them to be removed earlier from manufacturing lines, which can save battery manufacturers (hundreds of) millions of dollars per year. The sensor can further be used to improve product quality by accelerating R&D and process optimization, improving quality control, and enabling real-time process control. Overall, a real-time, in-situ metrology strategy can create unprecedented opportunities for implementation of smart manufacturing practices and advanced quality and process control solutions to realize higher battery electrode throughput and performance.

25 ENERGY STORAGE↗

Salt Hydrate Eutectic Thermal Energy Storage for Building Thermal Regulation (Final Technical Report)

Thermal energy storage is anticipated to play an important role in developing the power grid of the future - a power grid that meets increasing demands of users, is resistant to disruptions, but also allows for greater penetration of renewable resources. Specifically, thermal energy storage materials can be integrated into HVAC systems and building envelopes, where they can be used to shift power demands for building climate control from periods of peak demand to periods of low demand. Phase change materials (PCMs) are compelling as low-cost, high energy density thermal energy storage materials for building thermal management. However, there is a lack of high performance low-cost PCMs within the specific temperature ranges which would most effectively allow for power load shifting. Inorganic salt hydrates represent a promising class of PCMs, but their inherent limitations cause them to be currently unavailable for reliable building applications. The overarching goals of this research effort are to: 1) Discover low-cost, high volumetric density salt hydrate eutectic PCMs to store low-quality heat (10 to 40 °C); 2) Introduce a high thermal conductivity matrix to reduce the time constant for energy storage to ~0.1 to 1 hr, incorporate nucleation catalysts to decrease undercooling, and utilize microencapsulation and shape stabilization approaches, minimizing moisture loss/gain, mitigating phase separation, and maintaining stable melting behavior over the lifetime of the compounds; 3) Evaluate the impact these systems have on peak load shifting, and the potential for overall energy savings under different climatic scenarios and building configurations. These goals will be achieved by an integrated research program consisting of six cohesive research subtasks: 1) Materials discovery of eutectic salt hydrate PCMs by using computationally predicted thermodynamic equilibria, coupled with high-throughput experimental validation, 2) Rapid experimental screening of nucleation catalysts identified through robust computational databases, 3) Embedding salt hydrate PCM into a low cost and scalable high conductivity matrix, 4) Microencapsulation of salt hydrate microspheres using hybrid inorganic-polymer microencapsulation approach, 5) Shape stabilization by thermoreversible salt hydrate salogels, and 6) Analysis of end-use using thermal simulations, and characterization of mock-up energy storage finished components.

25 ENERGY STORAGE↗

An Intelligent Distributed Ledger Construction Algorithm for IoT

Blockchain is the next generation of secure data management that creates near-immutable decentralized storage. Secure cryptography created a niche for blockchain to provide alternatives to well-known security compromises. However, design bottlenecks with traditional blockchain data structures scale poorly with increased network usage and are extremely computation-intensive. This made the technology difficult to combine with limited devices, like those in Internet of Things networks. In protocols like IOTA, replacement of blockchain's linked-list queue processing with a lightweight dynamic ledger showed remarkable throughput performance increase. However, current stochastic algorithms for ledger construction suffer distinct trade-offs between efficiency and security. This work proposed a machine-learning approach with a multi-arm bandit that resolved these issues and was designed for auditing on limited devices. This algorithm was tested in a reinforcement-learning environment simulating the IOTA ledger's construction with a decision tree. This study showed through regret analysis and experimentation that this approach was secure against impulse manipulation attacks while remaining energy-efficient. Although the IOTA protocol was a pioneer for lightweight distributed ledgers, it is expected that future blockchain protocols will adopt techniques similar to those presented in this work.

multi-arm bandit↗

Non‐Equilibrium Synthesis Methods to Create Metastable and High‐Entropy Nanomaterials

Stabilizing multiple elements within a single phase enables the creation of advanced materials with exceptional properties arising from their complex composition. However, under equilibrium conditions, the Hume–Rothery rules impose strict limitations on solid-state miscibility, restricting combinations of elements with mismatched crystal structures, atomic radii, valence states, or electronegativities. This severely narrows the accessible compositional space for creating new inorganic materials. In this review, we highlight how non-equilibrium synthesis methods, featuring ultrafast heating and quenching, can overcome these thermodynamic barriers, enabling integration of immiscible elements into metastable and high-entropy nanostructures. The resulting materials benefit from both kinetic trapping and stabilization by high configurational entropy, leading to enhanced phase stability. These materials can exhibit unique structural and functional properties that are needed for advancing catalysis, energy storage, thermoelectrics, and sensing. Furthermore, the ability of non-equilibrium methods to generate unconventional compositions and structures expands the material design space dramatically, offering rich datasets for AI-guided materials discovery. When combined with their inherent high-throughput and scalable characteristics, these approaches enable rapid, iterative optimization and accelerate the development and industrial production of next-generation inorganic materials.

high-entropy materials↗

HEPOM: Using Graph Neural Networks for the Accelerated Predictions of Hydrolysis Free Energies in Different pH Conditions

Hydrolysis is a fundamental family of chemical reactions where water facilitates the cleavage of bonds. The process is ubiquitous in biological and chemical systems, owing to water’s remarkable versatility as a solvent. However, accurately predicting the feasibility of hydrolysis through computational techniques is a difficult task, as subtle changes in reactant structure like heteroatom substitutions or neighboring functional groups can influence the reaction outcome. Furthermore, hydrolysis is sensitive to the pH of the aqueous medium, and the same reaction can have different reaction properties at different pH conditions. In this work, we have combined reaction templates and high-throughput ab initio calculations to construct a diverse data set of hydrolysis free energies. The developed framework automatically identifies reaction centers, generates hydrolysis products, and utilizes a trained graph neural network (GNN) model to predict ΔG values for all potential hydrolysis reactions in a given molecule. The long-term goal of the work is to develop a data-driven, computational tool for high-throughput screening of pH-specific hydrolytic stability and the rapid prediction of reaction products, which can then be applied in a wide array of applications including chemical recycling of polymers and ion-conducting membranes for clean energy generation and storage.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Identification of Solid-Electrolyte Interphase Species by Joint Characterization of Li-Ion Battery Chemistry by Mass Spectrometry and Electrochemical Reaction Networks

The formation and stability of the solid-electrolyte interphase (SEI) play central roles in determining the long-term performance and safety of modern electrochemical energy storage systems. Despite decades of research, the SEI’s heterogeneous, dynamic, and multiphase nature has defied comprehensive molecular-level characterization, creating a critical knowledge gap that limits rational battery design. In this work, we introduce a computational−experimental framework that integrates high-throughput quantum chemistry calculations, data-driven electrochemical reaction networks (eCRNs), stochastic algorithms, and laser desorption/ionization Fourier transform ion cyclotron resonance mass spectrometry (LDI-FTICR-MS) to unravel SEI formation in carbonatebased electrolytes without imposing predefined mechanisms. We constructed the most comprehensive eCRN to date, spanning over 10,000 species and 209 million reactions. Through stochastic network analysis, we successfully recovered 27 species that were previously reported in the literature and predicted 28 novel SEI species nearly doubling our scientific knowledge in this area. Each new species was rigorously confirmed through advanced mass spectral analysis of its distinct molecular and isotopic signatures. We kinetically refined the formation pathways for a select set of both previously reported and novel SEI products, revealing kinetically feasible elementary reaction mechanisms with activation barriers below 1 eV. This computational−experimental approach deepens our molecular-level understanding of SEI chemistry by resolving which species form and through which decomposition mechanisms they emerge. Such knowledge provides the foundation necessary to connect electrolyte composition to the resulting SEI components, a critical step toward a more informed electrolyte development in next-generation lithium-based batteries.

25 ENERGY STORAGE↗

Experimental Testing of Particle Erosion and Attrition in CSP Systems

In CSP systems using solid particles for heat transfer, erosion from the falling particles can damage the system components upon impact, and from sliding against the component walls. Furthermore, the resulting attrition of particles can change the thermal performance due to alterations in particle morphology. The research on these issues has been limited to industrial applications, and don’t necessarily coincide with the operating conditions in CSP systems. In this work, we investigated the durability of the particles selected as the heat transfer media, as well as special substrate materials that are of interest as lining materials to the particle storage tanks and hoppers. Three different erosion phenomena were studied: impact, abrasion, and attrition erosion. The low-temperature experiments revealed negligible losses from attrition and abrasion erosion. Although the substrates indicated visible surface damage from impact erosion, the actual material mass loss was small even after a throughput of 500kg of particles 63 days of 1MW CSP plant operation assuming 14 hours per day of operation. Erosion is typically classified as impact, abrasion, or attrition erosion. For example, the CSP systems utilizing solid particles as heat transfer media will likely experience impact erosion on the receiver hopper and heat exchanger walls as the solid particles fall from the reservoir. Additionally, there will be sliding erosion along the receiver walls as particles move through the hopper, and lastly, there will also be attrition erosion as the particles rub against each other. The extent of erosion depends on many factors including but not limited to particle shape and size, material hardness/brittleness and ductility, and particle impact speed and angle. Mechanistic erosion equations that are available in the literature are mostly derived from data pertaining to specific experiments and therefore can’t be applied to all applications without suitable adjustments. Survey of the literature relating to particle-based receivers revealed that the most prevalent approach has been to choose low velocities to limit erosion, but to our knowledge, little effort has been put in to fully characterize erosion at the expected operating conditions. A relatively recent work investigated the erosion of wire mesh proposed for use in a particle receiver, where the results actually showed an increase in mass as oxidation occurred on the mesh surface but the work did not investigate the particle attrition rate, and the erosion rate of a solid substrate. The end goal of this work is to develop a comprehensive particle and substrate durability model that will allow a comprehensive understanding of particle-based CSP operating conditions on component durability.

14 SOLAR ENERGY↗

Active sampling of volatile chemicals for non-invasive classification of chicken eggs by sex early in incubation

According to industry estimates, approximately 7 billion day-old male chicks are disposed of annually worldwide because they are not of use to the layer industry. A practical process to identify the sex of the egg early in incubation without penetrating the egg would improve animal welfare, reduce food waste and mitigate environmental impact. We implemented a moderate vacuum pressure system through commercial egg-handling suction cups to collect volatile organic compounds (VOCs). Three separate experiments were set up to determine optimal conditions to collect eggs VOCs to discriminate male from female embryos. Optimal extraction time (2 min), storage conditions (short period of incubation during egg storage (SPIDES) at days 8–10 of incubation), and sampling temperature (37.5°C) were determined. Our VOC-based method could correctly differentiate male from female embryos with more than 80% accuracy. These specifications are compatible with the design of specialized automation equipment capable of high-throughput, in-ovo sexing based on chemical sensor microchips.

Borras, Eva↗

Nanomechanical mapping and strain rate sensitivity of microcrystalline cellulose

Nanoindentation provides a convenient and high-throughput means for mapping mechanical properties and for measuring the strain rate sensitivity of a material. Here, nanoindentation was applied to the study of microcrystalline cellulose. Here, constant strain rate nanoindentation revealed a depth dependence of nanohardness and modulus, mostly attributed to material densification. Nanomechanical maps of storage modulus and hardness resolved the shape and size of voids present in larger particles. In smaller, denser particles, however, where storage modulus varied little spatially, there was still some spatial dependence of hardness, which can be explained by cellulose’s structural anisotropy. Additionally, hardness changed with the indentation strain rate in strain rate jump tests. The resulting strain rate sensitivity values were found to be in agreement with those obtained by other techniques in the literature.

36 MATERIALS SCIENCE↗

From atomistic models to machine learning: Predictive design of nanocarbons under extreme conditions

The formation of technologically valuable nanocarbon structures under extreme conditions, such as those produced during high-explosive detonations, remains poorly understood but holds significant potential for the development of controlled synthesis pathways. While detonation shockwaves provide the high-pressure, high-temperature environment required for nanodiamond formation, subsequent cooling and decompression dictate whether the diamond phase is preserved or transformed into other nanocarbon structures. Here, in this study, we employ GPU-accelerated reactive molecular dynamics (ReaxFF) simulations to investigate the graphitization and structural remodeling of detonation nanodiamond under nonlinear quench and pressure-release trajectories. We further investigate how the initial nanodiamond morphology; cuboctahedral, octahedral, or hexagonal prism influences the resulting transformation products. Evolution of nanostructure, allotrope (via simulated x-ray diffraction), carbon hybridization, and ring statistics are tracked during a two-stage quench from 5000 K to 60 GPa. Rapid cooling combined with slow decompression optimizes cubic diamond retention, whereas slow cooling with rapid pressure release promotes surface-to-core graphitization, producing concentric sp 2 -hybridized layers and hollowed inner shells. Octahedral nanodiamonds evolve into carbon nano-onions, initially forming bucky diamonds that progressively transform into fully sp 2 -hybridized structures, while hexagonal prisms preferentially form parallel-stacked graphite layers resembling carbon dots. Transient hexagonal diamond (lonsdaleite) emerges as an interfacial phase, suggesting potential reversibility in the shock-induced graphite-to-diamond transformation pathway transformation route. To extend predictive capabilities, we trained machine learning (ML) regressors on over 10 5 node-hours of molecular dynamics (MD) trajectories. A multilayer perceptron (MLP) model reliably predicts the number of graphitized layers from temperature–pressure trajectories with a coefficient of determination (R 2 ) exceeding 0.90. This high predictive fidelity enables efficient, high-throughput mapping of the synthesis parameter space for optimized graphitization outcomes. Collectively, morphological control combined with optimized quench–decompression conditions promote the selective synthesis of nanocarbon allotropes. This work establishes a data-driven framework for the rational, a priori design of carbon nanomaterials for applications in energy storage, sensing, and biomedicine.

Detonation nanodiamond remodeling↗

Development of Composite Photocatalyst Materials that are Highly Selective for Solar Hydrogen Production and their Evaluation in Z-Scheme Reactor Designs

The key technology gap preventing a vertically stacked dual-bed particle suspension reactor from achieving the DOE MYRD&D ultimate cost target for H 2 production remains the lack of materials in particle form factor that exhibit ≥10% solar-to-H 2 energy conversion (STH) efficiency as a suspension. Therefore, our project goals centered around strategies to increase the STH efficiency by enhancing photophysical properties of perovskite oxide particles including increased visible-light absorption, increased selectivity for electrocatalysis of the H 2 evolution reaction (HER) and the O 2 evolution reaction (OER) through development of ultrathin oxide coatings, correlating composition and structure to function, and improving understanding of multiscale transport and kinetic processes.

08 HYDROGEN↗

Computational synthesis of 2D materials: A high-throughput approach to materials design

2D materials find promising applications in next-generation devices, however, large-scale, low-defect, and reproducible synthesis of 2D materials remains a challenging task. Here, to assist in the selection of suitable substrates for the synthesis of as-yet hypothetical 2D materials, we have developed an open-source high-throughput workflow package, Hetero2d, that searches for low-lattice mismatched substrate surfaces for any 2D material and determines the stability of these 2D-substrate heterostructures using density functional theory (DFT) simulations. Hetero2d automates the generation of 2D-substrate heterostructures, the creation of DFT input files, the submission and monitoring of computational jobs on supercomputing facilities, and the storage of relevant parameters alongside the post-processed results in a MongoDB database. We demonstrate the capability of Hetero2d in identifying stable 2D-substrate heterostructures for four 2D materials, namely 2H-MoS 2 , 1T- and 2H-NbO 2 , and hexagonal-ZnTe, considering 50 cubic elemental substrates. We find Cu, Hf, Mn, Nd, Ni, Pd, Re, Rh, Sc, Ta, Ti, V, W, Y, and Zr substrates sufficiently stabilize the formation energies of these 2D materials, with binding energies in the range of ~0.1–0.6 eV/atom. Upon examining the z-separation, the charge transfer, and the electronic density of states at the 2D-substrate interface, we find a covalent type bonding at the interface which suggests that these substrates can be used as contact materials for the 2D materials. Hetero2d is available on GitHub as an open-source package under the GNU license.

36 MATERIALS SCIENCE↗

SOMAS: a platform for data-driven material discovery in redox flow battery development

Abstract Aqueous organic redox flow batteries offer an environmentally benign, tunable, and safe route to large-scale energy storage. The energy density is one of the key performance parameters of organic redox flow batteries, which critically depends on the solubility of the redox-active molecule in water. Prediction of aqueous solubility remains a challenge in chemistry. Recently, machine learning models have been developed for molecular properties prediction in chemistry and material science. The fidelity of a machine learning model critically depends on the diversity, accuracy, and abundancy of the training datasets. We build a comprehensive open access organic molecular database “Solubility of Organic Molecules in Aqueous Solution” (SOMAS) containing about 12,000 molecules that covers wider chemical and solubility regimes suitable for aqueous organic redox flow battery development efforts. In addition to experimental solubility, we also provide eight distinctive quantum descriptors including optimized geometry derived from high-throughput density functional theory calculations along with six molecular descriptors for each molecule. SOMAS builds a critical foundation for future efforts in artificial intelligence-based solubility prediction models.

25 ENERGY STORAGE↗

Machine learning-assisted ultrafast flash sintering of high-performance and flexible silver–selenide thermoelectric devices

Flexible thermoelectric generators (TEGs) have shown immense potential for serving as a power source for wearable electronics and the Internet of Things. A key challenge preventing large-scale application of TEGs lies in the lack of a high-throughput processing method, which can sinter thermoelectric (TE) materials rapidly while maintaining their high thermoelectric properties. Herein, we integrate high-throughput experimentation and Bayesian optimization (BO) to accelerate the discovery of the optimum sintering conditions of silver–selenide TE films using an ultrafast intense pulsed light (flash) sintering technique. Due to the nature of the high-dimensional optimization problem of flash sintering processes, a Gaussian process regression (GPR) machine learning model is established to rapidly recommend the optimum flash sintering variables based on Bayesian expected improvement. For the first time, an ultrahigh-power factor flexible TE film (a power factor of 2205 μW m -1 K -2 with a zT of 1.1 at 300 K) is demonstrated with a sintering time less than 1.0 second, which is several orders of magnitude shorter than that of conventional thermal sintering techniques. Further, the films also show excellent flexibility with 92% retention of the power factor (PF) after 10 3 bending cycles with a 5 mm bending radius. In addition, a wearable thermoelectric generator based on the flash-sintered films generates a very competitive power density of 0.5 mW cm -2 at a temperature difference of 10 K. This work not only shows the tremendous potential of high-performance and flexible silver–selenide TEGs but also demonstrates a machine learning-assisted flash sintering strategy that could be used for ultrafast, high-throughput and scalable processing of functional materials for a broad range of energy and electronic applications.

25 ENERGY STORAGE↗

Machine learned potential for high-throughput phonon calculations of metal—organic frameworks

Metal–organic frameworks (MOFs) are highly porous and versatile materials studied extensively for applications such as carbon capture and water harvesting. However, computing phonon-mediated properties in MOFs, like thermal expansion and mechanical stability, remains challenging due to the large number of atoms per unit cell, making traditional Density Functional Theory (DFT) methods impractical for high-throughput screening. Recent advances in machine learning potentials have led to foundation atomistic models, such as MACE-MP-0, that accurately predict equilibrium structures but struggle with phonon properties of MOFs. In this work, we developed a workflow for computing phonons in MOFs within the quasi-harmonic approximation with a fine-tuned MACE model, MACE-MP-MOF0. The model was trained on a curated dataset of 127 representative and diverse MOFs. The fine-tuned MACE-MP-MOF0 improves the accuracy of phonon density of states and corrects the imaginary phonon modes of MACE-MP-0, enabling high-throughput phonon calculations with state-of-the-art precision. The model successfully predicts thermal expansion and bulk moduli in agreement with DFT and experimental data for several well-known MOFs. These results highlight the potential of MACE-MP-MOF0 in guiding MOF design for applications in energy storage and thermoelectrics.

Elena, Alin Marin↗

Verification and Validation of START: A Spent Nuclear Fuel Routing and Decision Support Tool

The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based geospatial decision-support tool being developed by the US Department of Energy’s Office of Integrated Waste Management (IWM) to support federal interim storage for spent nuclear fuel (SNF) and associated transportation. START provides many functions for the IWM program including: serving as a communications tool for conveying geospatial data and information, an options analysis tool for exploring potential transport modes and routes for transporting SNF from nuclear power plants to future federal interim storage facilities, an emergency response planning tool for Tribes and States to identify training needs along potential SNF transport corridors, an environmental analysis tool for estimating potential radiation dose exposure from incident-free and incident-case SNF transport conditions, and a systems analysis support tool providing route-related inputs for system throughput analysis. As part of the START development process, a verification and validation (V&V) effort is being undertaken. In the initial V&V phase, several outputs of the START tool were checked such as the total distance, population and population densities within the buffer zone, and incident free dose. The V&V process is fluid as it will be utilized after each version change to ensure that the core functionalities of the tool are maintained and the results are consistent with the previous versions. Efforts have also been put into developing scripts to aid in the process of automating certain sections of the V&V work. As some of the V&V efforts use Environmental Systems Research Institute’s (ESRI) tools upon which the START framework is built, the START data were compared against outputs from tools like Quantum Geographic Information System (QGIS) for buffer zone populations and route lengths to ensure independence of the V&V process. Good agreement was observed between the START results and the independent V&V studies with the majority of the differences falling between 1% and 5% for populations within the buffer zone and route distance. This presentation describes the development and design of the START tool, V&V methods employed for various metrics of interest and their respective results, and future plans.

START, transportation, GIS, V&V↗

Analysis of phospholipids and triacylglycerols in intravenous lipid emulsions

Intravenous lipid emulsions (ILEs) are used for parenteral nutrition, providing a vital source of essential fatty acids and concentrated energy for patients who are unable to absorb nutrients via the digestive track. They are commonly used to treat local and non-local anesthetic toxicity, and lipophilic drug overdose. ILE are composed of natural lipids, and the composition of these natural lipids can be varied based on their source. The lipids are susceptible to hydrolytic degradation with time, resulting various lipid degradation products such as Lysophosphatidylcholines (LPs), affecting the actual composition of nutrients in the formulation. As a result, the identification and quantification of lipid components, including degradation products, in ILEs are crucial in quality control. In this study, lipids from different batches of ILE Intralipid® 20%, were separated and identified using a UHPLC-ESI-QTOF system and SimLipid® high throughput lipid identification software. Out of 47 lipids identified, 34 were phospholipids (PLs) and the others were triacylglycerols (TAGs). Most of the phospholipids detected were phosphatidylcholines (PC) and Lysophosphatidylcholines (LPC). A total of 9 LPCs, 18 PCs, 6 phosphoethanolamines (PEs), and 1 sphingomyelin (SM) were identified. The LPCs concentration changed with the manufacturing date and storage time. Furthermore, this UHPLC method enabled the identification and quantification of lipids and their decomposition products in complex ILE emulsion mixtures on a single 20-minute chromatographic run.

60 APPLIED LIFE SCIENCES↗

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗