Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distribution monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Data-assimilated time-lapse visco-acoustic full-waveform inversion: Theory and application for injected CO 2 plume monitoring

Continuous seismic monitoring for quantifying CO 2 plume migration and detection of any potential leakages in the subsurface is essential for the security of long-term anthropogenic carbon dioxide geologic storage. Traditional time-lapse full-waveform inversion (TLFWI) methods aim to map the CO 2 distribution by estimating seismic velocity changes, but recent studies find that CO 2 -induced attenuation is an important complement to seismic velocity for tracking the CO 2 plumes and even quantifying the CO 2 saturation. We have developed a novel data-assimilated TLFWI method to construct high-resolution time-lapse velocity and attenuation changes from dense time-lapse monitoring data. This method consists of two theoretical developments: visco-acoustic full-waveform inversion (QFWI) and multiparameter hierarchical matrix-powered extended Kalman filter (mHiEKF). The method is capable of (1) posing temporal constraints to retrieve time-lapse information from dense monitoring data by using mHiEKF, (2) accurately recovering high-spatial-resolution velocity and attenuation perturbations using first-order equation system-based QFWI, and (3) providing the model uncertainty by estimating their model standard deviation. With numerical examples, we first find the effectiveness of the new QFWI on estimating accurate velocity and attenuation models simultaneously. Then, a CO 2 leakage case and a realistic Frio-II CO 2 monitoring case are presented to find the advantages and applicability of our data-assimilated QFWI method for estimating time-lapse changes using dense time-lapse monitoring surveys. Here, by assimilating time-lapse seismic monitoring data over time, our data-assimilated QFWI method can improve the resolution of velocity and attenuation changes and decrease their model uncertainties.

58 GEOSCIENCES↗

Design, Development and Testing Plan for Energy Efficiency Algorithms Related to Building-Integrated Cooling, Heating, and Power Systems

Building-integrated cooling, heating and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. It is estimated that the total CHP technical potential in the commercial building sector is approximately 76 GW, but only a small fraction of it is actually deployed. Advanced control and monitoring systems that realize the full potential of these CHP systems can transform this capacity into an asset for both the owner and the grid and also accelerate the adoption of these systems in the building sector. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. It has been demonstrated by several studies that as much as 30% of building energy use is wasted. Much of the waste results from the inability to anticipate load variations (design day vs. non-design day operations; diurnal variation of loads), identify improper operation, and efficiently operate, control and maintain building systems. Moreover, many buildings, even those with adequate control infrastructure, lack knowledgeable staff to operate and maintain energy systems. Operators of buildings with CHP systems will constantly need to make tradeoffs (economic dispatch) between onsite power generation and purchasing power, between onsite heat production from distributed generation versus heating/cooling from conventional systems, and different passive and active load management measures. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of a clean, efficient, reliable and affordable next-generation integrated energy systems. This report lists the components for which PM, real-time CxV and AFDD algorithms will be developed, how the algorithms will be tested, and metrics that will be used to validate the algorithms and easy of deployment. Deployment of these algorithms in the field will result in savings reduction in energy consumption of between 10% and 20%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Estimating carrying capacity for juvenile salmon using quantile random forest models

Abstract Establishing robust methods and metrics to evaluate habitat quality is critical for the recovery of endangered Pacific salmonids ( Oncorhynchus spp.). A variety of modeling approaches are used for status and trend monitoring of anadromous species throughout the Pacific Northwest, USA, but current methods may fail to capture the complex relationship between fish and habitat and are often limited in predictive power beyond specific watersheds. Further, the focus on species distribution and abundance is not easily manipulated to predict carrying capacity and traditional stock‐recruitment analyses are reliant on long‐term data which are not always available. In this study, we developed a quantile random forest model to provide estimates of habitat carrying capacity for Chinook salmon ( O. tshawytscha ) parr during the summer months, at both the site and watershed scale. Quantile random forest models allow for the consideration of noisy data, correlated variables, and non‐linear relationships: common features in fish–habitat datasets. We leveraged Columbia Habitat Monitoring Program data to select habitat co‐variates and predict capacity at those sites. We also identified a set of globally available attributes to extrapolate capacity estimate predictions throughout wadeable streams within the Columbia River basin. Total capacity estimates for watersheds closely matched estimates from alternative fish productivity models. Carrying capacity estimates based on quantile random forest models, like those presented here, provide managers a framework to guide the identification, prioritization, and development of habitat rehabilitation actions to recover salmon populations.

See, Kevin E.↗

Hydrologic investigations of radar-rainfall error propagation to rainfall-runoff model hydrographs

Rainfall is arguably the most important yet most variable input for rainfall-runoff hydrologic models. In this study, the authors search for the characteristics of radar-rainfall estimates that are most important for skillful streamflow predictions. They perform comprehensive hydrologic investigations of radar-rainfall characteristics, including spatiotemporal resolution, radar range visibility, statistical characterization of rainfall variability, all vis-a-vis basin characteristics such as size and river network topology. Since the true rainfall fields are unknown, the authors exploit a paradigm of using two independently constructed radar-rainfall products i.e., Multi-Radar Multi-Sensor and IFC-ZR used operationally by the Iowa Flood Center (IFC). Using the distributed hydrologic model called the Hillslope-Link Model for the domain of the state of Iowa, they evaluate streamflow prediction at 140 USGS gauge stations that monitor rivers in Iowa. Through spatial and temporal rainfall aggregation experiments, the authors show that the impact of spatial and temporal resolution of rainfall is significant typically for smaller basins while starts reducing significantly for basins larger than 1,000 km 2 . Other rainfall characteristics they explored do not reveal a strong signature in the relationship of rainfall differences between the two products and hydrograph errors. However, exploring the product similarities rather than differences reveals that the basin-wide rainfall volume has the most significant effect on streamflow prediction. The results from this study are generalizable for all rainfall observing systems.

54 ENVIRONMENTAL SCIENCES↗

DER Translate

SAND2024-13723O This software translates and maps any .xlsx-based distributed energy resource (DER) device from the SunSpec certification registry (https://sunspec.org/certified-registry/) to a JSON-based DER models map. It is then read by DER monitoring tools for applications such as network intrusion detection and system health monitoring. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fragkos, Georgios↗

Measured Thermal and Fast Neutron Fluence Rates ATR Cycles 171A ATF (Rev. 1)

This report contains the thermal (2200 m/s) and fast (E>1MeV) neutron fluence rate data for ATR Cycle 171A ATF which were measured by the Radiation Measurements Laboratory (RML) as requested by the Power Reactor Programs (ATR Experiments) Radiation Measurements Work Order. This report contains fluence rate values corresponding to the particular elevations (relative to the 80-ft. core elevation) where the measurements were taken. The data in this report consists of (1) a table of the ATR power history and distribution, (2) a listing of the calculated thermal and fast neutron fluence rates, and (3) plots of calculated both the thermal and fast neutron fluence rates. The fluence rates reported are for the average power levels given in the table of power history and distribution. During the irradiation of Cycle 152A, the RML performed additional flux measurements to assess core reconfiguration issues. Measurements using cadmium covered as well as bare neutron monitors in the Southwest, Southeast, and H positions of the Center lobe were performed to determine the division in neutron energy between epithermal and thermal neutrons. This is defined as the resonance correction defined in this report. It is used to quantify both thermal and fast neutron flux. For more information please refer to letter, “RADIATION MEASUREMENTS LABORATORY MEASUREMENTS OF IN CORE ATR PHYSICS TESTING DURING CYCLE 152A” dated January 24, 2013, to Casey Stengel from C. C. Jensen. The measured values documented in RML Procedure, “ACMM-3600, Flux Monitoring,” will be used indefinitely until further measurements supersede the current values.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Measured Thermal and Fast Neutron Fluence Rates ATR Cycles 171A IR TMIST 3B

This report contains the thermal (2200 m/s) and fast (E>1MeV) neutron fluence rate data for ATR Cycle 171A which were measured by the Radiation Measurements Laboratory (RML) as requested by the Power Reactor Programs (ATR Experiments) Radiation Measurements Work Order. This report contains fluence rate values corresponding to the particular elevations (relative to the 80-ft. core elevation) where the measurements were taken. The data in this report consists of (1) a table of the ATR power history and distribution, (2) a listing of the calculated thermal and fast neutron fluence rates, and (3) plots of calculated both the thermal and fast neutron fluence rates. The fluence rates reported are for the average power levels given in the table of power history and distribution. During the irradiation of Cycle 152A, the RML performed additional flux measurements to assess core reconfiguration issues. Measurements using cadmium covered as well as bare neutron monitors in the Southwest, Southeast, and H positions of the Center lobe were performed to determine the division in neutron energy between epithermal and thermal neutrons. This is defined as the resonance correction defined in this report. It is used to quantify both thermal and fast neutron flux. For more information please refer to letter, “RADIATION MEASUREMENTS LABORATORY MEASUREMENTS OF IN CORE ATR PHYSICS TESTING DURING CYCLE 152A” dated January 24, 2013, to Casey Stengel from C. C. Jensen. The measured values documented in RML Procedure, “ACMM-3600, Flux Monitoring,” will be used indefinitely until further measurements supersede the current values.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Blue Canyon Dome: Development of a Small-Scale Testbed for Monitoring Underground Explosions

This report documents the development of the Blue Canyon Dome (BCD) testbed, including test site selection, development, instrumentation, and logistical considerations. The BCD testbed was designed for small-scale explosive tests (~5 kg TNT equivalence maximum) for the purpose of comparing diagnostic signals from different types of explosives, the assumption being that different chemical explosives would generate different signatures on geophysical and other monitoring tools. The BCD testbed is located at the Energetic Materials Research and Testing Center near Socorro, New Mexico. Instrumentation includes an electrical resistivity tomography array, geophones, distributed acoustic sensing, gas samplers, distributed temperature sensing, pressure transducers, and high-speed cameras. This SAND report is a reference for BCD testbed development that can be cited in future publications.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Real-Time Inference For MI/RR Deblending

The Fermilab Main Injector (MI) and Recycler Ring (RR) share a common beam loss monitor (BLM) system, making loss events difficult to attribute to their source machine when beam is present in both simultaneously. The Real-time Edge AI for Distributed Systems (READS) project addresses this by deblending BLM readings in real time using machine learning (ML). The current FPGA based implementation meets the sub-3 ms latency requirement but carries a resource intensive hls4ml development cycle, motivating exploration of GPU based deployment. This paper characterizes inference latency on an NVIDIA Jetson Orin Nano and introduces a packet organization scheme for assembling synchronized event frames from seven distributed BLM DAQ streams. Using a Python based DAQ simulation with injected timing jitter in place of unavailable live beam data, the pipeline achieved an average end to end latency of 0.456 ms (σ = 0.122 ms) across 167,000 test frames, comfortably meeting the timing constraint. Early outliers were attributed to TensorRT warm-up rather than steady state limitations, suggesting GPU based inference is a viable alternative to the existing FPGA implementation.

Yu, Kellen [Cornell U.]↗

The Event Detection System in the NEXT-White Detector

This article describes the event detection system of the NEXT-White detector, a 5 kg high pressure xenon TPC with electroluminescent amplification, located in the Laboratorio Subterráneo de Canfranc (LSC), Spain. The detector is based on a plane of photomultipliers (PMTs) for energy measurements and a silicon photomultiplier (SiPM) tracking plane for offline topological event filtering. The event detection system, based on the SRS-ATCA data acquisition system developed in the framework of the CERN RD51 collaboration, has been designed to detect multiple events based on online PMT signal energy measurements and a coincidence-detection algorithm. Implemented on FPGA, the system has been successfully running and evolving during NEXT-White operation. The event detection system brings some relevant and new functionalities in the field. A distributed double event processor has been implemented to detect simultaneously two different types of events thus allowing simultaneous calibration and physics runs. This special feature provides constant monitoring of the detector conditions, being especially relevant to the lifetime and geometrical map computations which are needed to correct high-energy physics events. Other features, like primary scintillation event rejection, or a double buffer associated with the type of event being searched, help reduce the unnecessary data throughput thus minimizing dead time and improving trigger efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploration of Real Time Inference for MI-RR Deblending on GPU/TPU Systems

The Fermilab Main Injector (MI) and Recycler Ring (RR) share a common beam loss monitor (BLM) system, making loss events difficult to attribute to their source machine when beam is present in both simultaneously. The Real-time Edge AI for Distributed Systems (READS) project addresses this by deblending BLM readings in real time using machine learning (ML). The current FPGA based implementation meets the sub-3 ms latency requirement but carries a resource intensive hls4ml development cycle, motivating exploration of GPU based deployment. This paper characterizes inference latency on an NVIDIA Jetson Orin Nano and introduces a packet organization scheme for assembling synchronized event frames from seven distributed BLM DAQ streams. Using a Python based DAQ simulation with injected timing jitter in place of unavailable live beam data, the pipeline achieved an average end to end latency of 0.456 ms (σ = 0.122 ms) across 167,000 test frames, comfortably meeting the timing constraint. Early outliers were attributed to TensorRT warm-up rather than steady state limitations, suggesting GPU based inference is a viable alternative to the existing FPGA implementation.

Yu, Kellen [Fermilab; Cornell U.]↗

Interface effect of Fe and Fe 2 O 3 on the distributions of ion induced defects

The stability of structural materials in extreme nuclear reactor environments—with high temperature, high radiation, and corrosive media—directly affects the lifespan of the reactor. In such extreme environments, an oxide layer on the metal surface acts as a passive layer protecting the metal underneath from corrosion. To predict the irradiation effect on the metal layer in these metal/oxide bilayers, nondestructive depth-resolved positron annihilation lifetime spectroscopy (PALS) and complementary transmission electron microscopy (TEM) were used to investigate small-scale defects created by ion irradiation in an epitaxially grown (100) Fe film capped with a 50 nm Fe 2 O 3 oxide layer. In this study, the evolution of induced vacancies was monitored, from individual vacancy formation at low doses—10 –5 dpa—to larger vacancy cluster formation at increasing doses, showing the sensitivity of positron annihilation spectroscopy technique. Furthermore, PALS measurements reveal how the presence of a metal–oxide interface modifies the distribution of point defects induced by irradiation. TEM measurements show that irradiation induced dislocations at the interface is the mechanism behind the redistribution of point defects causing their accumulation close to the interface. Finally, this work demonstrates that the passive oxide layers formed during corrosion impact the distribution and accumulation of radiation induced defects in the metal underneath and emphasizes that the synergistic impact of radiation and corrosion will differ from their individual impacts.

36 MATERIALS SCIENCE↗

Electrical Fault Detection, Power Quality, Distributed Energy Resource Use Cases, and Cyber Event Applications with the Cyber Grid Guard System Using Distributed Ledger Technology

Electrical utilities continue to deploy more intelligent electronic devices (IEDs) inside and outside electrical substation and are associated with distributed energy resources (DERs). The integrity and confidentiality of data from IEDs is crucial, and distributed ledger technology (DLT) could improve the resilience of microgrids by helping to make these data more secure. The most popular applications using blockchain technology for electrical utilities is in the field is based on energy trading. However, the dynamism of the penetration of customer owned DERs and the deployment of sensors with IEDs have led to the identification of new applications using DLT that are focused on other areas, such as monitoring, operation and management of the grid and its assets. In addition, the majority of studies on electrical grid applications with blockchain were validated with software simulations. Although general monitoring of power systems for using DLT could be evaluated in operational electric grids, other DLT research applications such as defense against cyber-attacks and/or electrical fault detection are not likely to be performed in a real infrastructure because of possible risks to the network/equipment security. This report summarizes the application of power system applications using distributed ledger technology (DLT), providing a secure DLT framework for collecting data from IEDs like power meters and protective relays inside and outside of an electrical substation and/or between two different electrical utilities. In this study, the use case scenarios were created and assessed for different power system application by using DLT. The electrical fault detection for faulted phases (1), power quality monitoring of phase voltage magnitudes, frequency levels and load power factor (2), DERs use case monitoring (3), and cyber-event applications (4) were performed in a test bed with a Cyber-Grid Guard (CGG) system using DLT. It had a real-time simulator with power meters and protective relays in-the-loop. The first section of this report presents a literature review of power system applications using blockchain at research level. The second section shows the theory and equations used on this report. The third section shows the description of the test bed, equipment, architecture, and electrical grid diagrams. The fourth section shows the experimental models and use case scenarios that were performed for the electrical fault detection, power quality, DERs use case, and cyber event applications with the CGG system using DLT. The fifth section shows the results collected from the tests based on comparing the time stamped events of the analog signals from the IEDs, DLT computer and real time simulator. The sixth section performed the discussion of the results for the use case scenarios. Finally, section seven presents the conclusions for this report were presented.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Impact of Behind-the-Meter Heterogeneous Distributed Energy Resources on Distribution Grids: Preprint

The increasing integration of distributed energy resources (DERs) on the electric grid brings new challenges and opportunities for utility grid operations. With the rapid deployment of DERs, there is emerging interest in integrating these controllable devices with utility operations at all levels for monitoring and management. Different types of DERs such as Photovoltaics (PV), energy storage, electric vehicles (EVs), etc. have varying effects on the grid based on how and where they are deployed. Again, the DER deployment and its impact are network-dependent, while the traditional electric grids were not designed to host DERs. To understand the challenges with increasing behind-the-meter (BTM) DERs and to identify the needs in deploying advanced controls, a comprehensive grid impact study is indispensable. This paper investigates the impacts of integrating a mix of DERs in the utility distribution network in Colorado, U.S. Firstly, BTM DERs at the residential scale including distributed PV; battery energy storage systems (BESS); heating, ventilation, and air-conditioning (HVAC) load; electric water heater (EWH) load; and EVs are modeled. The impacts of integrating these resources on the distribution network are evaluated by conducting time-series simulations for different scenarios considering different days to capture the worst-case conditions. Monte Carlo simulations are conducted to generate the realistic EV charging profile. The voltage issues, substation transformer loadings, and critical nodes in the network are identified with the incorporation of uncoordinated EV charging loads and other DER in the network. This analysis helps visualize the DER impact on the grid, identify the challenges, and provides an insight into the new distribution management and control needs to enable reliable and resilient distribution grid operations. Additionally, further analysis is performed to estimate the daily residential electricity cost with the inclusion of DERs under time-of-use tariffs. The result shows the daily residential electricity cost reduced by 20:7% on average with DERs compared to the case without DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

Field Test Bed for Vadose-Zone Monitoring Approaches - 20404

In the Central Plateau at the U.S. Department of Energy Hanford Site, a large inventory of contaminants resides in unsaturated sediments within the approximately 100-meter-thick vadose zone, posing a potential continuing risk to groundwater. Vadose zone remedies used to address these contaminants will require performance monitoring to provide feedback during implementation and for long-term verification that remedial action objectives have been met. Passive approaches may also need long-term monitoring to demonstrate that the flux of contaminants from the vadose zone to the groundwater are below thresholds established to meet groundwater protection goals. Collection of physical (e.g., groundwater or sediment) samples is a common method for identifying contaminant concentration distributions, but this approach is limited by the number of locations and the frequency with which data can be collected. In situ vadose zone measurements have evolved over the past few years to include key measurements of water content, soil water pressure, temperature, and chemical concentration. However, the current generation of sensors is designed for relatively short-term use in near-surface soils or sediments. Geophysical methods have been evolving but are also limited in that they have not been designed for the specific long-term vadose zone monitoring needs at the Hanford Site. Overall, monitoring under unsaturated conditions can be difficult due to the need to install and maintain instrumentation over a large area and depth and the need to identify preferential flow pathways due to geologic and chemical heterogeneities over long periods. Thus, a vadose zone monitoring test bed was initiated to address these challenges and identify cost-effective approaches for implementation and postclosure monitoring of the deep vadose zone. The monitoring test bed is expected to provide valuable field-scale information for the design of vadose zone monitoring systems. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A study on computational fluid dynamics modeling of a refrigerated container for COVID-19 vaccine distribution with experimental validation

A key issue with the distribution of vaccines to prevent COVID-19 is the temperature level required during transport, storage, and distribution. Typical refrigerated transport containers can provide a temperature-controlled environment down to -30 °C. However, the Pfizer vaccine must be carefully transported and stored under a lower temperature between -80 °C and -60 °C. One way to provide the required temperature is to pack the vaccine vials into small packages containing dry ice. Dry ice sublimates from a solid to a gas, which limits the allowable transport duration. This can be mitigated by transporting in a -30 °C refrigerated container. Moreover, because the dry ice will sublimate and thereby release CO 2 gas into the transport container, monitoring the CO 2 concentration within the refrigerated container is also essential. In the present work, a 3D computational fluid dynamics model was developed based on a commercially available refrigerated container and validated with experimental data. The airflow, temperature distribution, and CO 2 concentration within the container were obtained from the simulations. The modeling results can provide guidance on preparing experimental setups, thus saving time and lowering cost, and also provide insight into safety precautions needed to avoid hazardous conditions associated with the release of CO 2 during vaccine distribution.

59 BASIC BIOLOGICAL SCIENCES↗

Variability and associated uncertainty in image analysis for soiling characterization in solar energy systems

The accumulation of soiling on photovoltaic modules and on the mirrors of concentrating solar power systems causes non-negligible energy losses with economic consequences. These challenges can be mitigated, or even prevented, through appropriate actions if the magnitude of soiling is known. Particle counting analysis is a common procedure to characterize soiling, as it can be easily performed on micrographs of glass coupons or solar devices that have been exposed to the environment. Particle counting does not, however, yield invariant results across institutions. The particle size distribution analysis is affected by the operator of the image analysis software and the methodology utilized. The results of a round-robin study are presented in this work to explore and elucidate the uncertainty related to particle counting and its effect on the characterization of the soiling of glass surfaces used in solar energy conversion systems. An international group of soiling experts analyzed the same 8 micrographs using the same open-source ImageJ software package. The variation in the particle analyses results were investigated to identify specimen characteristics with the lowest coefficient of variation (CV) and the least uncertainty among the various operators. The mean particle diameter showed the lowest CV among the investigated characteristics, whereas the number of particles exhibited the largest CV. Additional parameters, such as the fractional area coverage by particles and parameters related to the distribution's shape yielded intermediate CV values. These results can provide insights on the magnitude inter-lab variability and uncertainty for optical and microscope-based soiling monitoring and characterization.

14 SOLAR ENERGY↗

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗