A Real-Time T&D Co-Simulation Platform for Testing Grid Services of Distributed Energy Resources
Not Available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Explore the source record for details and available documents.
In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.
Abstract not provided.
Distributed restoration can exploit smart grid technologies to enhance the resilience of active distribution networks toward a self-healing smart grid. However, the large number of decision variables, especially the binary ones for reconfiguration, bring challenges to developing scalable distributed distribution service restoration (DDSR) strategies. This paper proposes a fully distributed solution procedure based on the alternating direction method of multipliers (ADMM) for mixed-integer programming problems and applies to develop the DDSR framework. The method consists of relax-drive-polish phases, 1) relaxing binary variables, and applying the convex ADMM as a warm start; 2) driving the solutions toward Boolean values through a proximal operator; 3) fixing the obtained binding binary variables and solving the rest of the problem to polish results and achieve a high-quality suboptimal solution. Then, an autonomous clustering strategy and consensus ADMM are integrated with the proposed method to realize the fully distributed cluster-based framework of DDSR. This framework can first determine DER scheduling and switch status for reconfiguration to energize the out-of-service areas from local faults, and then provide the load restoration solution in a distributed manner for total blackouts in large-scale distribution networks. Furthermore, the effectiveness and scalability of the proposed DDSR framework are demonstrated through testing on the IEEE 123-node, IEEE 8500-node, and synthetic 100k-node test feeders.
Microservices are a powerful new way of building, customizing, and deploying distributed services owing to their flexibility and maintainability. Several large-scale distributed platforms have emerged to serve the growing needs of data-centric workloads and services in commercial computing. Concurrently, high-performance computing (HPC) systems and software are rapidly evolving to meet the demands of diversified applications and heterogeneity. The interplay of hardware factors, software configuration parameters, and the flexibility offered with a microservice architecture makes it nontrivial to estimate the optimal service instantiation for a given application workload. Further, this problem is exacerbated when considering that these services operate in a dynamic and heterogeneous HPC environment. An optimally integrated service can be vastly more performant than a haphazardly integrated one. Existing performance tools for HPC either fail to understand the request-response model of communication inherent to microservices or they operate within a narrow scope, limiting the insight that can be gleaned from employing them in isolation. We propose a methodology for integrated performance analysis of HPC microservices frameworks and applications called SYMBIOSYS. We describe its design and implementation within the context of the Mochi framework. This integration is achieved by combining distributed callpath profiling and tracing with a performance data exchange strategy that collects fine-grained, low-level metrics from the RPC communication library and network layers. The result is a portable, low-overhead performance analysis setup that provides a holistic profile of the dependencies among microservices and how they interact with the Mochi RPC software stack. Using HEPnOS, a production-quality Mochi data service, we demonstrate the low-overhead operation of SYMBIOSYS at scale and use it to identify the root causes of poorly performing service configurations.
In this paper, a data-centric communication framework is proposed for multicast routable generic object-oriented substation event (GOOSE) messages (MRGM) over the wide area network (WAN) for effective substation-to-substation (SS2SS) and substation to control center (SS2CC) communications. In this structure, the IEC 61850 GOOSE message is transmitted over the WAN using the data distribution service (DDS) as a fast, reliable, and secure data-centric communication middleware. The main feature of this framework is its multicast capability, where several authorized subscribers can receive a published message simultaneously. This can significantly improve the system monitoring and control of the protection systems in modern smart grids, where intelligent schemes can be applied. The effectiveness of the proposed platform, in terms of total end-to-end delay between participants, is evaluated through experimental results obtained from the actual hardware-based test setup developed at the Florida International University (FIU) smart grid testbed. The results demonstrate that the latency between sending and receiving a GOOSE message among participants is within its maximum time span defined by the IEC 61850-90-5 working group for communications over the WAN.
For individuals, businesses, and communities focused on building resilient electrical grid infrastructure, wind energy can provide an affordable, accessible, and compatible distributed energy resource option that also enhances the capabilities of local grid operations. The Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL) project is a multi-year distributed wind research effort, driven through a partnership between four Department of Energy National Laboratories and industry to develop and improve the planning, design, and operation of wind-centered microgrids to complement solar, energy storage, and other distributed energy resources for grid-tied and isolated operation (U.S. Department of Energy, 2021). This report documents the application of methods developed through the initial three years of the MIRACL project to two real-world distributed wind reference systems. Specifically, the methods demonstrated in this report include 1) a market valuation framework to comprehensively value the services distributed wind can provide and 2) a resilience framework that enables stakeholders to characterize distribution system resilience and compare grid investment decisions from a resilience perspective. Additional methods mentioned in this report include distributed hybrid system design methods for grid resilience, advanced control co-simulation platforms, and power hardware-in-the-loop (PHIL) models. Preliminary results from these additional methods are presented in this report and will be demonstrated and/or applied to the reference systems in the coming year. The purpose of applying these methods to reference systems is to drive technology transfer of the theories, methodologies, and technologies developed under the MIRACL project and increase the number of referenceable case studies available to stakeholders interested in additional value-added capabilities of wind systems beyond bulk energy supply (i.e. kilowatt-hours).
Smart inverters (SI) have huge potential in providing grid services which has not been fully realized yet. One of these grid services, distribution network voltage regulation by SI, can improve the network voltage by regulating the SI reactive and active power output. Voltage regulation by SI is much faster compared to traditional voltage regulating devices, e.g. tap changing transformer, capacitor banks. However, there is gap in available published literature on the characteristics of SIs when the SI is controlled by local controller or external control signal. This paper presents the experimental study to characterize SI reactive power regulation response to two different control methods: autonomous control method and remote dispatch method. It was found that IS reactive power regulation response could be significantly different in terms of delay, and ramp rate for these two methods. Finally, Power-Hardware-in-The-Loop (PHIL) tests were conducted to evaluate the performance of these two methods. The PHIL tests results show that SI response characteristics for autonomous control method and remote dispatch method need to be considered during planning for distribution network voltage regulation using SI.
To meet south Minneapolis, Minnesota's clean energy goals, the community exploring opportunities to transition Sabathani Community Center into a resilience hub to provide critical community services during power outages, including shelter and warmth or cooling, continued food distribution services, and more. The National Renewable Energy Laboratory, through the U.S. Department of Energy's Communities LEAP (Local Energy Action Program) pilot, worked with Sabathani to quantify the costs and benefits of installing stand-alone solar photovoltaics (PV) and PV paired with battery systems to reduce energy costs, avoid emissions, and improve resilience.
To meet south Minneapolis, Minnesota's clean energy goals, the community exploring opportunities to transition Minneapolis American Indian Center (MAIC) into a resilience hub to provide critical community services during power outages, including shelter and warmth or cooling, continued food distribution services, and more. The National Renewable Energy Laboratory, through the U.S. Department of Energy's Communities LEAP (Local Energy Action Program) pilot, worked with MAIC to quantify the costs and benefits of installing stand-alone solar photovoltaics (PV) and PV paired with battery systems to reduce energy costs, avoid emissions, and improve resilience.
The report highlights key considerations for retail regulators in the footprints of the Southwest Power Pool (SPP) or Midcontinent Independent System Operator (MISO) in states that previously opted out of allowing third-party aggregation participation under FERC Order 719 and that may want to explore reversing the decision due to a changing policy environment under new FERC orders (i.e., 2222) and/or tightening resource adequacy constraints. Through a document review and a series of 27 interviews with regulators, aggregators, and other industry professionals, this document provides a high-level policy overview of the retail regulator’s role in a selection of processes, rules, and regulations to better understand how states have treated and/or integrated aggregators into wholesale markets. The report summarizes findings in two sections: General Findings and Specific Policy Findings. The General Findings offer high level takeaways such as the fact that 17 of the 20 states in MISO and SPP footprints opted out of third party aggregations following Order 719. Additionally, there is only one state that is fully restructured in the MISO and SPP footprints whereas the rest are vertically integrated, and the majority of third-party aggregations in the U.S. take place in restructured states outside of these footprints. Even so, third-party aggregations do take place in MISO and SPP albeit in small numbers and in an ad hoc regulatory environment. The specific policy findings delve deeper into specific examples of state actions on the topics of jurisdiction, registration and licensing, data governance, dual participation, and dispute resolution. Tables in each category organize state actions into Tiers I-III, which roughly correspond to the possible level of involvement or possible change necessary by state regulators and/or legislators to implement these actions. The tier level does not indicate any value judgement, as each state has respective regulatory limitations and each decision comes with various tradeoffs. One main tradeoff is between simplicity and quick implementation versus comprehensive and prolonged implementation. In many cases, actions in Tier I could be implemented without significant changes by relying on the use of existing processes for an aggregator context. On the other hand, many actions in Tier III are more narrowly designed to address aggregators specifically, but often require more significant changes including the involvement of additional parties through stakeholder engagement or legislative action. In some cases, these tiers are discrete. However, state regulators may also choose to progress through these various tiers sequentially as they phase in aggregators while learning from their experience. With the ability to stack bulk system level services, distributed energy resource aggregations in MISO and SPP could provide various private benefits (e.g., increased value streams to the owner) as well as societally beneficial grid services (e.g., peaking capacity, ancillary services, and other services that increase the grid’s overall operational efficiency). In deciding how to best to enable these benefits, states and retail regulators must weigh various tradeoffs if considering reversing a previous opt out.
We report a distribution service restoration algorithm as a fundamental resilient paradigm for system operators provides an optimally coordinated, resilient solution to enhance the restoration performance. The restoration problem is formulated to coordinate distribution generators and controllable switches optimally. A model-based control scheme is usually designed to solve this problem, relying on a precise model and resulting in low scalability. To tackle these limitations, this work proposes a graph-reinforcement learning framework for the restoration problem. We link the power system topology with a graph convolutional network, which captures the complex mechanism of network restoration in power networks and understands the mutual interactions among controllable devices. Latent features over graphical power networks produced by graph convolutional layers are exploited to learn the control policy for network restoration using deep reinforcement learning. The solution scalability is guaranteed by modeling distributed generators as agents in a multi-agent environment and a proper pre-training paradigm. Comparative studies on IEEE 123-node and 8500-node test systems demonstrate the performance of the proposed solution.
Lithium-ion batteries (LIBs) are used in a wide range of applications, including cell phones, laptops, power tools, electric vehicles, and grid storage, and are essential for economic growth and addressing climate change. However, the significant demand for LIBs has led to supply chain issues for the United States, as China dominates the processing of battery materials and battery production. To address this concern, NAATBatt International, a trade association of North American battery companies, supported the National Renewable Energy Laboratory in developing a database of companies that mine, process, manufacture, reuse, and recycle batteries in North America. The purpose of this database was to identify strengths and gaps in the supply chain, so that private-government partnerships could develop strategies to create a competitive LIB supply chain in the US. NREL published the first version of this database in 2021 and the second version in 2022. The database includes companies that have a manufacturing facility in North America and are engaged in materials, cells, packs, end-of-life management, as well as those involved in LIB battery modeling, distribution, service and repair, and R&D. In this presentation, we will discuss our approach to collecting data and categorizing various segments and products. We will also provide a summary of the data and present various maps to illustrate the distribution of companies in the database.
This presentation provides an overview of defining a use case for the advanced distribution management system (ADMS) test bed, including fault location, isolation, and service restoration with distributed energy resources.
We consider a price-based revenue management problem with finite reusable resources over a finite time horizon T. Customers arrive following a price-dependent Poisson process, and each customer requests one unit of c homogeneous reusable resources. If there is an available unit, the customer gets served within a price-dependent exponentially distributed service time; otherwise, the customer waits in a queue until the next available unit. In this paper, we assume that the firm does not know how the arrival and service rates depend on posted prices, and thus it makes adaptive pricing decisions in each period based only on past observations to maximize the cumulative revenue. Given a discrete price set with cardinality P, we propose two online learning algorithms, termed batch upper confidence bound (BUCB) and batch Thompson sampling (BTS), and prove that the cumulative regret upper bound is O˜(√PT) , which matches the regret lower bound. In establishing the regret, we bound the transient system performance upon price changes via a novel coupling argument, and also generalize bandits to accommodate subexponential rewards. Here, we also extend our approach to models with balking and reneging customers and discuss a continuous price setting. Our numerical experiments demonstrate the efficacy of the proposed BUCB and BTS algorithms.
Distribution service restoration (DSR) under natural disasters is always a critical and challenging problem for utility companies. An effective solution must not ignore the power-communication interdependency as various systems are getting increasingly connected in the Smart Grid era. In this paper, we propose a two-layer distribution system model with both power and communication components. Based on this model, we formulate the restoration process as a routing problem that schedules the path and action sequence of utility crews that involves repairing damaged components, closing power switches, and enabling communication paths between the control center and remote field devices. Further, we develop a simulation-based method to quantitatively evaluate the restoration process with public reference models of large-scale power systems. The experimental results show that our method improves the total restored energy up to 57.6% and reduces the recovery time up to 63% by considering the power-communication interdependency.
ICE 2.0 Phase 2 Final Report In 2021, Berkeley Lab and Resource Innovations, Inc. launched the “ICE Calculator 2 Initiative” – a national study to refresh the underlying data and enhance the functionality of the ICE Calculator. The Initiative involves Berkeley Lab contracting with sponsoring utilities to administer identical, updated and comprehensive interruption cost surveys to statistically representative samples of each utility’s customers. Berkeley Lab and Resource Innovations then pool the survey results across the utilities and use them to update the analytical engines that drive the ICE Calculator. The ICE Calculator 2 Initiative is being conducted in phases. Each phase involves the administration of interruption cost surveys to the customers of sponsoring utilities, followed by an update to the ICE Calculator based on analysis of the pooled survey results. This report describes the activities and findings from Phase 1 and 2 of the ICE Calculator 2 Initiative. Phase 1 was sponsored by eight utilities: American Electric Power, Commonwealth Edison, Dominion Energy, Duke Energy, DTE Electric, Exelon, National Grid, and Puget Sound Energy. Phase 2 was sponsored by six utilities: Empire District Electric Company, Evergy Missouri, Pacific Gas & Electric, San Diego Gas & Electric, Southern California Edison, and Union Electric. Phase 1 and 2 involved 15 customer interruption cost survey activities representing a total of 30 electricity distribution service territories. ICE Calculator Version 2.0 and 2.2 Comparison This memorandum describes–at a high-level–the improvements in interruption cost estimates for the version 2.2 of the ICE Calculator (released February 2026) compared to version 2.0 (released in April 2025). Version 2.2 of the ICE Calculator corresponds to Phase 2 of the initiative, while version 2.0 corresponds to Phase 1. The improvements in version 2.2 result from both a significant increase in the number of customer responses that have been collected and the identification of seven additional factors that help estimate customer interruption costs.