Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “autonomous energy grids”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

A Framework for Testing Automated Detection, Diagnosis, and Remediation Systems on the Smart Grid

America's electrical grid is currently undergoing a multi-billion dollar modernization effort aimed at producing a highly reliable critical national infrastructure for power - a Smart Grid. While the goals for the Smart Grid include upgrades to accommodate large quantities of clean, but transient, renewable energy and upgrades to provide customers with real-time pricing information, perhaps the most important objective is to create an electrical grid with a greatly increased robustness.

autonomous detection, diagnosis, and remediation (↗
DOE OSTI2020

An intelligent energy router for managing behind-the-meter resources and assets

With increase in distributed energy resources (DERs) and smart loads, each energy resource and load need a separate power conversion system leading to complex coordination and interaction, reduced energy conversion efficiency, coordinating compliance to grid standards (IEEE 1547) from multiple sources, reduced security. Also, multiple vendors with legacy system designs and proprietary communications interfaces result in redundancy and increase in cost of power electronics systems. This paper presents an energy router concept for buildings applications which provides autonomous power flow between sources and loads with a novel agent-based software interface.

Chinthavali, Madhu Sudhan↗
DOE OSTI2020

Enabling Power at Sea: Opportunities for Expanded Ocean Observations through Marine Renewable Energy Integration

The blue economy is a dynamic and rapidly growing movement that captures the interplay between economic, social, and ecological sustainability of the ocean and encompasses numerous maritime sectors and activities (e.g., commerce and trade; living resources; renewable energy; minerals, materials, and freshwater; and ocean health and data). The demand for ocean data to inform scientific, risk reduction, and national security needs is leading to a large increase in the number of deployed ocean observation and monitoring systems, most of which require increased power. Because ocean observation systems are often placed in remote locations, they primarily rely on energy storage (or in some cases in situ energy generation) to power instruments and equipment, which imposes limits on sampling rates, deployment times, and spatiotemporal resolution of data. The U.S. Department of Energy Water Power Technologies Office is exploring the potential for marine renewable energy (MRE) devices (largely wave and tidal energy converters) to provide power to support multiple blue economy opportunities. A portion of these opportunities focus on power at sea markets for providing power in off-grid and offshore locations to support a variety of ocean-based activities, including ocean observation and navigation, underwater vehicle charging, marine aquaculture, marine algae farming, and seawater mining. Initially, research has focused on better understanding how and where MRE can provide a consistent source of reliable power to extend ocean observing missions, including operation of autonomous underwater vehicles. Online surveys as well as phone and in-person interviews were conducted with experts in the field of ocean observing systems and observatories to gather end-user requirements, determine energy needs, identify opportunities for codevelopment, and pinpoint constraints for MRE to meet those needs. The surveys and interviews provided feedback on the potential for powering devices and vehicles using MRE, including identifying common themes and challenges that will inform foundational research and development steps needed to advance the integration of MRE with ocean observing systems. In most cases, additional power generation on the order of watts was identified as significantly beneficial to enhancing ocean observations capabilities.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Coordination of thermostatically controlled loads

Apparatus and methods for a market-based control framework to coordinate a group of autonomous thermostatically controlled loads (TCL) to achieve system-level objectives with pricing incentives is disclosed. In one example of the disclosed technology, a method of providing power to a load via a power grid by submitting bids to a coordinator includes determining an energy response relating price data for one or more energy prices to quantity data for power to be consumed by the load, sending a bid for power for a finite time period based on the energy response to the coordinator, and receiving a clearing price based on: the bid, on bids received from a plurality of additional loads, and a feeder power constraint. In some examples, the energy response is based at least in part on an equivalent thermal parameter model and a control policy indicating one or more power states for the load.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Coordination of thermostatically controlled loads

Apparatus and methods for a market-based control framework to coordinate a group of autonomous thermostatically controlled loads (TCL) to achieve system-level objectives with pricing incentives is disclosed. In one example of the disclosed technology, a method of providing power to a load via a power grid by submitting bids to a coordinator includes determining an energy response relating price data for one or more energy prices to quantity data for power to be consumed by the load, sending a bid for power for a finite time period based on the energy response to the coordinator, and receiving a clearing price based on: the bid, on bids received from a plurality of additional loads, and a feeder power constraint. In some examples, the energy response is based at least in part on an equivalent thermal parameter model and a control policy indicating one or more power states for the load.

Lian, Jianming↗
DOE OSTI2021

Model Based Predictive Control for Frequency Support in Multi-port Autonomous Reconfigurable Solar Plants

Primary frequency support functionality can be an added advantage for any new grid integrated power electronics resource. With increased penetration of power electronics resources, inertial and primary frequency response capabilities are decreasing. In this research paper, an advanced model-based predictive control (MBPC) algorithm for providing frequency support to a new topology of integrated photovoltaic(PV), batterybased energy storage systems (ESS), and high-voltage direct current (HV dc) systems called multi-port autonomus reconfigurable solar (MARS) plants is based on the synchronverter-based control. The simulation of MARS-HV dc system with proposed control strategy is simulated and validated for MARS connected to low short circuit ratio (SCR) grids in PSCAD/EMTDC simulation environment. The control algorithm proposed showcases better performance in terms of frequency nadir improvement and frequency steady state improvemnt with respect to no frequency control.

Marthi, Phani Ratna Vanamali↗
DOE OSTI2020

Estimation of solar photovoltaic energy curtailment due to volt–watt control

The widespread deployment of autonomous inverter‐based solutions for mitigating voltage and frequency excursions caused by high‐penetration photovoltaic (PV) systems has drawn increased attention due to their potential impact on PV production. It is now important to quantify the amount of solar energy curtailed as a result of the activation of inverter‐based grid support functions (GSFs). This study proposes a methodology for estimating the impact of volt–watt on customer PV energy curtailment using smart meter voltage data. This method estimates maximum possible curtailment for a given volt–watt curve based on the customer smart meter voltage during the time period of interest. This study compares the proposed methodology with field measurements using irradiance and customer inverter data from Hawaii as well as with results from a previous simulation‐driven study on the impact of advanced inverter GSF activation on PV energy curtailment. Results show that the proposed method for estimating lost PV production caused by volt–watt control aligns reasonably well with field measurements and computer simulations for hundreds of customers. The proposed method could be used to estimate customer energy curtailment, which could inform future compensation mechanisms for utilities leveraging customer‐sited resources to mitigate high voltage and defer infrastructure upgrades.

Emmanuel, Michael↗
NASA NTRSDate not supplied

Energy-Optimized Path Planning for Uas in Varying Winds Via Reinforcement Learning

In this paper we propose a reinforcement learning (RL) algorithm for path planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to UAV path planning problems are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs need to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health, and off-nominal battery power consumption. Machine learning methods such as reinforcement learning (RL) have the potential to revolutionize how vehicles navigate in such uncertain environments. In this study, we compute UAV trajectories from a pre-determined starting position to a target cell within a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption and operation time. The UAV navigates the grid by taking actions to move in any of the eight cardinal and inter-cardinal directions, under constant thrust profile. The resultant UAV state is sampled from a probability distribution which accounts for the UAV’s action, local wind velocity, and the presence of obstacles or boundaries. As the unmanned airspace gets more complex due to multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance need to be made. Our Markov Decision Process (MDP) environment model can capture any combination of these in the optimization objective, making it novel compared to other work in the field.

trajectory planning↗
DOE OSTI2022

Assessing the Technical Potential of Fast Frequency Response in Grid-Supportive Loads

Fast frequency response (FFR) is a critical tool for grid operators to manage contingency events in low-inertia systems. While large generators and loads are more commonly used, many smaller end use loads, in aggregate, can provide FFR across a large system. This work considers the technical potential of power electronics-based loads for autonomous FFR in low-inertia grids. We consider multiple factors that might influence the impact of FFR for various end use loads, with a focus on residential loads.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗
DOE OSTI2020

Vehicle to Grid Frequency Regulation Capacity Optimal Scheduling for Battery Swapping Station Using Deep Q-Network

Battery swapping stations (BSSs) are ideal candidates for fast frequency regulation services (FFRS) due to their large battery stock capacity. In addition, BSSs can precharge batteries for customers and the batteries that are not in charging can provide a stable regulation capacity to the market. However, uncertainties, such as ACE signals and the EV per-hour visit counts, introduce stochastic nonlinear dynamics into the operation of a BSS-based FFRS. Currently, there is no quantification method to ensure its optimal economical operation. To close this gap, in this article, we propose a novel deep Q-learning-based FFRS capacity dynamic scheduling strategy. This method can autonomously schedule the hourly regulation capacity in real time to maximize the BSSx0027;s revenue for providing FFRS. Case studies using real-world data verify the efficacy of the proposed work.

25 ENERGY STORAGE↗
DOE OSTI2023

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Autonomous Restoration of Networked Microgrids Using Communication-Free Smart Sensing and Protection Units

Here this paper presents autonomous restoration of networked microgrids using distributed energy resources (DERs), inverter-based resources (IBRs) in general, and controllable assets of intelligence without communication to achieve a extremely resilient power system restoration. The main innovation of this work lies in use of real-time smart sensing and decision making that enable autonomous recombination of islanded microgrids, which are individually black-started by local grid-forming (GFM) inverter units. The smart circuit breakers (SCBs) designed and demonstrated here play critical roles in the restoration process to achieve autonomy; the autonomous restoration scheme is not pre-engineered and may be subject to encounter overloading, live or downed segments as the boundary of the microgrids dynamically expands without prior knowledge and only with local measurement. We demonstrate autonomous microgrid restoration both in simulation of a modified IEEE 13-bus system, and in a hardware testbed comprising 24 GFM-IBRs and 6-SCBs, depicting several scenarios to evaluate their functionalities and interoperability. This work validates high potential of extremely resilient microgrid using novel approaches for inverter-based bottom-up system restoration in a communication-free paradigm.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Autonomous Tools for Attack Surface Reduction (Final Report)

The electric power grid is a complex critical infrastructure that forms the lifeline of modern society, and its secure and reliable operation is of paramount importance to national security and economic wellbeing. However, recent findings documented in authoritative sources indicate the threat of cyber-based attacks growing in numbers and sophistication. However, securing the grid against stealthy cyberattacks is a challenging task due to legacy nature of the infrastructure coupled with dynamic nature of threat landscape and ever-growing sophistication of the adversaries. Additionally, the grid’s attack surface continues to grow with the increased dependence on digital communications and control that now extends to each consumer through smart meters and distributed energy resources. Unfortunately, this expansive surface increases the grid’s vulnerability and further exposes critical control systems in both substations and control centers. To respond to this emerging need, we had successfully assembled an interdisciplinary team with academic- industry partnership to successfully conduct research, development, evaluation, demonstration, and commercialization of attack surface reduction tools, whose goal was to significantly reduce the cyber attack surface in the North American power grid. Our proposed project was a synergistic collaborative effort leveraging the synergistic expertise of the team members across power systems, cyber security and CPS security, testbeds, field deployments and demonstration, and successful commercialization. The following are the specific tasks that have been successfully completed two phases (2016-2020). Phase I: Task 1: Developed and implemented a robust Project Management and Data Management Plan, coupled with a well thought out Risk Mitigation Plan. Task 2.1: Developed a comprehensive framework that continually assesses and autonomously reduces the attack surface for the power grid control environment spanning across substations, control center and the SCADA network to significantly reduce the risks of cyber attacks. Task 2.2: Developed attack surface analysis techniques, metrics, and tools that assess the attack surface at multiple levels including the control center, substations, and the SCADA network. Task 2.3: Developed attack surface reduction techniques and tools that dynamically reduce attack surface and hence increase attacker’s cost without interfering in the critical functions of the system. Task 2.4: Prototyped, implemented, and quantitatively evaluated/validated the techniques and tools on a realistic industrial CPS security testbed environment by leveraging the unique resources of the team. Task 3: Developed Commercialization plan to transition the developed tools into power system industry stakeholders for a broader adoption by leveraging the expertise of our industrial members. Phase II: Task 4: Successfully completed field demonstration, verification, and evaluation of the effectiveness of the attack surface analysis and reduction techniques on a realistic utility testbed environment. This also involved the development of realistic scenarios, sound metrics, data sets, evaluation criteria, and documentation. Technology integration & Field demonstration: The project had significantly advanced the state-of-the-art research and practice in improving the cybersecurity of our nation’s power grid infrastructure against cyber threats. In particular, the proposed, designed, and deployed attack surface analysis and reduction algorithms and tools have contributed to significantly reducing the exposure and risk of the devices, substations, and the integrated SCADA/EMS/ DMS grid environment to cyber threat. Strong demonstration and evaluation techniques have verified the feasibility of the developed techniques on realistic cyber-physical testbeds and utility partner's real grid environment, and collaborative research and evaluation of attack surface reduction techniques (for wide-are monitoring and control) within a vendor (GE) EMS platform. The Attack Host Analyzer (AHA) tool that was developed through this project was made available through GitHub.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Operating-Envelopes-Aware Decentralized Welfare Maximization for Energy Communities: Preprint

We propose an operating-envelope-aware, prosumer-centric, and efficient energy community that aggregates individual and shared community distributed energy resources downstream of a regulated distribution system operator's (DSO) net energy metering revenue meter. Due to the elevated risk of grid constraint violations and to ensure safe network operation, the DSO imposes dynamic export and import limits, known as dynamic operating envelopes, on end-users' revenue meters. Given the operating envelopes, the proposed community market mechanism maximizes the community's social welfare in a decentralized fashion while every community member abides by its own operating envelopes. We show that the proposed market mechanism conforms with the cost-causation principle and guarantees community members a surplus level no less than their maximum surplus when they autonomously face the DSO. Lastly, a numerical study is implemented to showcase and compare the community's welfare under the proposed operating-envelopes-aware mechanisms to others, including the welfare of customers under the DSO's regime.

distributed energy resources aggregation↗
DOE OSTI2024

Enabling the Electrification of Offshore Activities – Co-Demonstration of Next-Generation Autonomous Offshore Power System and Resident, Uncrewed Mobile and Static Assets at PacWave Wave Energy Test Site

Oceans cover two-thirds of the earth's surface and form the world's biggest and best – yet largely untapped – battery. Ocean waves have more energy density than other renewables, including wind, solar, and biomass, and have the potential to supply 4x the world's annual energy consumption (Masterson, 2022; Zic, 2020). In addition to the impact wave energy can have on decarbonizing and diversifying the electric grid, it offers a significant value proposition in the emerging blue economy sector (LiVecchi et al, 2019). The blue economy consists of industries operating offshore, including shipping, oil and gas, defense and security, aquaculture, and research. These industries require bringing people and energy on site to perform daily work, but current energy costs in the blue economy are extremely high. Here, the prevailing processes are complex, including shore dependencies and fuel transportation logistics. Few alternatives for reliable power generation exist, with the most prominent being high cost and high carbon emissions diesel generation. Because of this lack of affordable, reliable power, the trends of electrification, digitization, and automation that have led to substantial innovation and improvements in the terrestrial economy over the last two decades are slow to come to the blue economy.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Coastal Community Resiliency Enhancement Using Marine Hydrokinetic (MHK) Resources and Networked Microgrids

Enormous challenges are inherent in the operation of modern distribution grids. In particular, distribution feeders can be severely compromised under extreme conditions such as large-scale weather events (e.g., hurricanes, floods, and other types of natural disasters). To combat this problem, they turn to local energy support from distributed energy resources, such as solar and wind, marine hydrolinetic (MHK), and other types of energy. In this report, we investigate the actual characteristics of MHK resources to enhance coastal community resiliency. Two typical types of MHK resources (i.e., wave and tidal resources) illustrate the coastal resilience enhancement framework. By identifying their operational characteristics, such as target time-scales and potential power generation variations, we detail a holistic coastal community resiliency enhancement framework that integrates both optimization and control efforts. The optimization problem is formulated to significantly minimize the power outage time at the critical infrastructures in coastal communities by implementing multiple autonomous and dynamic microgrids around MHK resources. Therefore, during severe power outages caused by natural disasters (e.g., floods, hurricanes), the coastal community load profiles can be satisfied using local MHK resources in each microgrid with limited or no power support from upstream power grids.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

VOLTTRON/volttron-pnnl-aems

The Autonomous Energy Management Software (AEMS) system will continuously optimize the operations of the distributed energy resources in the small and medium size commercial building by minimizing energy consumption and cost, while providing a solution for maximizing decarbonization benefits from electrification of buildings. Initially, AEMS system will manage rooftop air conditioners and heat pumps but it can be extended in the future to manage, hot water heaters, storage (battery and thermal), electric vehicle charging and monitoring solar photovoltaic. AEMS support both energy efficiency and grid service features.

Bleeker, Amelia [Pacific Northwest National Labora↗