SEARCH · Engineering Papers

Results for “controller development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Deep Reinforcement Learning in Buildings: Implicit Assumptions and their Impact

As deep reinforcement learning (DRL) continues to gain interest in the smart building research community, there is a transition from simulation-based evaluations to deploying DRL control strategies in actual buildings. While the efficacy of a solution could depend on a particular implementation, there are common obstacles that developers have to overcome to deliver an effective controller. Additionally, a deployment in a physical building can invalidate some of the assumptions made during the controller development. Assumptions on the sensor placement or on the equipment behavior can quickly come undone. This paper presents some of the significant assumptions made during the development of DRL based controllers that could affect their operations in a physical building. Furthermore, a preliminary evaluation revealed that controllers developed with some of these assumptions can incur twice the expected costs when they are deployed in a building.

Prakash, Anand Krishnan↗

DOE OSTI2022

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Frequency Recovery in Power Grids Using High-Performance Computing

Maintaining electric power system stability is paramount, especially in extreme contingencies involving unexpected outages of multiple generators or transmission lines that are typical during severe weather events. Such outages often lead to large supply-demand mismatches followed by subsequent system frequency deviations from their nominal value. The extent of frequency deviations is an important metric of system resilience, and its timely mitigation is a central goal of power system operation and control. This paper develops a novel nonlinear model predictive control (NMPC) method to minimize frequency deviations when the grid is affected by an unforeseen loss of multiple components. Our method is based on a novel multi-period alternating current optimal power flow (ACOPF) formulation that accurately models both nonlinear electric power flow physics and the primary and secondary frequency response of generator control mechanisms. We develop a distributed parallel Julia package for solving the large-scale nonlinear optimization problems that result from our NMPC method and thereby address realistic test instances on existing high-performance computing architectures. Our method demonstrates superior performance in terms of frequency recovery over existing industry practices, where generator levels are set based on the solution of single-period classical ACOPF models.

nonlinear model predictive control↗

DOE OSTI2023

Model predictive current profile control in tokamaks by exploiting spatially moving electron cyclotron current drives

The plasma control systems in next-generation tokamaks like ITER will balance competing control objectives to achieve the desired level of performance in advanced scenarios while preventing magnetohydrodynamic instabilities and disruptions. During normal tokamak operation, the points of incidence of the electromagnetic waves generated by the electron cyclotron heating and current drives (EC H&CDs) are usually fixed in space. However, the points of incidence can be modified in real-time by changing the angles of the mirrors that reflect the EC H&CD waves. Altering the points of incidence, in turn, varies the ability of the plasma control system to regulate a plasma property. For instance, changing the EC H&CD wave incidence location may place the power demands necessary to achieve a particular plasma target within saturation limits. Therefore, using the EC H&CD deposition location, which is related to the EC H&CD mirror angle, as a supplementary controllable variable may facilitate access to a given target scenario. However, active scenario-control algorithms have not been designed so far to fully exploit this capability in real time. In this work, a model predictive controller that can handle actuation locations as control inputs is developed. In particular, the controller is designed to regulate both the auxiliary powers and the EC H&CD deposition locations in a pre-defined optimal sense to achieve the control objective of attaining and sustaining a target current profile. Further, the proposed controller is tested for a DIII-D tokamak scenario in nonlinear simulations using the Control Oriented Transport SIMulator (COTSIM).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

Redox-enabled electronic interrogation and feedback control of hierarchical and networked biological systems

Abstract Microelectronic devices can directly communicate with biology, as electronic information can be transmitted via redox reactions within biological systems. By engineering biology’s native redox networks, we enable electronic interrogation and control of biological systems at several hierarchical levels: proteins, cells, and cell consortia. First, electro-biofabrication facilitates on-device biological component assembly. Then, electrode-actuated redox data transmission and redox-linked synthetic biology allows programming of enzyme activity and closed-loop electrogenetic control of cellular function. Specifically, horseradish peroxidase is assembled onto interdigitated electrodes where electrode-generated hydrogen peroxide controls its activity. E. coli ’s stress response regulon, oxyRS , is rewired to enable algorithm-based feedback control of gene expression, including an eCRISPR module that switches cell-cell quorum sensing communication from one autoinducer to another—creating an electronically controlled ‘bilingual’ cell. Then, these disparate redox-guided devices are wirelessly connected, enabling real-time communication and user-based control. We suggest these methodologies will help us to better understand and develop sophisticated control for biology.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Real-time plasma equilibrium reconstruction and shape control for the MAST Upgrade tokamak

Real-time magnetic control has been developed to deliver precise control of multiple plasma shape parameters for advanced divertor configurations, including double-null, Super-X, X-point target and X-divertor for the first time on the MAST Upgrade (MAST-U) spherical tokamak. Successful real-time magnetic equilibrium control of different plasma shape variables has been accomplished in the 2022–2023 MAST-U experimental campaign for the advanced MAST-U divertor configurations. Application of the MAST-U boundary reconstruction algorithm, LEMUR, is described and compared with off-line equilibrium reconstruction and diagnostic measurements. The process of design and verification of the axisymmetric magnetic control schemes using a suite of control analysis tools (known collectively as TokSys) is also described.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Fuel recycling and impurity characteristics in long-pulse H-mode plasmas with full metal and dynamically coated walls on EAST

We report the basic behaviors of fuel recycling and impurity accumulation during >100 s long-pulse H-mode plasma under full metal wall conditions on EAST. Significant fuel recycling and impurity rising, particularly from heavy impurities, have been observed when operating with a bare metal wall or a deteriorate real-time coated wall, which severely limits the duration of H-mode discharges. To address this issue, a novel dynamic wall coating technique combining feedforward and feedback controls has been successfully developed. The feedforward control presets the Li powder injection rate based on prior experimental observations, whereas the feedback control dynamically modulates the Li injection rate in response to real-time Li-II line emission measurements. Using this approach, a 605 s H-mode plasma has been achieved with fuel recycling and impurity level maintained stable. This result extends the previous record of a 403 s long-pulse H-mode plasma Gong et al (2024 Nucl. Fusion 64 112013) by over 200 s. It demonstrates the effectiveness of the dynamic powder injection technique in controlling fuel recycling and impurities accumulation, while prolonging plasma duration. These findings offer valuable insights into potential applications of other low-Z powder, such as boron, in ITER.

fuel recycling↗

DOE OSTI2026

A bi-level advanced control framework for large-scale control of buildings with system-level impact

Increased electricity consumption combined with new forms of generation is testing the reliability of our grid infrastructure. This work describes a method to improve the reliability of the grid through large-scale advanced building control. This paper develops a bi-level distributed control framework to shift the load of 153 buildings to achieve a system-level objective of tracking a power reference signal. This bi-level control is based on the previously-developed ANPV-MPC, a predictive controller that uses a Bayesian neural network to generate an accurate control model and adapt to changing conditions over time. By shifting the building electricity demand to better match the available power, the grid system supplying the buildings is more reliable as evidenced by the analysis of node voltages across an IEEE 13-bus distribution system. The proposed bi-level control framework tracks the system-level power reference with enough accuracy to regulate node voltages across the IEEE 13-bus distribution system within ANSI limits of ±5%. Additionally, the adaptive nature of ANPV-MPC allows each building across the system to adapt to changing conditions, further amplifying the system-level reliability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

Secondary-Side Active Rectifier Synchronization and Control in LCC-LC Compensated Inductive Power Transfer Systems

This paper proposes a communication-less synchronization and output power control strategy for LCC-LC compensated inductive power transfer systems with a secondaryside active rectifier. By replacing the passive rectifier with an active bridge, the proposed architecture eliminates the need for a separate secondary-side DC-DC converter and enables direct regulation of battery power. The key challenge in such a system is achieving robust synchronization of the secondary active bridge with the primary inverter without access to primary-side signals. To address this issue, the secondary-side variables are analyzed and the current through the secondary series inductor is identified as a load-independent synchronization variable with a fixed phase relationship to the primary excitation. A fixed-frequency second order generalized (SOGI)-based phase locked loop (PLL) is used to estimate the switching phase and frequency, and a phase-shift-based output power controller is developed using a phasor-transformer model of the active bridges. A modified control formulation is further introduced to remove phase-dependent loop-gain variation and simplify controller design. Simulation results validate the proposed method under both fixed and varying switching-frequency conditions, demonstrating successful frequency tracking from 82 kHz to 88 kHz and accurate output power regulation over a wide operating range. The proposed method offers a compact and effective solution for high-power IPT systems by enabling secondary-side synchronization and control without wireless communication or an additional DC-DC conversion stage.

Fernandes, Arnold Anthony [ORNL] (ORCID:0009000631↗

DOE OSTI2023

Control Co-Design of Wind Turbines

Wind energy is recognized worldwide as cost-effective and environmentally friendly, and it is among the fastest-growing sources of electrical energy. To further decrease the cost of wind energy, wind turbines are being designed at ever-larger scales. To expand the deployment of wind energy, wind turbines are also being designed on floating platforms for placement in deep-water locations offshore. Both larger-scale and floating wind turbines pose challenges because of their greater structural loads and deflections. Complex, large-scale systems such as modern wind turbines increasingly require a control co-design approach, whereby the system design and control design are performed in a more integrated fashion. This article reviews recent developments in control co-design of wind turbines. We provide an overview of wind turbine design objectives and constraints, issues in the design of key wind turbine components, modeling of the wind turbine and environment, and controller coupling issues. Wind turbine control functions and the integration of control design in co-design are detailed with a focus on co-design compatible control approaches.

17 WIND ENERGY↗

DOE OSTI2023

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Mitigating Phase Unbalance for Distribution Systems with High Penetrations of Solar PV (Final Technical Report)

Distribution system operators have traditionally limited unbalance among phases by maintaining similar loadings on each phase. High penetrations of distributed solar PV continually change the net loading on each phase, resulting in time-varying phase unbalances that can damage three-phase devices such as three-phase motors, violate grid codes, and increase technical losses. This project has developed several control strategies for the reactive power outputs of solar PV inverters in order to mitigate power quality issues related to phase unbalance. These control strategies include a decentralized approach that is solely based on local measurements, distributed and grouped approaches that consider subsets of loads and PV generators, and a centralized approach that leverages measurements from a variety of locations in order to compute optimal reactive power setpoints for each inverter. Variants of the controllers handle challenges relevant to practical implementations, including noisy measurements, delayed communications, and reactive power limits. Moreover, the project developed theory that provides convergence guarantees for systems with multiple interacting controllers as well as “balanceability” certificates that ensure satisfaction of phase unbalance requirements with variable loading. The controllers were integrated with NRECA’s Open Modeling Framework (omf.coop) and evaluated using actual distribution system models obtained from several NRECA member utilities. Application of the controllers results in significant improvements to phase unbalance in these test cases with decreases from base case levels of over 3% to under 0.5%, which is within the 2% IEC phase unbalance standard.

14 SOLAR ENERGY↗

DOE OSTI2022

Improved Control Strategy of Grid-Forming Inverters for Fault Ride-Through in a Microgrid System: Preprint

This paper develops improved control strategy of GFM inverter with fault ride-through (FRT) capabilities to guarantee stable operation of microgrid under fault conditions especially islanded microgrid and asymmetrical faults. The proposed control strategy includes dual control of positive-sequence and negative-sequence control, and the adaptive virtual impedance (VI) control. Unlike the existing works, the proposed strategy only applies the VI control for the d-component of the positive-sequence control and leaves the q-component of positive-sequence control and dq-component of negative-sequence control zero, thus achieving the improved stability and balanced three-phase voltage under asymmetrical faults. The adaptive feature of the VI control guarantees the stability of the GFM inverter under severe faults which could cause saturated inner current loop and instability if the VI is not adaptive. Simulation results of a phase-to-phase-ground fault show that the proposed control strategy improves the stability of GFM and achieves the stable and balanced output voltages in islanded microgrid.

fault ride-through↗

DOE OSTI2022

Epistemology of voltage control in DER-rich power system

Despite the recent development of several scalable, robust, and resilient control approaches with superior convergence properties considering an increasing penetration of distributed energy resources (DERs), cognitive oversights often simplify several aspects of the cyber–physical power system in the controller development. Here, following the identification of the limitations of classical controller definitions, we justify alternative definitions of voltage control approaches classifiers considering three inter-disciplinary domains: (i) power system, (ii) optimization and decision-making, and (iii) networking and cyber-security, to develop a taxonomy for helping in real-world comparative performance analysis and deployability of these controllers. We observe that classical and introduced domain-based definitions together can better classify the control algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

A Machine Learning-Assisted Framework to Control Thermally Anisotropic Building Envelopes in Residential Buildings

To curb the energy consumption of buildings and their related CO2 emissions, Oak Ridge National Laboratory (ORNL) has developed the thermally anisotropic building envelope (TABE) —a multi-layer design comprising insulation materials and metal foils connected to thermal loops. In this study, a machine learning-assisted framework was developed to control the TABE in residential buildings to reduce the computation load for future optimal rule-based control and application. First, a 2D finite element model was established in COMSOL to calculate the hourly heat flux through exterior walls installed with the TABE. Then, TABE wall heat fluxes were simulated for various given indoor and outdoor boundary conditions, as well as thermal loops fluid temperatures and flow rates. Since the finite element simulations are computationally expensive, an artificial neural network (ANN) was then trained to use as a proxy of the finite element (COMSOL) modeling. Finally, the trained ANN model was coupled with the EnergyPlus model to predict the energy consumption of a US Department of Energy prototype single-family house installed with the TABE. An optimal simple rule-based control was determined from predefined rules for a case study. The results demonstrate that the developed machine learning–assisted framework can reduce 99.9% of the computation time while efficiently managing residential building energy for installed TABE walls.

Shen, Zhenglai↗

DOE OSTI2021

Autonomous Energy Systems: A Distributed Approach to Control Millions of Energy Devices

Energy systems of all sizes are becoming increasingly complex. The National Renewable Energy Laboratory has developed new controls that will support real-time operations and management of renewables, storage, electric vehicles and loads for grid efficiency and resilience. This fact sheet presents an overview of these autonomous energy systems.

AES↗

DOE OSTI2025

Development of a Practical Secondary Control for Hardware Microgrids

Practical, vendor-agnostic interoperability guidelines for the secondary control architecture of microgrids (MGs) with multiple grid-forming (GFM) inverter-based resources (IBRs) have not yet been developed. Therefore, this paper proposes a generic and vendor-agnostic secondary control architecture that operates with all GFM IBRs and synchronous generators. This secondary control does not require the use of additional measurement devices in the MG and utilizes the inherent communication systems of the GFM units, such as Modbus TCP/IP. The practical challenges of Modbus registers, such as packet loss and quantization error, and their detrimental impacts on secondary control actions are investigated. The proposed three-stage modification for any secondary control architecture to mitigate these impacts includes: 1) averaging the data read, 2) situational event-triggering of the controller, and 3) finite iteration of the controlling action. The proposed method is validated using a 3-..phi.., 480 V, 60 Hz, 500 kVA laboratory hardware microgrid with commercial two GFM IBRs and one diesel generator. The experimental results corroborates the fact the proposed modification in the secondary control architecture is advantageous for practical usage under erroneous measurements.

communication systems↗