Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hybrid Data-Driven Based HVdc Ancillary Control for Multiple Frequency Data Attacks

The high voltage direct current (HVdc) intertie has been applied to provide ancillary-services for ac grids, utilizing the real-time feedback from phasor measurement units (PMUs). However, PMU data communication is vulnerable to false data injection attacks (FDIA) due to protocol defects, thus the HVdc ancillary control and system stability will be threatened. To address this issue, this article proposes a novel HVdc control strategy based on a hybrid data-driven (HDD) methodology. In this work, the HDD methodology is first proposed to detect the types and duration time of multiple frequency attacks. Specifically, the Hilbert Huang transform (HHT) is used to decompose the frequency data, using variational mode decomposition instead of the traditional empirical mode decomposition, to extract data features. Second, a multikernel support vector machine is proposed to classify the attacked data based on the designed distinctive features from HHT. Meanwhile, the attacking duration time is decided using an unsupervised technique. Third, an HDD-based HVdc ancillary control strategy is established to eliminate the effect of FDIAs on the HVdc frequency response. Comprehensive experiments of HDD-based HVdc ancillary controls under different FDIAs suggest that the proposed HDD could fast and accurately classify the FDIAs, and the HDD-based HVdc ancillary control strategy could significantly suppress the impact of the FDIAs.

97 MATHEMATICS AND COMPUTING↗

Energy-Efficient Driving in Connected Corridors via Minimum Principle Control: Vehicle-in-the-Loop Experimental Verification in Mixed Fleets

Connected and automated vehicles (CAVs) can plan and actuate control that explicitly considers performance, system safety, and actuation constraints in a manner more efficient than their human-driven counterparts. In particular, eco-driving is enabled through connected exchange of information from signalized corridors that share their upcoming signal phase and timing (SPaT). This is accomplished in the proposed control approach, which follows first principles to plan a free-flow acceleration-optimal trajectory through green traffic light intervals by Pontryagin's Minimum Principle in a feedback manner. Urban conditions are then imposed from exogeneous traffic comprised of a mixture of human-driven vehicles (HVs) - as well as other CAVs. As such, safe disturbance compensation is achieved by implementing a model predictive controller (MPC) to anticipate and avoid collisions by issuing braking commands as necessary. The control strategy is experimentally vetted through vehicle-in-the-loop (VIL) of a prototype CAV that is embedded into a virtual traffic corridor realized through microsimulation. Up to 36% fuel savings are measured with the proposed control approach over a human-modelled driver, and it was found connectivity in the automation approach improved fuel economy by up to 26% over automation without. Additionally, the passive energy benefits realizable for human drivers when driving behind downstream CAVs are measured, showing up to 22% fuel savings in a HV when driving behind a small penetration of connectivity-enabled automated vehicles.

33 ADVANCED PROPULSION SYSTEMS↗

Optimal Control for X-Ray Mircroscopes

In this article, a systematic framework for designing the control for fine positioning (scanning) stages of X-ray microscopes is presented. This framework facilitates designs that simultaneously achieve specifications on positioning resolution and tracking bandwidth while guaranteeing robustness of the closed loop device to unmodeled uncertainties. We use robust optimal control techniques for modeling, quantifying design objectives and system-specific challenges, and designing the control laws. The control designs were implemented on a three degree of freedom piezoactuated flexure stages dedicated for fine positioning of X-ray optics. Experimental results demonstrate significant improvements in positioning performance of 134%, 150%, and 132% in tracking bandwidths along the lateral (X), vertical (Y), and beam (Z) directions, respectively, when compared to proportional-integral-derivative controller designs. This was achieved while keeping similar or better positioning resolution and robustness measures. Fast scanning for X-ray imaging was demonstrated in both the step scan and flyscan modes, where bandwidth was improved by over 450 times with flyscan compared to the step scan.

42 ENGINEERING↗

Prototype Data Acquisition and Slow Control Systems for the Mu2e Experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10 000 over existing limits. Such a charged lepton flavor-violating reaction probes new physics at a scale unavailable with direct searches at either present or planned high-energy colliders. The Mu2e Trigger and Data Acquisition (TDAQ) system exploits otsdaq as its online Data Acquisition System (DAQ) solution. Furthermore, developed at Fermilab, otsdaq integrates both the artdaq DAQ and the art analysis frameworks for event transfer, filtering, and processing. otsdaq is an online DAQ software suite with a focus on flexibility and scalability and provides a multi-user, web-based, interface accessible through a web browser. The read out controllers (ROCs) stream out zero-suppressed data continuously from the detector subsystems to the data transfer controllers (DTCs). The data stream is then read over the peripheral component interconnect express (PCIe) bus to a software filter algorithm that selects events which are combined with the data flux coming from a cosmic-ray veto (CRV) system. The detector control system (DCS) has been developed using the experimental physics and industrial control system (EPICS) open source platform for monitoring, controlling, alarming, and archiving. The DCS has been integrated into otsdaq. A prototype of the TDAQ system and the DCS has been built at Fermilab's Feynman Computing Center. In this article, we report on the progress of the integration of this prototype in the online otsdaq software.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Control Design of Passive Grid-Forming Inverters in Port-Hamiltonian Framework

This article presents a modified dispatchable virtual oscillator control approach for achieving the passivity of gridforming inverters (GFMs), without assuming constant voltage and constant frequency. The proposed control framework utilizes the Port-Hamiltonian (PH) based structure that mimics the behaviors of coupled harmonic oscillators, along with an energy ‘pumpingor-damping’ block and the Control by Interconnection (CbI) technique, to render the inverter passive. Once passivity is achieved, transient stability of the system will be guaranteed. The proposed control framework is composed of three loops: an outer power dispatching loop that generates the voltage and frequency references, a virtual oscillator loop that emulates the spontaneous synchronization of oscillators, and an inductor current loop that maintains lossless interconnection in PH systems. In conclusion, the study shows that the proposed control approach ensures the passivity of GFMs, facilitating the transient stability design of multi-inverter systems, as interconnections of passive systems remain passive and stable.

42 ENGINEERING↗

Distributed Conditions for Small-signal Stability of Power Grids and Local Control Design

Operating modern power grids with stability guarantees is markedly important. Typical methods for analyzing and certifying power grid stability are largely centralized relying on the ability of the system operator to gather network-wide information and accurately compute the system's eigenvalues. These methods are oftentimes not privacy-preserving and computationally burdensome. They are therefore, not well-suited to modern power grids where small-signal stability has to be evaluated timely, efficiently and in a privacy-preserving fashion. Herein, we introduce a distributed methodology for certifying small-signal stability of power grids and designing the local controllers. First, we analytically derive distributed conditions for network-wide stability that bus agents can inspect using local information. By leveraging these conditions, we then introduce a distributed control design algorithm (DCDA) that can guide the local control design so that stability of the interconnected system is guaranteed. The agents that adopt the proposed distributed algorithm are responsible for tuning their local controllers, producing their local control commands and ensuring that their local stability condition is met. The system operator is only responsible for verifying network-wide stability upon receiving affirmative responses from all agents and, announcing, that the overall system is stable. The proposed DCDA algorithm is numerically validated via simulations using the IEEE 39-bus system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Power system emergency control is generally regarded as the final safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived “worst” case scenarios or a few typical operation scenarios. These schemes are facing significant adaptiveness and robustness issues as increasing uncertainties and variations occur in modern electrical grids. To address these challenges, for the first time, this paper proposes a novel adaptive emergency control scheme using deep reinforcement learning (DRL), by leveraging the high-dimensional feature extraction and non-linear generalization capabilities DRL has for complex systems with high-dimensional variations. Furthermore, an open-source platform named DeepGrid has been designed for the first time to assist the DRL development and benchmarking processes in power system emergency control. Details of the platform, DRL, and emergency control schemes that use dynamic braking or under-voltage load shedding are presented. Extensive case studies performed in both two-area four-machine system and IEEE 39-Bus system have demonstrated the excellent performance and robustness of the proposed schemes.

Deep reinforcement learning, emergency control, lo↗

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hierarchical Control of Megawatt-Scale Charging Stations for Electric Trucks with Distributed Energy Resources

Electrifying medium- and heavy-duty trucks is critical to decarbonizing the transportation sector. Energy needs of electric trucks will likely require megawatt-scale charging stations, which could significantly stress the electric distribution grid. Distributed energy resources (DER) can alleviate this stress and reduce charging costs with proper management. To that end, this work develops a hierarchical predictive control algorithm for future multi-port megawatt-scale charging stations that can provide real-time energy management for stations, decide charging rates, dispatch energy storage system (ESS), and provide grid voltage support. We integrate three algorithmic components: (i) an energy management optimization (EMO) that provides supervisory control to DER assets and charging loads at minute scale, (ii) a real-time energy management system (RT-EMS) that heuristically compensates for fast disturbances at sub-second scale, and (iii) a model predictive control (MPC)-based battery management system (BMS) that communicates future charging demands to the EMO, to manage the overall megawatt-scale site. Additionally, validation in a controller hardware-in-the-loop (CHIL) environment shows that the hierarchical controller can reduce the total energy consumption from the grid by approximately 28% compared to an uncontrolled case for the station configuration in this paper, without impacting charging time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Role of reinforcement learning for risk-based robust control of cyber-physical energy systems

Critical infrastructures such as cyber-physical energy systems (CPS-E) integrate information flow and physical operations that are vulnerable to natural and targeted failures. Safe, secure, and reliable operation and control of CPS-E is critical to ensure societal well-being and economic prosperity. Automated control is key for real-time operations and may be mathematically cast as a sequential decision-making problem under uncertainty. Emergence of data-driven techniques for decision making under uncertainty, such as reinforcement learning (RL), have led to promising advances for addressing sequential decision-making problems for risk-based robust CPS-E control. However, existing research challenges include understanding the applicability of RL methods across diverse CPS-E applications, addressing the effect of risk preferences across multiple RL methods, and development of open-source domain-aware simulation environments for RL experimentation within a CPS-E context. This article systematically analyzes the applicability of four types of RL methods (model-free, model-based, hybrid model-free and model-based, and hierarchical) for risk-based robust CPS-E control. Problem features and solution stability for the RL methods are also discussed. We demonstrate and compare the performance of multiple RL methods under different risk specifications (risk-averse, risk-neutral, and risk-seeking) through the development and application of an open-source simulation environment. Motivating numerical simulation examples include representative single-zone and multizone building control use cases. Finally, six key insights for future research and broader adoption of RL methods are identified, with specific emphasis on problem features, algorithmic explainability, and solution stability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Design of a Two-Body Wave Energy Converter Featuring Controllable Geometry

While the field of wave energy has been the subject of numerical simulation, scale model testing, and precommercial project testing for decades, wave energy technologies remain in the early stages of development and must continue to prove themselves as a promising modern renewable energy field. A wave energy converter (WEC) concept currently being explored is the variable-geometry WEC (VGWEC), which aims to add an extra control option to WEC design. VGWECs attempt to incorporate controllable geometric features to adjust the floating body hydrodynamics to favor either power absorption, load shedding, or other operational goals. These variable geometry components have been proposed to be controlled on a sea-state-to-sea-state or wave-to-wave time scale depending on the force (or torque) and bandwidth limitations of the actuators required to manipulate just the controllable geometric hull features. Having control over both the WEC geometry components and the power takeoff (PTO) offers the potential to improve overall system performance and reliability if a cost-effective solution can be found for a given WEC architecture. This paper will present the recent developments and results of a VGWEC concept that incorporates variable-geometry modules into a two-body WEC. In the proposed VGWEC concept, the variable-geometry modules consist of air-inflatable bags in the surface float and a water inflatable ring in the subsurface body. The surface float is tethered directly to the subsurface body through tether lines, each connected to a separate PTO. Adjusting the geometry of both the surface and subsurface bodies along with the PTO coefficients can maximize power in design sea states while reducing motion response and PTO forces when transitioning to sea states where rated power is reached and load shedding is prioritized. The ability to transition between operating condition is expected to increase the sea state operational map and power capacity.

geometry control↗

Process Control and Energy Efficiency

We review the impact of control systems and strategies on the energy efficiency of chemical processes. We show that, in many ways, good control performance is a necessary but not sufficient condition for energy efficiency. The direct effect of process control on energy efficiency is manyfold: Reducing output variability allows for operating chemical plants closer to their limits, where the energy/economic optima typically lie. Further, good control enables novel, transient operating strategies, such as conversion smoothing and demand response. Indirectly, control systems are key to the implementation and operation of more energy-efficient plant designs, as dictated by the process integration and intensification paradigms. Our conclusions are supported with references to numerous examples from the literature.

42 ENGINEERING↗

Learning reference governor for cycle-to-cycle combustion control with misfire avoidance in spark-ignition engines at high exhaust gas recirculation–diluted conditions

Cycle-to-cycle feedback control is employed to achieve optimal combustion phasing while maintaining high levels of exhaust gas recirculation by adjusting the spark advance and the exhaust gas recirculation valve position. The control development is based on a control-oriented model that captures the effects of throttle position, exhaust gas recirculation valve position, and spark timing on the combustion phasing. Under the assumption that in-cylinder pressure information is available, an adaptive extended Kalman filter approach is used to estimate the exhaust gas recirculation rate into the intake manifold based on combustion phasing measurements. The estimation algorithm is adaptive since the cycle-to-cycle combustion variability (output covariance) is not known a priori and changes with operating conditions. A linear quadratic regulator controller is designed to maintain optimal combustion phasing while maximizing exhaust gas recirculation levels during load transients coming from throttle tip-in and tip-out commands from the driver. During throttle tip-outs, however, a combination of a high exhaust gas recirculation rate and an overly advanced spark, product of the dynamic response of the system, generates a sequence of misfire events. In this work, an explicit reference governor is used as an add-on scheme to the closed-loop system in order to avoid the violation of the misfire limit. The reference governor is enhanced with model-free learning which enables it to avoid misfires after a learning phase. Experimental results are reported which illustrate the potential of the proposed control strategy for achieving an optimal combustion process during highly diluted conditions for improving fuel efficiency.

42 ENGINEERING↗

Integrating Control Methods and Digital Twins for Advanced Nuclear Reactors

Advanced nuclear reactors offer new capabilities such as the ability to adapt to variable energy demand, operate autonomously with remote supervision, be deployable in rural locations, be compact in size, afford lower power ratings, and rely on novel techniques for increased operational safety. However, realizing these capabilities requires intelligent control systems that can track changing power demands and make autonomous decisions based on these demands. The unique aspects of advanced reactors (e.g., strict regulatory requirements, harsh operating environments, high consequences, highly coupled dynamics, evolving knowledge, and limited operating histories) directly impact the design and deployment of control systems for these reactors. The present work identifies and evaluates these aspects so as to develop a set of control system requirements to guide future research and development. To meet these requirements, a layered control system approach is proposed that integrates digital twins with different control paradigms. This work aims to demonstrate how different methods interface with enabling solutions, and to identify any gaps that need to be researched.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Mechanistic basis of post-treatment control of SIV after anti-α4β7 antibody therapy

Treating macaques with an anti-α4β7 antibody under the umbrella of combination antiretroviral therapy (cART) during early SIV infection can lead to viral remission, with viral loads maintained at < 50 SIV RNA copies/ml after removal of all treatment in a subset of animals. Depletion of CD8+ lymphocytes in controllers resulted in transient recrudescence of viremia, suggesting that the combination of cART and anti-α4β7 antibody treatment led to a state where ongoing immune responses kept the virus undetectable in the absence of treatment. A previous mathematical model of HIV infection and cART incorporates immune effector cell responses and exhibits the property of two different viral load set-points. While the lower set-point could correspond to the attainment of long-term viral remission, attaining the higher set-point may be the result of viral rebound. Here we expand that model to include possible mechanisms of action of an anti-α4β7 antibody operating in these treated animals. We show that the model can fit the longitudinal viral load data from both IgG control and anti-α4β7 antibody treated macaques, suggesting explanations for the viral control associated with cART and an anti-α4β7 antibody treatment. This effective perturbation to the virus-host interaction can also explain observations in other nonhuman primate experiments in which cART and immunotherapy have led to post-treatment control or resetting of the viral load set-point. Interestingly, because the viral kinetics in the various treated animals differed—some animals exhibited large fluctuations in viral load after cART cessation—the model suggests that anti-α4β7 treatment could act by different primary mechanisms in different animals and still lead to post-treatment viral control. This outcome is nonetheless in accordance with a model with two stable viral load set-points, in which therapy can perturb the system from one set-point to a lower one through different biological mechanisms.

60 APPLIED LIFE SCIENCES↗

Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems

The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.

DER integration↗