Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Digital Twin-Enabled Adaptive Control for Hydroelectric Systems: Turbine Governor and Voltage Regulation

This paper presents a comprehensive digital twin (DT) framework for hydroelectric systems that enables adaptive control of turbine governors and excitation systems without requiring detailed manufacturer specifications. The proposed framework integrates neural network-based system identification with stabilizing adaptive control laws for the installed turbine controller and middle-branch adaptive tuning for the installed voltage regulator. Using real operational data from Unit C-8 at Rocky Reach Dam (1,349 MW capacity), highfidelity neural network models are developed to capture turbine and generator dynamics without requiring detailed manufacturer specifications. The DT enables safe controller synthesis and validation in simulation before deployment. For turbine control, the proposed method achieves a 79.9% mean square error (MSE) reduction compared with that of an optimal controller. For voltage regulation, the adaptive excitation controller achieves approximately 42.6% MSE reduction while preserving installed protection logic. The results demonstrate that DT technology provides a practical pathway for modernizing hydropower control systems with minimal operational disruption.

Gui, Yonghao [ORNL] (ORCID:0000000250435534)↗

Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids

This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While unconstrained reinforcement learning (RL) algorithms are black-box decision models that could fail to satisfy grid operational constraints, our proposed method considers AC power flow equations and other operational limits. Accordingly, the training process employs the gradient information of operational constraints to ensure that the optimal control policy functions generate safe and feasible decisions. Furthermore, we have developed a distributed consensus-based optimization approach to train the agents’ policy functions while maintaining MGs’ privacy and data ownership boundaries. After training, the learned optimal policy functions can be safely used by the MGs to dispatch their local resources, without the need to solve a complex optimization problem from scratch. Lastly, numerical experiments have been devised to verify the performance of the proposed method.

, policy gradient↗

Building-Wide, Adaptive Energy Management Systems for High-Performance Buildings: Final CRADA Report

Development and field demonstration of the minimum ratio policy for occupancy-driven, predictive control of outdoor air ventilation. Technology transfer of Argonne’s methods for occupancy estimation and forecasting and for M&V to BuildingIQ for their deployment. Selection of CO2 sensing as the currently best-available technology for occupancy-driven controls. Accelerated restart capability for the commercial BuildingIQ system using horizon shifting strategies applied to receding horizon optimal control problems. Empirical-based evidence of 30% chilled water energy savings and 22% total HVAC energy savings achievable with the BuildingIQ system operating in the APS Office Building on-site at Argonne.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimization problems governed by systems of PDEs with uncertainties

This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.

Heinkenschloss, Matthias [Rice Univ., Houston, TX ↗

Three-dimensional alignment of asymmetric-top molecules induced by polarization-shaped optimal laser pulses

Optimal control simulation is applied to numerically design nonresonant laser pulses that maximize the degrees of three-dimensional (3D) alignment of SO 2 using the lowest-order induced-dipole interaction. In our trials, combinations of more than two mutually orthogonal, linearly polarized subpulses are always obtained as the optimal solutions. Each subpulse in the optimal pulses impulsively excites the rotational wave packet. The optimal pulses effectively cooperate with the rotational dynamics up to only a few partial revival timings owing to the rotational dephasing that determines the effective control periods. The control mechanisms are interpreted in terms of the time derivatives of the expectation values of the squares of the direction cosines, that of the rotational energy, and the interplay between them. We find a special and important role of the last subpulses as they align the molecular axes using the interaction through the two smallest polarizability components, while the other subpulses excite the rotational wave packet mainly through the largest polarizability component. Lastly, the control pulses composed of the specified number of subpulses are also numerically optimized by actively utilizing the instantaneous penalty to systematically show the superiority of the use of more than two subpulses over that of two subpulses, the latter of which leads to the saturation of the degree of 3D alignment as a function of total fluence.

74 ATOMIC AND MOLECULAR PHYSICS↗

Computation-Efficient Algorithm for Distributed Feedback Optimization of Distribution Grids

Feedback-based optimization algorithms use real-time measurements to update the optimal control for the underlying system which may not be fully identified. Recently, we have developed a distributed feedback-based algorithm [1] that avoids the requirement of fast communication between central computing and local actuator/sensor agents. This paper extends the work by greatly reducing the number of copies of variables involved in the distributed feedback-based algorithm, which results in faster convergence and lower communication requirement. The main idea is to leverage the specific structural properties of the admittance matrix for distribution systems with tree network topology. We also show the effectiveness of the proposed algorithm in simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Electricity Pricing aware Deep Reinforcement Learning based Intelligent HVAC Control

Recently, deep reinforcement learning (DRL) based intelligent control of Heating, Ventilation, and Air Conditioning (HVAC) has gained a lot of attention due to DRL's ability to optimally control HVAC for minimizing operational cost while maintaining resident's comfort. The success of such DRL-based techniques largely depends on the articulation of the problem in terms of states, actions, and reward function. Inclusion of the electricity pricing information in the problem formulation can play an important role in saving the cost of HVAC operation. However, less attention has been given in the literature on formulating well-crafted state features based on electricity pricing. In this work, we propose an approach for training the DRL model with a specific focus on feature engineering based on electricity pricing. During training, we generate random but sufficiently realistic electricity price signals so that the pre-trained DRL model is robust and adaptive to the dynamic and variable electricity prices. The validation results are encouraging and show the potential of ≈12%-15% savings in the one day cost of HVAC operation, proving the usefulness of including electricity pricing related features as state features.

Kurte, Kuldeep↗

A Transfer Learning Strategy for Improving the Data Efficiency of Deep Reinforcement Learning Control in Smart Buildings

Reinforcement learning (RL) is a powerful tool that has shown promising results in many domains such as robotics and game-playing. Because RL algorithms learn optimal control policies by continuously interacting with their environments, these algorithms require a lot of data to learn, which limits their application to a wide range of domains. For this reason, there is an immense need for improving the training and data efficiency of RL. Towards addressing this research gap, this paper proposes a transfer learning (TL) approach to improve the efficiency of the RL algorithms by reducing data need and, thus, reducing training time. To demonstrate the proposed approach, a knowledge transfer from a set of buildings to another building was conducted. The results show that the proposed TL approach is a promising method that can efficiently harness the information from similar RL tasks and reduce the data needs of RL algorithms.

Amasyali, Kadir↗

Gas Reliability Analysis Integrated Library (GRAIL)

The Gas Reliability Analysis Integrated Library (GRAIL) is a prototype computational tool for solving a class of intra-day model-predictive control problems for a simplified network model of midstream natural gas pipeline systems. The model accurately resolves dynamic gas flows through long pipes using a non-ideal gas equation of state. It can be used to provide optimal intra-day flow schedules as well as spatiotemporal economic values of natural gas while ensuring that pipeline hydraulic limitations, compressor station constraints, operational factors, and pre-existing shipping contracts are satisfied. The inputs to the code are a model of the pipeline system as well as time-series data that specify boundary conditions on the network and time-dependent constraints on the optimal control problem. The outputs are time-series data that provide an approximately optimal solution of flows, pressures, compressor settings, and sensitivities to the objective function.

Zlotnik, Anatoly↗

Mathematical Modeling in Systems for Operational Evaluation of the Stress-Strain State of the Arch-Gravity Dam at the Sayano-Shushenskaya Hydroelectric Power Plant

Current studies of the stress-strain state of the dam at the Sayano-Shushenskaya Hydroelectric Power Plant at VNIIG based on mathematical modeling including full scale and experimental data are described. Applications and programs intended for automatic operational evaluation of the stress-strain state of the dam for optimizing control of the upper race level in the course of the annual filling-drawdown cycle and during seismic events are examined. Improvements in systems for monitoring the stress-strain state of concrete dams are proposed.

42 ENGINEERING↗

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert attack. We consider the attack scenario where the attacker learns about the dynamic model during the exploration phase of the learning conducted by the designer to learn a linear quadratic regulator (LQR), and thereafter, use such information to conduct a covert attack on the dynamic system, which we refer to as doubly learning-based control and attack (DLCA) framework. We propose a dynamic camouflaging based attack-resilient reinforcement learning (ARRL) algorithm which can learn the desired optimal controller for the dynamic system, and at the same time, can inject sufficient misinformation in the estimation of system dynamics by the attacker. The algorithm is accompanied by theoretical guarantees and extensive numerical experiments on a consensus multi-agent system and on a benchmark power grid model.

Mukherjee, Sayak↗

Stability of quasi-Keplerian shear flow in a laboratory experiment

Subcritical transition to turbulence has been proposed as a source of turbulent viscosity required for the associated angular momentum transport for fast accretion in Keplerian disks. Previously cited laboratory experiments in supporting this hypothesis were performed either in a different type of flow than Keplerian or without quantitative measurements of angular momentum transport and mean flow profile, and all of them appear to suffer from Ekman effects, secondary flows induced by nonoptimal axial boundary conditions. Such Ekman effects are expected to be absent from astronomical disks, which probably have stress-free vertical boundaries unless strongly magnetized. To quantify angular momentum transport due to subcritical hydrodynamic turbulence, if exists, in a quasi-Keplerian flow with minimized Ekman effects. We perform a local measurement of the azimuthal–radial component of the Reynolds stress tensor in a novel laboratory apparatus where Ekman effects are minimized by flexible control of axial boundary conditions. We find significant Ekman effects on angular momentum transport due to nonoptimal axial boundary conditions in quasi-Keplerian flows. With the optimal control of Ekman effects, no statistically meaningful angular momentum transport is detected in such flows at Reynolds number up to two millions. Either a subcritical transition does not occur, or, if a subcritical transition does occur, the associated radial transport of angular momentum in optimized quasi-Keplerian laboratory flows is too small to directly support the hypothesis that subcritical hydrodynamic turbulence is responsible for accretion in astrophysical disks. Possible limitations in applying laboratory results to astrophysical disks due to experimental geometry are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Optimal subhourly electricity resource dispatch under multiple price signals with high renewable generation availability

This article proposes a system-wide optimal resource dispatch strategy that enables a shift from a primarily energy cost-based approach, to a strategy using simultaneous price signals for energy, power and ramping behavior. A formal method to compute the optimal sub-hourly power trajectory is derived for a system when the price of energy and ramping are both significant. Optimal control functions are obtained in both time and frequency domains, and a discrete-time solution suitable for periodic feedback control systems is presented. The method is applied to North America Western Interconnection for the planning year 2024, and it is shown that an optimal dispatch strategy that simultaneously considers both the cost of energy and the cost of ramping leads to significant cost savings in systems with high levels of renewable generation: the savings exceed 25% of the total system operating cost for a 50% renewables scenario.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Harnessing Quantum Information Science for Enhancing Sensors in Harsh Fossil Energy Environments

The main goals of this project are to utilize real-time quantum dynamics simulations and quantum optimal control algorithms to (1) harness near-surface nitrogen vacancy (NV) centers to detect chemical analytes in harsh fossil energy environments, and (2) design optimally constructed electromagnetic fields for initializing these near-surface NV center spins for efficient sensor performance and detectivity.

20 FOSSIL-FUELED POWER PLANTS↗

Evaluation of Optimal Net Load Management in Microgrids Using Hardware-in-the-Loop Simulation

This paper presents the performance evaluation of a net load management (NLM) engine that balances load and generation in an isolated community to power a critical facility after a grid interruption event (e.g., the loss of a large generation unit). This NLM engine is particularly important for microgrid systems because it provides a high-speed, cost-optimal control solution to coordinate grid-forming inverters and to dispatch grid-following inverters and deferrable loads in microgrid systems to enhance grid resilience and reliability. The NLM algorithm cost-optimally dispatches the grid-following inverters and deferrable loads based on the demanded power and load priorities, and the grid-forming inverters use droop control to form system voltages and share active and reactive power. A controller-hardware-in-the-loop platform is developed to evaluate the control performance of the NLM algorithm with two sequential contingency events of lost generation units. The experimental results indicate that the NLM engine can maintain system stability, achieve the targeted system voltage and frequency, and balance load and generation to serve the critical facility with improved system resilience and reliability.

grid-following inverter↗

Evaluation of Optimal Net Load Management in Microgrids Using Hardware-in-the-Loop Simulation

This presentation discusses the performance evaluation of a net load management (NLM) engine that balances load and generation in an isolated community to power a critical facility after a grid interruption event (e.g., the loss of a large generation unit). This NLM engine is particularly important for microgrid systems because it provides a high-speed, cost-optimal control solution to coordinate grid-forming inverters and to dispatch grid-following inverters and deferrable loads in microgrid systems to enhance grid resilience and reliability. The NLM algorithm cost-optimally dispatches the grid-following inverters and deferrable loads based on the demanded power and load priorities, and the grid-forming inverters use droop control to form system voltages and share active and reactive power. A controller-hardware-in-the-loop platform is developed to evaluate the control performance of the NLM algorithm with two sequential contingency events of lost generation units. The experimental results indicate that the NLM engine can maintain system stability, achieve the targeted system voltage and frequency, and balance load and generation to serve the critical facility with improved system resilience and reliability.

droop control↗

Impact of plug-in hybrid electric vehicles on power systems with demand response and wind power.

This paper uses a new unit commitment model which can simulate the interactions among plug-in hybrid electric vehicles (PHEVs), wind power, and demand response (DR). Four PHEV charging scenarios are simulated for the Illinois power system: (1) unconstrained charging, (2) 3-hour delayed constrained charging, (3) smart charging, and (4) smart charging with DR. The PHEV charging is assumed to be optimally controlled by the system operator in the latter two scenarios, along with load shifting and shaving enabled by DR programs. The simulation results show that optimally dispatching the PHEV charging load can significantly reduce the total operating cost of the system. With DR programs in place, the operating cost can be further reduced.

17 WIND ENERGY↗

Transmission and Distribution Real-Time Analysis Software for Monitoring and Control: Design and Simulation Testing

The US electric grid is facing operational, stability, and security challenges. Transmission system operators need some measure of visibility into distribution system renewable generation. Distribution system generation needs to support transmission system voltage. The grid is experiencing an expansion in measurement systems. How to take full advantage of this expansion and defend against attacks, both cyber and physical, poses additional challenges. This paper introduces software designed to meet these challenges. At the center of the software is an Integrated System Model (ISM) that spans from transmission to secondary distribution. The ISM is employed in real-time abnormality detection, voltage stability forecasting, and multi-mode control. The software architecture along with selected analysis modules is presented. Testing results are presented for: 1—attacks on utility infrastructure; 2—energy savings from optimal control; 3—distribution system control response during a low voltage transmission system event; 4—cyber-attacks on PV inverters, where physical inverters are used in hardware-in-the-simulation-loop studies. Contributions of this work include real-time analysis that spans from three-phase transmission through secondary distribution; an approach for detecting abnormalities that employs measurements from three independent measurement systems; and a multi-mode distribution system control that responds to cyber-attacks, physical attacks, equipment failures, and transmission system needs.

14 SOLAR ENERGY↗