Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Development of a wind turbine model and simulation platform using an acausal approach: Multiphysics modeling, validation, and control

This article presents the development of the Control-oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS). CRAFTS has a modular, hierarchical model architecture that enables rapid and accurate simulation of wind turbines. The architecture facilitates the incorporation of model variants, and its system reconfiguration features help simulate multiple design variants. CRAFTS also supports the integration of models developed on a causality-free platform (e.g., Modelica®) with existing causal models. This article focuses on the validation of a land-based wind turbine models against OpenFAST, an industry-standard platform, for several test cases. Closed-loop scenarios are also tested using the standard ROSCO controller and compared against OpenFAST. In addition, a nonlinear controller developed in our prior work is also evaluated. The test cases demonstrate the user-friendly and computationally efficient capabilities of CRAFTS to facilitate control co-design, assist in incorporating multiphysics models, be adaptable to design variants, and allow for rapid simulations to validate models and evaluate controllers.

17 WIND ENERGY↗
DOE OSTI2023

Reinforcement learning for real-time process control in high-temperature superconductor manufacturing

With high efficiency and low energy loss, high-temperature superconductors (HTS) have demonstrated their profound applications in various fields, such as medical imaging, transportation, accelerators, microwave devices, and power systems. The high-field applications of HTS tapes have raised the demand for producing cost-effective tapes with long lengths in superconductor manufacturing. However, achieving the uniform and enhanced performance of a long HTS tape is challenging due to the unstable growth conditions in the manufacturing process. Although it is confirmed that the process parameters during the advanced metal organic chemical vapor deposition (A-MOCVD) process influence the uniformity of the produced HTS tapes, the high-dimensional process parameter signals and their complicated interactions make it difficult to develop an effective control policy. In this paper, we propose a local measure for the uniformity of HTS tapes to provide instant feedback for our control policy. Then, we model the manufacturing of HTS tapes as a Markov decision process (MDP) with continuous state and action spaces to assess the instant reward in real time in our feedback control model. As our MDP involves continuous and high-dimensional state and action spaces, a neural fitted Q-iteration (NFQ) algorithm is adopted to solve the MDP with artificial neural network (ANN) function approximation. The collinearity of process parameters can restrict our capability of adjusting the process parameters, which is addressed by the principal component analysis (PCA) in our method. The control policy adjusts the PCA of process parameters using the NFQ algorithm. In conclusion, based on our case studies on real A-MOCVD dataset, the obtained control policy increases the average uniformity of tapes by 5.6% and performs especially well on sample HTS tapes with a low uniformity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Progress of Divertor Heat and Particle Flux Control in EAST for Advanced Steady-State Operation in the Last 10 Years

Active control of the excessively high heat and particle fluxes on the divertor target plates is of fundamental importance to the steady state operation of tokamaks, especially for fusion reactors. A series of experiments have been carried out on this critical issue to relieve the plasma-wall interactions in the experimental advanced superconducting tokamak (EAST) in the last ten years, not only contributing to the long pulse operation of EAST itself, but also providing physical understandings and potential techniques to the next-generation devices like ITER. Here we have characterized the power deposition pattern and broadened the divertor footprint width effectively. The plasma-wetted area is actively handled using either 3-dimentional edge magnetic topology or advanced plasma equilibrium, thereby peak heat flux around the strike point is reduced. Active control of detachment or radiation compatible with core plasma performance has progressed significantly in very recent years, with a series of active feedback control modules developed and utilized successfully, based on the divertor physics advances with both experiments and simulation. The upper divertor of EAST was upgraded from graphite to active water-cooling ITER-like tungsten in 2014, exhibiting much enhanced heat removal capability. As for the particle exhaust including both fueling and impurity particles, in addition to wall conditioning and impurity source control, the efficiency of particle flux exhaust is optimized by making full use of the divertor closure and the plasma drifts in both scrape-off layer and divertor volume. These heat and particle exhaust advances contribute greatly to a series of EAST achievements like H-mode operation over 100 s. A brief near-term plan on the integrated control of divertor plasma-wall interactions in long-time scale will also be introduced, aiming to provide favorable divertor operation solution for ITER and CFETR.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Sensitivity-Driven Experimental Design to Facilitate Control of Dynamical Systems

Control of nonlinear dynamical systems is a complex and multifaceted process. Essential elements of many engineering systems include high-fidelity physics-based modeling, offline trajectory planning, feedback control design, and data acquisition strategies to reduce uncertainties. Here this article proposes an optimization-centric perspective which couples these elements in a cohesive framework. We introduce a novel use of hyper-differential sensitivity analysis to understand the sensitivity of feedback controllers to parametric uncertainty in physics-based models used for trajectory planning. These sensitivities provide a foundation to define an optimal experimental design which seeks to acquire data most relevant in reducing demand on the feedback controller. Our proposed framework is illustrated on the Zermelo navigation problem and a hypersonic trajectory control problem using data from NASA’s X-43 hypersonic flight tests.

42 ENGINEERING↗
DOE OSTI2021

A comparison of efficiency-aware model-predictive control approaches for wave energy devices

In this study, we compare four different formulations of model predictive control that attempt to maximise electrical power generated by a wave energy converter (WEC). Control laws include (1) pure maximisation of mechanical power, (2) maximisation of mechanical power with a control penalty factor, (3) maximisation of electrical power using power conversion efficiency, and (4) maximisation of electrical power using the full electro-mechanical model of a system. For this study, a wave-to-wire model is developed for a floating spherical buoy connected to a permanent magnet synchronous generator. The performance of the controllers, including the mechanical and electrical power outputs, is compared in irregular wave conditions for the unconstrained and force-constrained scenarios. The results demonstrate that the controller designed to maximise mechanical power is not suitable for practical applications and may lead to negative electrical power output due to the non-ideal power take-off efficiency. Moreover, the replacement of the power take-off dynamics by the efficiency coefficient does not guarantee the maximum electrical power production.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

Physics-Informed Neural Networks for PDE-Constrained Optimization and Control

The goal of optimal control is to determine a sequence of inputs for maximizing or minimizing a given performance criterion subject to the dynamics and constraints of the system under observation. This work introduces Control Physics-Informed Neural Networks (PINNs), which simultaneously learn both the system states and the optimal control signal in a single-stage framework that leverages the system’s underlying physical laws. While prior approaches often follow a two-stage process-modeling, the system first and then devising its control—the presented novel framework embeds the necessary optimality conditions directly into the network architecture and loss function. We demonstrate the effectiveness of the novel methodology by solving various open-loop optimal control problems governed by analytical, one-dimensional, and two-dimensional partial differential equations (PDEs).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Chapter 7: Learning Stable Local Volt/Var Controllers in Distribution Grids

This chapter describes a framework to synthesize provably stable local Volt/Var controllers for distributed energy resources (DERs) in power distribution grids (DGs). The goal is to control the reactive power injections of DERs to improve the system performance as quantified by a generic optimal reactive power flow (ORPF) problem. To achieve this, we jointly design for each DER the control function, which prescribes the reactive power update rule, and the equilibrium function, which approximates the ORPF solutions from local measurements of voltages and powers. We provide conditions on the equilibrium functions and the control parameters ensuring the stability of the closed-loop system. In particular, we discuss the trade-offs between each set of conditions accounting for practical considerations, like fully exploiting the DERs' generation capabilities and reducing the optimality gap. These conditions are then translated into learning constraints on the neural networks' parameters that are enforced in the training phase. We validate our framework with numerical simulations on the IEEE 37-bus network and through a comparison with an optimized version of standard piece wise linear control rules.

closed-loop asymptotic stability↗
DOE OSTI2022

Model predictive control for demand flexibility: Real-world operation of a commercial building with photovoltaic and battery systems

Hundreds of studies have investigated Model Predictive Control (MPC) for the optimal operation of building energy systems in the past two decades. However, MPC field tests are still uncommon, especially for small- and medium-sized commercial buildings and for buildings integrated with onsite renewables. This paper describes the implementation and the long-term performance evaluation of an MPC controller in a small commercial building equipped with behind-the-meter photovoltaics and electrochemical batteries. MPC controls space conditioning, commercial refrigeration, and the battery system. We tested two types of demand flexibility applications in the field: electricity bill minimization under time-of-use tariffs and responses to grid flexibility events. Results show that the proposed controller achieves 12% of annual electricity cost savings and 34% peak demand reduction against the baseline, while respecting thermal comfort and food safety. The field tests also demonstrate the ability of the MPC controller to provide a multitude of grid services including real-time pricing, demand limiting, load shedding, load shifting, and load tracking, using the same optimization framework.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Design of a supervisory control system for autonomous operation of advanced reactors

Advanced reactors to be deployed in the coming decades will face deregulated energy markets, and may adopt flexible operation to boost profitability. To aid in the transition from baseload to flexible operation paradigm, autonomous operation is sought. This work focuses on the control aspect of autonomous operation. Specifically, a hierarchical control system is designed to support constraint enforcement during routine operational transients. Within the system, data-driven modeling, physics-based state observation, and classical control algorithms are integrated to provide an adaptable and robust solution. A 320 MW Fluoride-cooled High-temperature Pebble-bed Reactor is the design basis for demonstrating the proposed control system. The hierarchical control system consists of a supervisory layer and low-level layer. The supervisory layer receives requests to change the system's operating conditions (e.g., the current reactor power to meet a load -follow), and accepts or rejects them based on constraints that have been assigned. Constraints are issued to keep the plant within an optimal operating region. The low-level layer interfaces with the actuators of the system to fulfill requested changes, while maintaining tracking and regulation duties. Further, to accept requests at the supervisory layer, the Reference Governor algorithm was adopted. To model the dynamics of the reactor, a system identification algorithm, Dynamic Mode Decomposition, was utilized. To estimate the evolution of process variables that cannot be directly measured (e.g., the propagation of delayed neutron precursors), the Unscented Kalman Filter, incorporating a nonlinear model of nuclear dynamics, was adopted. The composition of these algorithms led to a numerical demonstration of constraint enforcement during a 40% power drop transient (at a rate of 5 %/min). Uncontrolled secondary-side temperatures were successfully constrained. Adaptability of the proposed system was demonstrated by modifying the constraint values, and enforcing them during the transient. Robustness was also demonstrated by enforcing constraints under noisy environments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Combining model-based and model-free methods for stochastic control of distributed energy resources

Modern distribution systems are experiencing a fast transformation with the growing penetration of distributed energy resources (DERs). Along with the economic and environmental benefits of DERs, challenges arise to address the uncertainties caused by their inherent volatility. If properly coordinated, however, DERs have the potential to provide the controllability that grid operators need. Here, we propose a hierarchical control framework that combines the model-based and model-free methods for stochastic DER control in distribution systems. The upper-level scheduler considers a chance-constrained optimal power flow problem (model-based) that schedules DER setpoints to minimize the operational cost and maintain the operating reserve. The lower-level distributed DER controllers absorb real-time disturbances and uncertainties using the extremum seeking control (model-free) to achieve grid objectives. The combination of model-based and model-free methods allows us to take the advantages of both methods to effectively manage the uncertainty in distribution systems. The proposed work is demonstrated on the IEEE 13-node feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

HHL algorithm with mapping function and enhanced sampling for model predictive control in microgrids

Here, this paper presents a refined quantum Harrow Hassidim Lloyd (HHL) algorithm for microgrid control. The first novelty of the developed method is that a mapping shift function enables the original HHL algorithm to handle general linear equations with non-singular and indefinite matrix. Second, a method of Matrix Extension for Amplifying Sampling Probabilities of Intended Solution (ME-ASPI) is proposed to design the reformulated linear algebraic equations, allowing for improved sampling efficiency of the quantum tomography in the refined HHL algorithm. Then, we applied the method to solve the model predictive control (MPC) problem in nonlinear dynamical microgrids. Specifically, with the ME-ASPI method, the refined HHL algorithm can effectively obtain the intended partial optimal control inputs for MPC. The optimization of quadratic programming problem in each time step of MPC is transformed into a linear system problem, which is addressed by the proposed quantum solver through using only partial information, with the time complexity improved from $\mathscr{O}(\mathscr{N}^{2.37286})$ classically to $\mathscr{O}(\mathscr{N}^{2} log \mathscr{N}$ x $p$ log $p)$ in quantum. Numerical examples have validated the effectiveness of the refined HHL algorithm with the proposed mapping function and the ME-ASPI method. By leveraging quantum properties, the proposed method provides a hybrid quantum–classical framework for microgrid control. This generic method can also potentially tackle many other challenges in analyzing and controlling general complex engineered systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Parallelized POD-based suboptimal economic model predictive control of a state-constrained Boussinesq approximation

Motivated by an energy efficient building application, we want to optimize a quadratic cost functional subject to the Boussinesq approximation of the Navier-Stokes equations and to bilateral state and control constraints. Since the computation of such an optimal solution is numerically costly, we design an efficient strategy to compute a sub-optimal (but applicationally acceptable) solution with significantly reduced computational effort. We employ an economic Model Predictive Control (MPC) strategy to obtain a feedback control. The MPC sub-problems are based on a linear-quadratic optimal control problem subjected to mixed control and state constraints and a convection-diffusion equation, reduced with proper orthogonal decomposition. Finally, to solve each sub-problem, we apply a primal-dual active set strategy. The method can be fully parallelized, which enables the solution of large problems with real-world parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Dynamic modelling and control strategy of a temperature-driven metal hydride cooling system for buildings

A temperature-driven coupled metal hydride (MH) based thermal energy storage (TES) system can allow to shave and shift the peak energy demand in buildings. The high energy density and long-term (seasonal) energy storage capability are its major advantages over other energy storage methods. The dynamic nature of the MH operation, however, requires controlled hydrogen transfer between the coupled MHs at a rate needed to meet the building's transient load. While temperature-driven MH systems are studied in the literature, their application in buildings and control are scarcely reported. Here, this paper presents a control-based dynamic modeling of the temperature-driven coupled MH-TES system for building cooling applications. The dynamic model is developed in MATLAB(R) Simulink environment, considering the thermodynamic and kinetic behaviors of the MH systems. Based on a preliminary analysis of a property database of over 337 hydrides, we select around 1600 MH pairs suitable for building cooling applications. Each of these MH pairs is studied for their performance using the dynamic model, and among all, Zr 0.76 Ti 0.24 Ni 1.16 Mn 0.63 V 0.14 Fe 0.18 -Ti 0.85 Zr 0.15 Cr 1.2 Mn 0.8 MH pair showed fast dynamics along with high coefficient of performance (COP) of 0.71. A parametric investigation is performed on this MH pair to understand the effect of operating temperatures. Finally, three proportional-integral (PI) feedback controllers are investigated to regulate the temperature, pressure and mass exchange between the coupled MH pairs. The developed PI controller is sufficiently capable of rejecting the signal noise from the hydrogen flow and internal heat exchange processes with root mean square error of 5.78 W between reference and actual cooling load.

08 HYDROGEN↗
DOE OSTI2025

Field evaluation of zone temperature response to control actions in cooling systems of small and medium-sized office buildings

The response of zone temperature to control actions in heating, ventilation, and air conditioning (HVAC) systems, known as zone temperature response, has been a central focus of building control research owing to its crucial role in determining control performance. However, existing studies often overlook the representativeness of the buildings being studied, resulting in unclear generalizations. In addition, those studies tend to focus on a single aspect of the response. Furthermore, this paper provides the first comprehensive characterization of zone temperature response applicable to a clearly defined building sector—small and medium-sized office (SMO) buildings (<5000 m 2 ) in the US. Specifically, two representative SMO buildings, selected based on the US Department of Energy’s commercial prototype buildings, were studied. Field tests were conducted over a 2-month period during summer, and the collected data were analyzed with two key metrics—delay time and nonlinearity index—to quantify zone temperature response, capturing both short- and long-term patterns. Beyond this quantitative characterization, the analysis reveals that the HVAC system type, rather than factors like floor area or zone location, is the primary determinant of the zone temperature response. Drawing on the field test results, we recommend that building control strategies monitor zone temperatures at intervals shorter than 10 minutes, configure controls independently for VAV- and RTU-served zones, and implement nonlinear methods at the zone level—particularly for VAV zones—rather than across the entire building.

Building control↗
DOE OSTI2022

Large-scale scenarios of electric vehicle charging with a data-driven model of control

Transportation electrification is forecast to bring millions of new electric vehicles to roads worldwide this decade. Planning to support those vehicles depends on detailed scenarios of their electricity demand in both uncontrolled and controlled or smart charging scenarios. In this work, we present a novel modeling approach to enable rapid generation of demand estimates that represent the impact of controlled charging for large-scale scenarios with millions of individual drivers. To model the effect of load modulation control on aggregate charging profiles, we propose a novel machine learning approach that replaces traditional optimization approaches. We demonstrate its performance modeling workplace charging control under a range of electricity rate schedules, achieving small errors (2.5%–4.5%) while accelerating computations by more than 4000 times. To generate the uncontrolled charging demand for scenarios with residential, workplace, and public charging we use statistical representations of a large data set of real charging sessions. We demonstrate the methodology by generating diverse sets of scenarios for California's charging demand in 2030 which consider multiple charging segments and controls, each run locally in under 50 s. We further demonstrate support for rate design by modeling the large-scale impact of a new, custom rate schedule for workplace charging.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2022

Optimizing conformance control for gas injection EOR in unconventional reservoirs

Field observations have shown that interference between wells caused by connected fractures commonly exists in unconventional reservoirs. The well interference effect and conformance issues could lead to minimal enhanced oil recovery response (EOR) in actual operations if they are not properly controlled. A series of data analysis, modeling, and experimental activities were performed in this study to investigate the gas EOR strategies in the Bakken Formation. Employing the embedded discrete fracture modeling technology, a multiple-well, multiple-fracture model was developed to capture the well interference and conformance issues in the Bakken. The model made it possible to investigate the complex flow behavior between wells in the EOR (huff ‘n’ puff) processes. Alternative EOR and conformance control strategies using water and surfactant injections were studied to improve oil production performance based on experimental observations. Results showed that water injection could be used for conformance control in the Bakken because of its relatively low mobility compared to gas; however, water could also block oil flow around the conformance control wells because of the high interfacial tension between oil and water. Adding surfactant to the injection water is more effective for improving gas EOR performance since surfactant reduces the oil–water interfacial tension and contact angle effectively. Up to 9.4% more oil could be produced from the huff ‘n’ puff wells in 2 years of EOR operations when rich gas was injected at only 3 MMscf/d with 6000 psi of surfactant injection in the offset wells for conformance control.

42 ENGINEERING↗