Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Simulation Evaluation of a Large-Scale Implementation of Virtual-Phase Link-Based Model Predictive Control

Traffic congestion is a serious problem in the US, and traffic signal control is one of the effective solutions to congestion. Previous research on model predictive control (MPC)-based traffic signal control showed substantial benefits over conventional methods. This study focused on implementing MPC over a large-scale network with complex intersections and the impact of cycle length, network size, and imperfect state estimation on performances. This study implemented a virtual phase link (VPL)-based model predictive control method which used the number of vehicles in each VPL as input state variables and was suitable for National Electrical Manufacturing Association (NEMA) ring-barrier control. To test the impact of network size, the performance of distributed MPC (36 intersections in the network are divided into five subnetworks) was compared with that of MPC over the full network for a set of cycle lengths. To test the impact of imperfect state estimation, we synthetically infused estimation error and developed two scenarios, MPC-error and MPC-error narrow, which had higher and lower estimation errors, respectively. The performance of these MPC methods was compared with that of the existing time-of-day (TOD) method and an offline method that used Webster's method for split and MULTIBAND for cycle length and offset optimization. Trajectory and linkwise signal performance measures were collected from the simulation to evaluate performance. The distributed MPC method with perfect state estimation had the lowest delay and highest energy efficiency of all the methods. The performance of MPC decreased as the prediction inaccuracy increased. MPC-error had 7% and 11% more delay than MPC-error narrow in the morning and evening peaks, respectively. Overall, simulation results suggest that even with imperfect state estimation, MPC methods will outperform offline methods significantly.

large-scale simulation↗
DOE OSTI2020

Predictive and Cooperative Voltage Control with Probabilistic Load and Solar Generation Forecasting

This paper proposes predictive cooperative voltage control method in a power system with high penetration of photovoltaic (PV) units. Cooperative distributed control of the reactive power output of PV inverters is coordinated with operation of voltage regulators (VRs) to maintain system voltages within an appropriate bandwidth. Probabilistic forecasting of the solar power generation and the loads is applied to estimate voltage changes which, in turn, are used to set the VR tap positions for preventing large voltage fluctuations with the lowest risk considering the voltage distribution estimation. The fine tuning of voltage adjustment is achieved by cooperative control of PV inverters to maintain a uniform voltage profile across the system. The proposed method is tested on the modified IEEE 123-node test feeder with high PV penetration using real insolation data and with constant loads replaced by several different load profiles. Simulation results demonstrate the effectiveness of the coordinated approach for voltage control with cooperative PV and predictive VR controls taking into account probabilistic load and solar power forecasts.

Cooperative Control↗
DOE OSTI2026

Closed-Loop Wind Turbine Controllers for Active Wake Mixing Strategies

Wind turbine active wake mixing (AWM) is an exciting new field of research where dynamic actuation, usually on the blade pitch angles, is used to increase wind farm-wide power production. From a controls perspective, the current state-of-the-art AWM strategies are very simple: a dynamic, usually periodic, reference signal is prescribed to actuators in an open-loop (OL) fashion. The actuation is then presumed to have a certain desired effect on the system, i.e., the wind turbine and the flow it affects. However, this system is highly nonlinear and experiences disturbances in the form of wind variations that are not known a priori. As a result, the OL approach might not yield optimal results. In this article, a novel approach is presented, which closes the loop on AWM controllers. A feedback loop is implemented, which uses measurements of the individual blade bending moments that are widely available on modern wind turbines to determine the individual blade pitch angles. A proof of concept of this implementation is presented in this article, and a thorough comparison with the OL method is executed using high-fidelity flow simulations. These simulations show that the novel closed-loop controller does not substantially increase wake mixing but achieves similar performance as the OL controller while reducing fatigue loads on the controlled turbine.

17 WIND ENERGY↗
DOE OSTI2020

Accurate Consensus-based Distributed Averaging with Variable Time Delay in Support of Distributed Secondary Control Algorithms

We report that distributed secondary control has been widely used in hierarchical control structures, where multiple distributed generators (DGs) need to coordinate to regulate system voltage and frequency. In these systems, consensus algorithms determine the average of a group of dynamic states (e.g. voltages measured by a group of DGs). To be useful, consensus algorithms must be computationally efficient, stable and accurate. In practice, numerous practical implementation challenges significantly affect the consensus equilibrium. In this paper, we quantify the accuracy deviations of the distributed average observer algorithms proposed in the literature to demonstrate the problems with the state-of-the-art distributed averaging techniques. A novel approach is proposed that achieves accurate average tracking in the presence of time-varying communication delays among agents. In our implementation, time synchronization of all distributed controllers is enabled by a novel software platform, called Resilient Information Architecture Platform for the Smart Grid (RIAPS). The proposed distributed average observer is implemented on hardware controllers and its effectiveness is validated in a controller hardware-in-the-loop testbed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A Method of Optimal Control for Class 8 Vehicle Platoons Over Hilly Terrain

This work develops and implements an NMPC control system to facilitate fuel-optimal platooning of Class 8 vehicles over challenging terrain. Prior research has shown that Cooperative Adaptive Cruise Control (CACC), which allows multiple Class 8 vehicles to follow in close succession, can save between 3 and 8% in overall fuel consumption on flat terrain. However, on more challenging terrain, e.g. rolling hills, platooning vehicles can experience diminished fuel savings, and, in some cases, an increase in fuel consumption relative to individual vehicle operation. This research explores the use of Nonlinear Model Predictive Control (NMPC) with predefined route grade profiles to allow platooning vehicles to generate an optimal velocity trajectory with respect to fuel consumption. In order to successfully implement the NMPC system, a model relating vehicle velocity to fuel consumption was generated and validated using experimental data. Additionally, the predefined route grade profiles were created by using the vehicle's GPS velocity over the desired terrain. The real-time NMPC system was then implemented on a two-truck platoon operating over challenging terrain, with a reference vehicle running individually. The results from NMPC platooning are compared against fuel results from a classical proportional-integral-derivative (PID) headway control method. Furthermore, this comparison yields the comparative fuel savings and energy efficiency benefit of NMPC system. In the final analysis, significant fuel savings of greater than 14 and 20% were seen for the lead and following vehicles relative to their respective traditional cruise control and platooning architectures.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Distributed Online Voltage Control in Distribution Network: A Two-Stage Real-Time Implementation

The increasing integration of renewable-based distributed generation (DG) brings growing challenges to distribution network (DN) voltage control. To address this issue, a two-stage distributed online voltage control framework (TDO-VC) is proposed in this paper. In the proposed method, legacy voltage control devices are controlled in the upper stage on an hourly timescale, while DGs operate autonomously online in the lower stage to remove instantaneous voltage violations. The idea of receding horizon control is applied in the upper stage to comprehensively consider the current and future renewable generation, and the generalized fast dual ascent (Gf-DA) is employed in the lower stage to effectively manage DGs through near real-time optimization. The effectiveness of the proposed TDO-VC is demonstrated by rigorous theoretical analysis and case studies on IEEE-123 bus system.

Distributed generation↗
DOE OSTI2025

Physics-informed Deep Reinforcement Learning-based Control in Power systems

Incorporating physics information into the deep reinforcement learning (DRL) process is a promising approach for addressing the challenges faced in learning-based control design problems for physical systems. Power grid dynamics, being a physical system, adheres to specific physical laws, constraints, as well as operational and control rules. Therefore, consideration of such physics-based law improves the learning process drastically. In general, traditional grid control schemes rely on rule-based mechanisms that cannot adapt to changing operating conditions. To improve the adaptability and computation time, recent research has seen a surge of DRL-based applications in power grid control. A generic DRL-based control design imposes the system performance requirements through the design of reward functions. In some cases, some of the important physics information is injected through this reward function. However, due to the complex dynamics and large state-action space, learning an optimal DRL policy often becomes challenging. Inspired by the latest developments in general machine learning (ML) research, power system researchers have been investigating more direct ways of incorporating physics knowledge into DRL training. This chapter specifically focuses on these aspects of physics-informed DRL designs in grid control. It discusses the significance, applications, research gaps, and open problems that need to be addressed in future research.

artificial intelligence, machine learning↗
DOE OSTI2022

Electrical Switching of Nematic Plasmonic Nanocolloids for Infrared Solar Gain Control

Controlling solar gain is essential to reduce the energy consumption by residential and commercial buildings, which are responsible for ≈40% of all energy generated globally. However, the dynamic control of solar gain in the near-infrared that corresponds to ≈50% of the overall Sun's energy at the Earth's surface, separately from the visible spectral range has been a challenge, albeit commercial coatings provide passive control while retaining highly visible transmission. To address this problem, in this paper switchable silver colloids (SSCs) are demonstrated, colloidal analogs of the common silver coatings used for solar gain control. When dispersed in a nematic liquid crystal, orientations of such plasmonic silver nanoplates are controlled by ≈1 V low-voltage electric fields, allowing for sub-second switching of the near-infrared-based solar gain. Installed and retrofit products made from thin films of such nanoplate dispersions confined between glass and plastic substrates, respectively, exhibit electrically controlled infrared-based solar gain while retaining high visible-range transparency, low haze, and high color rendering index. Furthermore, this study's findings reveal a great potential of soft-matter systems in addressing energy-related problems.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Machine‐learning‐based construction of barrier functions and models for safe model predictive control

Abstract In this paper, we propose a control Lyapunov‐barrier function‐based model predictive control method utilizing a feed‐forward neural network specified control barrier function (CBF) and a recurrent neural network (RNN) predictive model to stabilize nonlinear processes with input constraints, and to guarantee that safety requirements are met for all times. The nonlinear system is first modeled using RNN techniques, and a CBF is characterized by constructing a feed‐forward neural network (FNN) model with unique structures and properties. The FNN model for the CBF is trained based on data samples collected from safe and unsafe operating regions, and the resulting FNN model is verified to demonstrate that the safety properties of the CBF are satisfied. Given sufficiently small bounded modeling errors for both the FNN and the RNN models, the proposed control system is able to guarantee closed‐loop stability while preventing the closed‐loop states from entering unsafe regions in state‐space under sample‐and‐hold control action implementation. We provide the theoretical analysis for bounded unsafe sets in state‐space, and demonstrate the effectiveness of the proposed control strategy using a nonlinear chemical process example with a bounded unsafe region.

Chen, Scarlett↗
DOE OSTI2022

A machine learning approach for clinker quality prediction and nonlinear model predictive control design for a rotary cement kiln

Abstract Cement manufacturing is energy‐intensive (5Gj/t) and comprises a significant portion of the energy footprint of concrete systems. Incorporating modern monitoring, simulation and control systems will allow lower energy use, lower environmental impact, and lower costs of this widely used construction material. One of the goals of the CESMII roadmap project on the Smart Manufacturing of Cement included developing an analytical process model for clinker quality that includes the chemistry of the kiln feed and accounts for critical process variables. This predictive model will be used in nonlinear model predictive control system designed to significantly reduce process energy use while maintaining or improving product quality. In the cement manufacturing plant used in this study, the kiln feed (meal) is tested every 12 h and used to estimate the mineral composition of the cement kiln output (clinker) using the stoichiometry‐based Bogue's model and the expertise of the plant operators. During kiln operation, kiln output (clinker) is sampled and tested every 2 h to measure its chemical and mineral composition. The predicted and measured values of the clinker composition are used by the plant operators to adjust the kiln input stream and the production process characteristics to maintain stable operation and uniform product quality. However, the time delay between prediction and testing, along with inaccuracies inherent in the Bogue's model have made any process changes designed to minimize energy use problematic, especially in‐light of potential clinker quality issues that process changes often pose. A new analytical model that integrates quality information and process operation information has been developed from data collected from 2 years of production from an operating cement facility. To make the model fuel‐type‐independent, consumed heat energy was computed in the model instead of fuel type and amount. A Feedforward Network was trained and tailored from collected data. Many data‐based simulations were conducted to quantitatively evaluate the proposed model and the 5‐fold cross‐validation procedure was used to test the models. The resulting predictive model was shown to have a low root mean square error (MSE) with respect to the estimated clinker mineral composition compared to that using the industry standard “Bogue’ model”. The end goal of this work was to develop a single machine learning tool that allows the use of quality control data and process control variables to improve energy efficiency of the process in a continuous fashion. The proposed nonlinear model predictive control system (NMPC) can generate predicted kiln production characteristics based on manipulated variables in manner that accurately follows the target product quality values. Simulation results also show that the proposed model produced accurate predictions of kiln outputs that fell within the required constraints, while manipulating control variables within typical operational ranges.

Ali, Asem M.↗
DOE OSTI2022

Exploring Gradient-Based Multi-directional Controls in GANs

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its controllable generation an open problem, especially when spurious correlations between different semantic attributes exist in the image distributions. To address this problem, previous methods typically learn linear directions or individual channels that control semantic attributes in the image space. However, they often suffer from imperfect disentanglement, or are unable to obtain multi-directional controls. Furthermore, in this work, in light of the above challenges, we propose a novel approach that discovers nonlinear controls, which enables multi-directional manipulation as well as effective disentanglement, based on gradient information in the learned GAN latent space. More specifically, we first learn interpolation directions by following the gradients from classification networks trained separately on the attributes, and then navigate the latent space by exclusively controlling channels activated for the target attribute in the learned directions. Empirically, with small training data, our approach is able to gain fine-grained controls over a diverse set of bi-directional and multi-directional attributes, and we showcase its ability to achieve disentanglement significantly better than state-of-the-art methods both qualitatively and quantitatively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Security Assessment of an LBP16-Protocol-Based Computer Numerical Control Machine

Subtractive manufacturing systems, specifically, computer numerical control machines, have revolutionized the manufacturing industry. Computer numerical control machining is the preferred method for producing finished parts due to its efficiency, speed and suitability for high-volume production. Securing computer numerical control machines is a priority. Compromises or disruptions of these machines can result in significant downtime, loss of productivity and financial loss. This study examines the vulnerabilities and risks associated with computer numerical control machines, in particular, systems utilizing the LBP16 protocol for controller-machine communications. The study reveals that an adversary can execute cyber-physical attacks such as sabotage and denial of service. The potential security threats emphasize the importance of implementing robust security measures to mitigate the cyber risks to computer numerical control machines.

Forihat, Yahya [Virginia Commonwealth University, ↗
DOE OSTI2025

Automated Programmable Logic Controller Memory Forensics Using RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and Internet-based technologies has enhanced industrial control system operations but have inadvertently increased their vulnerabilities to cyber attacks. When an industrial control system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies. Memory forensics is critical in the incident analysis process to ascertain what occurred. Approaches for analyzing the persistent memory in industrial control devices are limited and almost nonexistent for volatile memory. This chapter proposes an automated methodology for programmable logic controller memory dump analysis using computer vision and deep learning techniques. The methodology converts the sequences of bytes in a programmable logic controller memory dump to red-green-blue pixels and employs a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. The trained model is employed to automatically segment new memory images and identify forensic artifacts. Evaluation of the methodology on a Schneider Electric Modicon M221 programmable logic controller under code injection and code modification attacks demonstrates its ability to detect attack artifacts in memory dumps.

Asmar Awad, Rima [ORNL] (ORCID:0000000233407742)↗
DOE OSTI2021

Quantifying microbial control of soil organic matter dynamics at macrosystem scales

Soil organic matter (SOM) stocks, decomposition and persistence are largely the product of controls that act locally. Yet the controls are shaped and interact at multiple spatiotemporal scales, from which macrosystem patterns in SOM emerge. Theory on SOM turnover recognizes the resulting spatial and temporal conditionality in the effect sizes of controls that play out across macrosystems, and couples them through evolutionary and community assembly processes. For example, climate history shapes plant functional traits, which in turn interact with contemporary climate to influence SOM dynamics. Selection and assembly also shape the functional traits of soil decomposer communities, but it is less clear how in turn these traits influence temporal macrosystem patterns in SOM turnover. Here, we review evidence that establishes the expectation that selection and assembly should generate decomposer communities across macrosystems that have distinct functional effects on SOM dynamics. Representation of this knowledge in soil biogeochemical models affects the magnitude and direction of projected SOM responses under global change. Yet there is high uncertainty and low confidence in these projections. To address these issues, we make the case that a coordinated set of empirical practices are required which necessitate (1) greater use of statistical approaches in biogeochemistry that are suited to causative inference; (2) long-term, macrosystem-scale, observational and experimental networks to reveal conditionality in effect sizes, and embedded correlation, in controls on SOM turnover; and (3) use of multiple measurement grains to capture local- and macroscale variation in controls and outcomes, to avoid obscuring causative understanding through data aggregation. Here, when employed together, along with process-based models to synthesize knowledge and guide further empirical work, we believe these practices will rapidly advance understanding of microbial controls on SOM and improve carbon cycle projections that guide policies on climate adaptation and mitigation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Designing reinforcement learning algorithms for building HVAC control: From experimental observation to simulation comparisons

Advanced supervisory-level control with reinforcement learning (RL) is regarded as a promising solution for HVAC systems to minimize energy consumption while maintaining thermal comfort and indoor air quality. However, most RL applications were conducted in the simulation environment rather than real-world HVAC systems. This paper developed a value-based RL controller termed Deep Q-Network (DQN) for a typical central HVAC system and evaluated its performance in a building test facility. By comparing DQN with a rule-based controller, the study not only demonstrated the cases where DQN could properly maintain indoor comfort but also discussed possible reasons why DQN failed in some other situations. Recognizing the limitations of value-based RL algorithms from the experimental tests, a simulation study was conducted to compare DQN with an alternative RL approach, an actor–critic algorithm termed Deep Deterministic Policy Gradient (DDPG). In scenarios with a relatively large action space, DDPG outperformed DQN by requiring fewer computational resources and achieving better thermal comfort, lower energy consumption, and more stable control actions. The findings suggest that the ability of DDPG to handle continuous control variables more effectively allows for faster convergence in training and more precise control in practice, which enhances the overall efficiency and reliability of the HVAC system.

Guo, Fangzhou↗
DOE OSTI2021

Deep reinforcement learning control of hydraulic fracturing

Hydraulic fracturing is a technique to extract oil and gas from shale formations, and obtaining a uniform proppant concentration along the fracture is key to its productivity. Recently, various model predictive control schemes have been proposed to achieve this objective. But such controllers require an accurate and computationally efficient model which is difficult to obtain given the complexity of the process and uncertainties in the rock formation properties. In this article, we design a model-free data-based reinforcement learning controller which learns an optimal control policy through interactions with the process. Deep reinforcement learning (DRL) controller is based on the Deep Deterministic Policy Gradient algorithm that combines Deep-Q-network with actor-critic framework. In addition, we utilize dimensionality reduction and transfer learning to quicken the learning process. We show that the controller learns an optimal policy to obtain uniform proppant concentration despite the complex nature of the process while satisfying various input constraints.

42 ENGINEERING↗
DOE OSTI2020

Advances and challenges in KSTAR plasma control toward long-pulse, high-performance experiments

An overview of advances and progress on the KSTAR plasma control improvement is given. The enhancement of the KSTAR plasma control system (PCS) continues in order to enable implementations of more sophisticated control algorithms and capabilities of integrated controls on magnets, gas, heating and off-normal event handling. Features and functionalities on the generic magnetic controls, kinetic controls and new fault scheme design are added for the operation space expansion, mainly regarding recent achievements of higher plasma current up to 1.0–1.2MA, high-performance long pulse up to 90s, and discharges relevant to ITER. Technical challenges and prospective upgrades in the near future are described.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Extremum-Seeking-Based Ultra-local Model Predictive Control and Its Application to Electric Motor Speed Regulation

Electric vehicle (EV) market is rapidly expanding. As a critical component of EV, an electric motor needs to accurately follow a reference speed signal while respecting the electrical current constraint for safety. Those requirements are usually formulated as a model predictive control (MPC) problem. However, the performance of traditional model-based MPC depends on the accuracy of the system model, which may not always be guaranteed in reality. Therefore, we utilize a data-driven, model-free predictive control strategy, called ultra-local MPC (ULMPC), to control the speed of an electric motor. To further enhance the control performance of ULMPC, we employ the extremum-seeking control (ESC) to tune the control gain of the ULMPC online. Simulation and hardware experiments demonstrate the enhancement of the extremum-seeking-based ULMPC over a constant-gain ULMPC.

Zhou, Yujing↗