Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Asynchronous and Distributed Tracking of Time-Varying Fixed Points

NREL researcher Andrey Bernstein discusses asynchronous and distributed tracking of time-varying fixed points as part of the Innovative Optimization and Control Methods for Highly Distributed Autonomous Systems workshop. NREL hosted the workshop to exchange ideas on state-of-the-art control and optimization strategies as well as get feedback on work being done at NREL.

97 MATHEMATICS AND COMPUTING↗

Convex Q-Learning in Continuous Time with Application to Dispatch of Distributed Energy Resources

Convex Q-learning is a recent approach to reinforcement learning, motivated by the possibility of a firmer theory for convergence, and the possibility of making use of greater a priori knowledge regarding policy or value function structure. This paper explores algorithm design in the continuous time domain, with a finite-horizon optimal control objective. The main contributions are (i) The new Q-ODE: a model-free characterization of the Hamilton-Jacobi-Bellman equation. (ii) A formulation of Convex Q-learning that avoids approximations appearing in prior work. The Bellman error used in the algorithm is defined by filtered measurements, which is necessary in the presence of measurement noise. (iii) Convex Q-learning with linear function approximation is a convex program. It is shown that the constraint region is bounded, subject to an exploration condition on the training input. (iv) The theory is illustrated in application to resource allocation for distributed energy resources, for which the theory is ideally suited.

Lu, Fan↗

Ocean Wave Energy Harvester with Oak Ridge Converter

Oceans can provide great potential for the American energy dominance. There is significant potential to utilize marine energy resources. In the United States, the total amount of marine energy available is equivalent to about 57% of the country's total power generation in 2019. Even if a fraction of this technical potential is harnessed, marine energy technologies could play a crucial role in fulfilling the nation's energy requirements. Marine energy resources are spread out geographically, and because more than 50% of the United States' population resides within 50 miles of the coastline, they are well-positioned to power local communities. These resources are also very dependable, making them a viable option for contributing to a consistent, trustworthy energy grid. Due to their predictable daily and seasonal patterns, marine energy resources can be integrated into our energy generation portfolio. On the other hand, ocean environment presents many challenges for cost-effective renewable energy conversion, including optimal control of ocean wave energy. This report presents a novel cost-effective energy conversion technique for ocean wave energy harvesters. The proposed system is simulated by using the Oak Ridge Converter to directly interface ocean wave energy source with the utility grid. The system description and simulation results are presented in detail. The results show that the proposed system is a cost effective and promising technology to reduce the infrastructure cost for ocean wave energy harvesters.

Sutton, Elizabeth [ORNL] (ORCID:0009000078885935)↗

Smart Grid and Smart Cities

We hope the proceedings will offer the readers a good opportunity to explore the state-of-the art developments and future directions of researches on smart grid and smart cities. These conferences covered the recent trends and progresses made in the field of smart grid and smart cities. For the past few years, smart grids have been one of the main topics in research and development at academic, industry, business and government level. The smart grid is envisaged to be the next generation electric grid for Smart Cities. It enables the smart integration of conventional power generation, renewable generation, distributed generation, energy storage, transmission, distribution and demand management. The benefits of smart grid include the enhanced reliability and resilience, higher intelligence and optimized control, decentralized operation, higher operational efficiency, more efficient demand management, and better power quality. However, all these prospected transformations also bring with them numerous challenges and opportunities. The conference program covers keynotes, invited, oral and poster presentations. The keynotes and invited talks are focused on the potential application of smart grid and smart cities in various fields of application. Among 105 full length articles submitted to the conference, 59 manuscripts were accepted after a thorough peer reviews and were recommended for presentations and publication in this proceedings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DeepGrid: Robust Deep Reinforcement Learning-based Contingency Management

Increasing uncertainty raised by the integration of renewable energy resources requires an enormous number of simulations to be carried out for the security assessment of the power grid. However, it is challenging to assess the steady-state and dynamic security indices for different system contingency events by doing an exhaustive analysis in real-time due to the computational and communication constraints. One promising solution is using data-driven techniques along with the system models to train an intelligent contingency management framework to better handle the contingencies in real-time. Nevertheless, implementing a data-driven technique to obtain the best remedial actions necessitates to account for the effect of the measurement noise on the performance of the contingency management. To tackle these challenges, we leverage a robust deep reinforcement learning (DRL) algorithm called Double Deep Q-Network (DDQN) to design a recommender system capable of prescribing optimal control actions with the help of the real-time digital simulator (RTDS). The use of RTDS system in combination with the advanced DRL algorithm allows to explore a wide variety of system contingencies in order to derive better remedial actions. The performance of the proposed algorithm is evaluated in IEEE 9-bus system under different loading conditions, and different network configurations in presence of noisy measurements.

Ghasemkhani, Amir↗

Impact of connected and automated vehicles on traffic flow

In this paper, we investigate the impact of connected and automated vehicles (CAVs) on traffic flow at merging roadways and develop a microscopic simulation framework to explore the implications on fuel consumption and travel time. In this framework, we use optimal control to simulate the behavior of CAVs and the Gipps car following model to capture the behavior of human-driven vehicles. The simulation results show that CAVs can contribute to significant fuel consumption and travel time reduction for diverse traffic conditions under average and high congestion scenarios. Furthermore, we show that CAVs allow for more stable traffic patterns even for high density traffic.

Rios Torres, Jackeline↗

Neural Network Predictive Controller for Grid-Connected Virtual Synchronous Generator

In this paper, a neural network predictive controller is proposed to regulate the active and the reactive power delivered to the grid generated by a three-phase virtual inertia-based inverter. The concept of the conventional virtual synchronous generator (VSG) is discussed, and it is shown that when the inverter is connected to non-inductive grids, the conventional PI-based VSGs are unable to perform acceptable tracking. The concept of the neural network predictive controller is also discussed to replace the traditional VSGs. This replacement enables inverters to perform in both inductive and non-inductive grids. The simulation results confirm that a well-trained neural network predictive controller illustrates can adapt to any grid impedance angle, compared to the traditional PI-based virtual inertia controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Heuristic Dynamic Programming for Adaptive Virtual Synchronous Generators

In this paper a neural network heuristic dynamic programing (HDP) is used for optimal control of the virtual inertia-based control of grid connected three-phase inverters. It is shown that the conventional virtual inertia controllers are not suited for non-inductive grids. A neural network-based controller is proposed to adapt to any impedance angle. Applying an adaptive dynamic programming controller instead of a supervised controlled method enables the system to adjust itself to different conditions. The proposed HDP consists of two subnetworks: critic network and action network. These networks can be trained during the same training cycle to decrease the training time. The simulation results confirm that the proposed neural network HDP controller performs better than the traditional direct-fed voltage and/or reactive power controllers in virtual inertia control schemes.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Value Gradient Learning Approach in Power and Frequency Regulation of Grid-Connected Synchronverters

In this paper, a neural network adaptive critic design (ACD) method based on value gradient learning (VGL) is used to optimally control a grid-connected synchronverter. The main drawback of the traditional synchronverters is their infeasibility to face non-inductive grids. To be able to implement a synchronverter technique in any impedance angle, a neural network-based adaptive controller is used. The advantage of adaptive dynamic programing is its ability to adjust itself when it faces changes and uncertainties in the power system. The proposed VGL consists of two subnetworks: the critic network and the action network. The action network is trained during the operation, and the critic network can be pretrained offline or can be simultaneously trained with the action network. To compare the effectiveness of the traditional synchronverter to the VGL-based synchronverter, the simulation results are provided.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Tri-Sectional Approximation of the Shortest Path to Long-Term Voltage Stability Boundary with Distributed Energy Resources

Ensuring long-term voltage stability is critical for reliable operations of power grids. High share of distributed energy resources (DERs) can create complicated system operation modes that may invalidate the traditional long-term voltage stability analysis based on typical operation modes. To address this challenge, this paper investigates how to compute the shortest path to the voltage stability boundary in the DER aggregated load space with large dispersion. Instead of working in the Euclidean space, we establish the analysis and computations on the algebraic power flow manifold to better capture the curvature change of the shortest path along the direction of losing stability. A modified optimal control framework is presented for obtaining the ground-truth of the smooth shortest path on the manifold. To efficiently and accurately solve for the shortest path, we further leverage the geometric features of the power flow manifold and propose a tri-sectional approximation model that is scalable for large-scale systems. Several numerical examples, up to the 1354-bus system, with different DER penetration levels and high dimensional renewable power injection variations are evaluated. The simulation results demonstrate that the tri-sectional approximation achieves high accuracy and efficiency to approximate the shortest path to the voltage stability boundary.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Woody plants optimise stomatal behaviour relative to hydraulic risk

Abstract Stomatal response to environmental conditions forms the backbone of all ecosystem and carbon cycle models, but is largely based on empirical relationships. Evolutionary theories of stomatal behaviour are critical for guarding against prediction errors of empirical models under future climates. Longstanding theory holds that stomata maximise fitness by acting to maintain constant marginal water use efficiency over a given time horizon, but a recent evolutionary theory proposes that stomata instead maximise carbon gain minus carbon costs/risk of hydraulic damage. Using data from 34 species that span global forest biomes, we find that the recent carbon‐maximisation optimisation theory is widely supported, revealing that the evolution of stomatal regulation has not been primarily driven by attainment of constant marginal water use efficiency. Optimal control of stomata to manage hydraulic risk is likely to have significant consequences for ecosystem fluxes during drought, which is critical given projected intensification of the global hydrological cycle.

Anderegg, William R. L.↗

On-Line Prediction of Resistant Force During Soil–Tool Interaction

For off-road vehicles such as excavators and wheel loaders, a large portion of energy is consumed to overcome the soil resistant force in the digging process. For optimal control of the digging tool, a high-fidelity model of the soil–tool interaction force is important to reduce energy consumption. Here, in this paper, an on-line soil resistant force prediction method is proposed. In this method, a hybrid model, which combines a physical model and a data-driven model, is used for the force prediction. In addition, the parameters of the hybrid model can be updated on-line based on real-time data. Comparisons with experimental data demonstrate that the proposed prediction method has an average error of around 12.7%.

42 ENGINEERING↗

Minor Isozymes Tailor Yeast Metabolism to Carbon Availability

ABSTRACT Isozymes are enzymes that differ in sequence but catalyze the same chemical reactions. Despite their apparent redundancy, isozymes are often retained over evolutionary time, suggesting that they contribute to fitness. We developed an unsupervised computational method for identifying environmental conditions under which isozymes are likely to make fitness contributions. This method analyzes published gene expression data to find specific experimental perturbations that induce differential isozyme expression. In yeast, we found that isozymes are strongly enriched in the pathways of central carbon metabolism and that many isozyme pairs show anticorrelated expression during the respirofermentative shift. Building on these observations, we assigned function to two minor central carbon isozymes, aconitase 2 ( ACO2 ) and pyruvate kinase 2 ( PYK2 ). ACO2 is expressed during fermentation and proves advantageous when glucose is limiting. PYK2 is expressed during respiration and proves advantageous for growth on three-carbon substrates. PYK2 ’s deletion can be rescued by expressing the major pyruvate kinase only if that enzyme carries mutations mirroring PYK2 ’s allosteric regulation. Thus, central carbon isozymes help to optimize allosteric metabolic regulation under a broad range of potential nutrient conditions while requiring only a small number of transcriptional states. IMPORTANCE Gene duplication is one of the main evolutionary paths to new protein function. Typically, duplicated genes either accumulate mutations and degrade into pseudogenes or are retained and diverge in function. Some duplicated genes, however, show long-term persistence without apparently acquiring new function. An important class of isozymes consists of those that catalyze the same reaction in the same compartment, where knockout of one isozyme causes no known functional defect. Here we present an approach to assigning specific functional roles to seemingly redundant isozymes. First, gene expression data are analyzed computationally to identify conditions under which isozyme expression diverges. Then, knockouts are compared under those conditions. This approach revealed that the expression of many yeast isozymes diverges in response to carbon availability and that carbon source manipulations can induce fitness phenotypes for seemingly redundant isozymes. A driver of these fitness phenotypes is differential allosteric enzyme regulation, indicating isozyme divergence to achieve more-optimal control of metabolism.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring the Meta-regulon of the CRP/FNR Family of Global Transcriptional Regulators in a Partial-Nitritation Anammox Microbiome

Microbiomes are important contributors to many ecosystems, including ones where nutrient cycling is stimulated by aeration control. Optimizing cyclic aeration helps reduce energy needs and maximize microbiome performance during wastewater treatment; however, little is known about how most microbial community members respond to these alternating conditions.

transcription factors↗

Qompress: Efficient Compilation for Ququarts Exploiting Partial and Mixed Radix Operations for Communication Reduction

Quantum computing is in an era of limited resources. Current hardware lacks high fidelity gates, long coherence times, and the number of computational units required to perform meaningful computation. Contemporary quantum devices typically use a binary system, where each qubit exists in a superposition of the 0 and 1 states. Furthermore, it is often possible to access the 2 or even 3 states in the same physical unit by manipulating the system in different ways. In this work, we consider automatically encoding two qubits into one four-state ququart via a compression scheme. We use quantum optimal control to design efficient proof-of-concept gates that fully replicate standard qubit computation on these encoded qubits.

compilation↗