Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Control Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Modeling and Analysis of Modal Switching in Networked Transport Systems

We consider networked transport systems defined on directed graphs: the dynamics on the edges correspond to solutions of transport equations with space dimension one. In addition to the graph setting, a major consideration is the introduction and propagation of discontinuities in the solutions when the system may discontinuously switch modes, naturally or as a hybrid control. This kind of switching has been extensively studied for ordinary differential equations, but not much so far for systems governed by partial differential equations. In particular, we give well-posedness results for switching as a control, both in finite horizon open loop operation and as feedback based on sensor measurements in the system.

97 MATHEMATICS AND COMPUTING↗

Stochastic Impulse Control of Non-Markovian Processes

We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot apply quasi-variational inequalities techniques. We rather derive the main results using techniques involving reflected BSDEs and the Snell envelope.

97 MATHEMATICS AND COMPUTING↗

The Discounted Method and Equivalence of Average Criteria for Risk-Sensitive Markov Decision Processes on Borel Spaces

This note concerns discrete-time controlled Markov chains with Borel state and action spaces. Given a nonnegative cost function, the performance of a control policy is measured by the superior limit risk-sensitive average criterion associated with a constant and positive risk sensitivity coefficient. Within such a framework, the discounted approach is used (a) to establish the existence of solutions for the corresponding optimality inequality, and (b) to show that, under mild conditions on the cost function, the optimal value functions corresponding to the superior and inferior limit average criteria coincide on a certain subset of the state space. The approach of the paper relies on standard dynamic programming ideas and on a simple analytical derivation of a Tauberian relation.

97 MATHEMATICS AND COMPUTING↗

The Obstacle Version of the Geometric Dynamic Programming Principle: Application to the Pricing of American Options Under Constraints

We provide an obstacle version of the Geometric Dynamic Programming Principle of Soner and Touzi (J. Eur. Math. Soc. 4:201-236, 2002) for stochastic target problems. This opens the doors to a wide range of applications, particularly in risk control in finance and insurance, in which a controlled stochastic process has to be maintained in a given set on a time interval [0,T]. As an example of application, we show how it can be used to provide a viscosity characterization of the super-hedging cost of American options under portfolio constraints, without appealing to the standard dual formulation from mathematical finance. In particular, we allow for a degenerate volatility, a case which does not seem to have been studied so far in this context.

97 MATHEMATICS AND COMPUTING↗

Semi-Markov Control Processes with Unknown Holding Times Distribution Under an Average Cost Criterion

This paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution F. Assuming that F does not depend on state-action pairs, we combine suitable methods of statistical estimation of the mean holding time with control procedures to construct an average cost optimal Markovian policy {pi}-hat={l_brace}f{sub n}{r_brace}, and an optimal stationary policy {l_brace}f{sub {infinity}}{r_brace}, where f{sub n} converges to f{sub {infinity}} in the sense of Schael.

97 MATHEMATICS AND COMPUTING↗

Deterministic Minimax Impulse Control

We prove the uniqueness of the viscosity solution of an Isaacs quasi-variational inequality arising in an impulse control minimax problem, motivated by an application in mathematical finance.

97 MATHEMATICS AND COMPUTING↗

Risk-Sensitive Control with Near Monotone Cost

The infinite horizon risk-sensitive control problem for non-degenerate controlled diffusions is analyzed under a 'near monotonicity' condition on the running cost that penalizes large excursions of the process.

97 MATHEMATICS AND COMPUTING↗

Max-Plus Stochastic Control and Risk-Sensitivity

In the Maslov idempotent probability calculus, expectations of random variables are defined so as to be linear with respect to max-plus addition and scalar multiplication. This paper considers control problems in which the objective is to minimize the max-plus expectation of some max-plus additive running cost. Such problems arise naturally as limits of some types of risk sensitive stochastic control problems. The value function is a viscosity solution to a quasivariational inequality (QVI) of dynamic programming. Equivalence of this QVI to a nonlinear parabolic PDE with discontinuous Hamiltonian is used to prove a comparison theorem for viscosity sub- and super-solutions. An example from mathematical finance is given, and an application in nonlinear H-infinity control is sketched.

97 MATHEMATICS AND COMPUTING↗

Maximal Controllability for Boundary Control Problems

We develop a semigroup approach to abstract boundary control problems which allows to characterize the space of all approximately reachable states. We then introduce the 'maximal reachability space' giving an upper bound for this space. The abstract results are applied to the flow in a network controlled in a single vertex.

97 MATHEMATICS AND COMPUTING↗

Explicit Solution to a Certain Non-ELQG Risk-sensitive Stochastic Control Problem

A risk-sensitive stochastic control problem with finite/infinite horizon is studied with a 1-dimensional controlled process defined by a linear SDE with a linear control-term in the drift. In the criterion function, a non-linear/quadratic term is introduced by using the solution to a Riccati differential equation, and hence, the problem is not ELQG (Exponential Linear Quadratic Gaussian) in general. For the problem, optimal value and control are calculated in explicit forms and the set of admissible risk-sensitive parameters is given in a concrete form. As applications, two types of large deviations control problems, i.e., maximizing an upside large deviations probability and minimizing a downside large deviations probability, are mentioned.

97 MATHEMATICS AND COMPUTING↗

Discrete Approximations of Dynamical Quantum Zeno Effect

In this paper, we discuss approximations of the dynamical quantum Zeno effect by a fixed number of nonselective quantum measurements. A wide class of measurements whose efficiency is close to optimal in the case of two-level systems is found.

97 MATHEMATICS AND COMPUTING↗

Reinforcement Learning for feedback-enabled cyber resilience

The rapid growth in the number of devices and their connectivity has enlarged the attack surface and made cyber systems more vulnerable. As attackers become increasingly sophisticated and resourceful, mere reliance on traditional cyber protection, such as intrusion detection, firewalls, and encryption, is insufficient to secure the cyber systems. Cyber resilience provides a new security paradigm that complements inadequate protection with resilience mechanisms. A Cyber-Resilient Mechanism (CRM) adapts to the known or zero-day threats and uncertainties in real-time and strategically responds to them to maintain the critical functions of the cyber systems in the event of successful attacks. Feedback architectures play a pivotal role in enabling the online sensing, reasoning, and actuation process of the CRM. Reinforcement Learning (RL) is an important gathering of algorithms that epitomize the feedback architectures for cyber resilience. It allows the CRM to provide dynamic and sequential responses to attacks with limited or without prior knowledge of the environment and the attacker. In this work, we review the literature on RL for cyber resilience and discuss the cyber-resilient defenses against three major types of vulnerabilities, i.e., posture-related, information-related, and human-related vulnerabilities. Here we introduce moving target defense, defensive cyber deception, and assistive human security technologies as three application domains of CRMs to elaborate on their designs. The RL algorithms also have vulnerabilities themselves. We explain the major vulnerabilities of RL and present develop several attack models where the attacker target the information exchanged between the environment and the agent: the rewards, the state observations, and the action commands. We show that the attacker can trick the RL agent into learning a nefarious policy with minimum attacking effort. The paper introduces several defense methods to secure the RL-enabled systems from these attacks. However, there is still a lack of works that focuses on the defensive mechanisms for RL-enabled systems. Last but not least, we discuss the future challenges of RL for cyber security and resilience and emerging applications of RL-based CRMs.

97 MATHEMATICS AND COMPUTING↗

Critical values of cyber parameters in a dynamic microgrid system

An islanded microgrid can be used to serve critcal load as a resiliency source when a severe outage occurs. In an islanded mode, control of a microgrid relies on the communication system significantly. Hence, microgrids are cyberphysical systems and, therefore, the cyber system plays a crucial role in the performance of the cyber-power system. A microgrid control scheme is proposed for power dispatch and regulation based on the droop and proportional-integral (PI) feedback control. The proposed control strategy is validated for transient stability following dynamic events. To evaluate the impact of a networked control system on control performance, a cyber model is developed to represent data acquisition periods and communication delays. An analytical method is proposed to determine the critical values for the data reporting periods and communication delays. The analytical method based on a state space model of a networked control system is applicable for large-scale systems. A 2-dimensional stability region of a microgrid in the space of cyber parameters can be obtained by the proposed method, and the critical values of cyber parameters are determined based on the stability region. Simulation results validate that the design of a microgrid as a cyber-physical system needs to be guided by critical values for the data reporting period and communication delay to prevent system instability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Experimental Tests of Lateral Bedload Transport Induced by a Yawed Submerged Vane Array in Open-Channel Flows

This work proposes the use of an array of yawed porous vanes to control the lateral bedload transport by locally steering bedform migration and maximize the amount of sediments redirected toward a potential sediment extraction system or bypass channel. A laboratory experiment was conducted in a quasifield-scale channel with an array of permeable vanes installed on one side, in live-bed conditions under bedload dominant regime, i.e., negligible suspended load. A baseline experiment without vanes was also performed for comparison. The evolution of migrating bedforms of different scales was tracked in space and time using a high-resolution, state-of-the-art laser scanning device. The bedload transport rate in the streamwise direction was first calculated using bedforms’ geometry and migration velocity, and then spatially distributed over the entire monitored area using a new Eulerian-averaged grid-mapping method. This allowed us to introduce a new methodology to estimate the lateral bedload transport using control volume theory and applying mass conservation. Quantitative assessments of lateral bedload transport along the channel yield consistent results, suggesting that the vanes effectively move sediments laterally as intended. Under the investigated setup, the maximum lateral sediment transport rate ranges from 9% to 18% of the whole domain-averaged streamwise transport rate. The developed methodology also allowed to identify the location where sediment capture could be maximized for the given vane spatial distribution.

42 ENGINEERING↗

Mathematical foundation of quantum annealing

Quantum annealing is a generic name of quantum algorithms that use quantum-mechanical fluctuations to search for the solution of an optimization problem. It shares the basic idea with quantum adiabatic evolution studied actively in quantum computation. The present paper reviews the mathematical and theoretical foundations of quantum annealing. In particular, theorems are presented for convergence conditions of quantum annealing to the target optimal state after an infinite-time evolution following the Schroedinger or stochastic (Monte Carlo) dynamics. It is proved that the same asymptotic behavior of the control parameter guarantees convergence for both the Schroedinger dynamics and the stochastic dynamics in spite of the essential difference of these two types of dynamics. Also described are the prescriptions to reduce errors in the final approximate solution obtained after a long but finite dynamical evolution of quantum annealing. It is shown there that we can reduce errors significantly by an ingenious choice of annealing schedule (time dependence of the control parameter) without compromising computational complexity qualitatively. A review is given on the derivation of the convergence condition for classical simulated annealing from the view point of quantum adiabaticity using a classical-quantum mapping.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimal Parameter for the Training of Multilayer Perceptron Neural Networks by Using Hierarchical Genetic Algorithm

This paper deals with the controversial topic of the selection of the parameters of a genetic algorithm, in this case hierarchical, used for training of multilayer perceptron neural networks for the binary classification. The parameters to select are the crossover and mutation probabilities of the control and parametric genes and the permanency percent. The results can be considered as a guide for using this kind of algorithm.

97 MATHEMATICS AND COMPUTING↗

Entangled Coherent States Generation in two Superconducting LC Circuits

We proposed a novel pure electronic (solid state) device consisting of two superconducting LC circuits coupled to a superconducting flux qubit. The entangled coherent states of the two LC modes is generated through the measurement of the flux qubit states. The interaction of the flux qubit and two LC circuits is controlled by the external microwave control lines. The geometrical structure of the LC circuits is adjustable and makes a strong coupling between them achievable. This entangled coherent state generator can be realized by using the conventional microelectronic fabrication techniques which increases the feasibility of the experiment.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Novel Approach to Anharmonicity for a Wealth of Applications in Nonlinear Science Technologies

We present a new theory of the anharmonicity of nonlinear oscillations that are exhibited by many physical systems. New physical quantities are introduced that describe the departure from linear or harmonic behavior and as far as extremely anharmonic situations. In order to solve the nonlinear phase equation, the key notion of our theory, which controls the anharmonic behavior, a new and fascinating nonlinear trigonometry is designed. These results provide a general and accurate yet compact description of such signals, by far better than the Fourier description, both quantitatively and qualitatively and will benefit many application fields.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗