Stochastic stability and the design of feedback controls
Stochastic stability and design of feedback controls - application of Liapunov method to optimal control problems
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Stochastic stability and design of feedback controls - application of Liapunov method to optimal control problems
Computational scheme for optimal control problem based on convex programming method
The paper presents the specific approach taken to formulate the problem in terms of gene encoding, fitness function, and genetic operations. The genome is encoded such that a subset of the scheduling constraints is automatically satisfied. Several fitness functions are formulated to emphasize different aspects of the scheduling problem. The optimal solutions of the different fitness functions demonstrate the trade-off of the scheduling problem and provide insight into a conflict resolution process.
In this work, a new optimized MacCormack-type scheme, which is 4th order accurate in time and space, is applied to Problems 1 and 2 of Category 1. The performance of this new scheme is compared to that of the 2-4 MacCormack scheme, and results for Problems 1 and 2 of Category 1 are presented and compared to the exact solutions.
Solutions of the optimal boost problem for the MSC April 1970 base line shuttle vehicle show significant payload increases may be achieved by flying optimal pitch profiles. Results consistent with aerodynamic and acceleration constraints indicate payload gains of approximately 2.0 per cent of the total injected weight may be achieved. This corresponds to a real payload increase of about 20 per cent. Trajectory parameters for optimal launches under various conditions and a standard gravity turn launch are presented along with a brief discussion of the problem modeling and assumptions. The data are used to support a number of observations and conclusions and to provide some insight into the methods by which payload gains are achieved.
New control synthesis procedures for digital flight control systems were developed. The theoretical developments are the solution to the problem of optimal disturbance suppression in the presence of windshear. Control synthesis is accomplished using a linear quadratic cost function, the command generator tracker for trajectory following and the proportional-integral-filter control structure for practical implementation. Extensions are made to the optimal output feedback algorithm for computing feedback gains so that the multirate and optimal disturbance control designs are computed and compared for the advanced transport operating system (ATOPS). The performance of the designs is demonstrated by closed-loop poles, frequency domain multiinput sigma and eigenvalue plots and detailed nonlinear 6-DOF aircraft simulations in the terminal area in the presence of windshear.
This paper presents finite-dimensional approximations for linear retarded functional differential equations by use of discontinuous piecewise linear functions. The approximation scheme is applied to optimal control problems, when a quadratic cost integral must be minimized subject to the controlled retarded system. It is shown that the approximate optimal feedback operators converge to the true ones both in the case where the cost integral ranges over a finite time interval, as well as in the case where it ranges over an infinite time interval. The arguments in the last case rely on the fact that the piecewise linear approximations to stable systems are stable in a uniform sense.
We address the problem of navigating a set (fleet) of aircraft in an aerial route network so as to bring each aircraft to its destination at a specified time and with minimal distance separation assured between all aircraft at all times. The speed range, initial position, required destination, and required time of arrival at destination for each aircraft are assumed provided. Each aircraft's movement is governed by a controlled differential equation (state equation). The problem consists in choosing for each aircraft a path in the route network and a control strategy so as to meet the constraints and reach the destination at the required time. The main contribution of the paper is a model that allows to recast this problem as a decoupled collection of problems in classical optimal control and is easily generalized to the case when inertia cannot be neglected. Some qualitative insight into solution behavior is obtained using the Pontryagin Maximum Principle. Sample numerical solutions are computed using a numerical optimal control solver. The proposed model is first step toward increasing the fidelity of continuous time control models of air traffic in a terminal airspace. The Pontryagin Maximum Principle implies the polygonal shape of those portions of the state trajectories away from those states in which one or more aircraft pair are at minimal separation. The model also confirms the intuition that, the narrower the allowed speed ranges of the aircraft, the smaller the space of optimal solutions, and that an instance of the optimal control problem may not have a solution at all (i.e., no control strategy that meets the separation requirement and other constraints).
Minimum energy-loss guidance for the aero-assisted plane change of an orbiting vehicle is developed and applied to the plane change of a circular orbit. First, trajectories which minimize the fuel required to change the orbital plane are computed for a realistic vehicle. From these trajectories, it is observed that the fuel weight is minimized if the velocity at exit from the atmosphere is maximized. Next, for the atmospheric turn, approximate optimal controls (angle of attack and bank angle) which maximize the exit velocity are derived. Finally, the minimum-fuel problem is resolved using optimal guidance for the atmospheric part of the trajectory, and the optimization problem reduces to a one-dimensional parameter minimization. Successful plane changes up to 40 deg are demonstrated. Optimal guidance requires up to 14 percent more fuel than the 'true' optimum but only 50 percent of the fuel required by the single-impulse maneuver. Finally, the guidance law developed here is implementable because only algebraic manipulations are required.
QSPIN is a high level Java language API for experimentation in QC models used in the calculation of Ising spin glass ground states and related quadratic unconstrained binary optimization (QUBO) problems. The Java API is intended to facilitate research in advanced QC algorithms such as hybrid quantum-classical solvers, automatic selection of constraint and optimization parameters, and techniques for the correction and mitigation of model and solution errors. QSPIN includes high level solver objects tailored to the D-Wave quantum annealing architecture that implement hybrid quantum-classical algorithms [Booth et al.] for solving large problems on small quantum devices, elimination of variables via roof duality, and classical computing optimization methods such as GPU accelerated simulated annealing and tabu search for comparison. A test suite of documented NP-complete applications ranging from graph coloring, covering, and partitioning to integer programming and scheduling are provided to demonstrate current capabilities.
Consideration of stochastic optimal control problems in which the measurement equation contains a control variable. Conditions under which it is possible to separately optimize the dynamic and measurement controls are studied, with particular emphasis on showing (by counterexample) that certain results already available for the linear-Gaussian-quadratic case do not extend to more general problems. Conditions under which the extension is possible are discussed.
The problem of determining the optimum guidance policy for an interplanetary spacecraft is treated as a stochastic optimal control problem. An algorithm for computing the optimum velocity correction and the optimum execution time (with allowance for correction-dependent errors) is derived in the case of a single midcourse correction. The performance index was chosen to be an upper bound for the probability that the mission fails, and it is defined as a function of the maximum allowable velocity correction and the maximum allowable deviation of the terminal state. Numerical results obtained for a Jupiter fly-by mission indicate that the execution errors have a significant influence on the performance index, but an acceptably small upper bound on the probability of mission failure can be obtained for sufficiently small execution errors.
This paper describes an efficient numerical approach for the design and optimization of aerodynamic bodies. As in classical optimal control methods, the present approach introduces a cost function and a costate variable (Lagrange multiplier) in order to achieve a minimum. High efficiency is achieved by using a multigrid technique to solve for all the unknowns simultaneously, but restricting work on a design variable only to grids on which their changes produce nonsmooth perturbations. Thus, the effort required to evaluate design variables that have nonlocal effects on the solution is confined to the coarse grids. However, if a variable has a nonsmooth local effect on the solution in some neighborhood, it is relaxed in that neighborhood on finer grids. The cost of solving the optimal control problem is shown to be approximately two to three times the cost of the equivalent analysis problem. Examples are presented to illustrate the application of the method to aerodynamic design and constraint optimization.
Distributed electric propulsion powered electric vertical takeoff and landing aircraft are expected to enable urban air mobility. Low specific energy of onboard lithium-ion polymer batteries and wind conditions impose constraints on flight endurance. Therefore, from the safety and efficiency perspective, planning and flying minimum energy trajectories are important.The primary motivation for this paper is to determine if there is an operational benefit to flying wind-optimal trajectories for short flights (less than 60 miles) in the urban environment. This study employs wind-optimal trajectories for a NASA-proposed conceptual multirotor aircraft flight in the urban environment. The optimal control model presented includes a wind model for quantifying the effect of wind on the trajectory. The optimal control problem is numerically solved using the direct method. Energy consumption and flight duration flying wind-optimal trajectories between origins and destinations in a metropolitan area are compared with energy consumption and flight duration flying on the great-circle paths between the same origin and destination pairs to determine the operational benefit of wind-optimal routing for short flights.The flight duration results for different scenarios are validated using a simulation tool designed and developed by NASA for exploring advanced air traffic management concepts. In summary,this research study suggests that for short flights in an urban environment, the wind-optimal trajectories have a very slight (insignificant) operational advantage over the great-circle trajectories in terms of energy consumption and flight duration. As expected, headwinds and tailwinds along the route of flight have a significant impact on energy consumption and flight duration.
The problem of designing optimal inputs in the identification of multi-input multi-output linear systems with unknown time-varying parameters is considered using a Bayesian approach. A sensitivity index gives a measure of performance for the closed-loop system inputs. The computation of the optimal closed-loop mappings is shown to be a nontrivial exercise in stochastic control with no analytic solution, but optimal open-loop and affine laws yield much more tractable problems. For time-invariant systems, the sensitivity index considered is shown to be equivalent to the trace of the (strictly positive definite) information matrix associated with the system. Numerical examples are given. A Kalman filter is used to estimate the parameters. A necessary condition for the Kalman filter not to diverge when applying linear feedback is also given.
The primary motivation for this paper is to quantify the operational benefits (energy consumption and flight duration) of flying wind-optimal lateral trajectories for short flights (less than 60 miles) anticipated in the urban environment. The optimal control model presented includes a wind model for quantifying the effect of wind on the lateral trajectory. The optimal control problem is numerically solved using the direct collocation method. Energy consumption and flight duration flying wind-optimal lateral trajectories are compared with corresponding values obtained flying great-circle paths between the same origin and destination pairs to determine the operational benefits of wind-optimal routing for short flights. The flight duration results for different scenarios are validated using a simulation tool designed and developed at NASA for exploring advanced air traffic management concepts. This research study suggests that for short flights in an urban environment, operational benefits of the wind-optimal lateral trajectories over the corresponding great-circle trajectories in terms of energy consumption and flight duration per flight are dependent on: i) wind field’s spatial variability, ii) wind magnitude, iii) the direction of route relative to the wind field, and iv) cruise segment length. The operational benefits observed in realistic flyable wind scenarios are less than 2.5%; these could be translated to an equivalent of a maximum of 2 min of cruise flight duration savings in the urban air mobility environment. As expected, headwinds and tailwinds along the flight route most significantly impact energy consumption and flight duration.
A gradient-based shape optimization based on quasi-analytical sensitivities has been extended for practical three-dimensional aerodynamic applications. The flow analysis has been rendered by a fully implicit, finite-volume formulation of the Euler and Thin-Layer Navier-Stokes (TLNS) equations. Initially, the viscous laminar flow analysis for a wing has been compared with an independent computational fluid dynamics (CFD) code which has been extensively validated. The new procedure has been demonstrated in the design of a cranked arrow wing at Mach 2.4 with coarse- and fine-grid based computations performed with Euler and TLNS equations. The influence of the initial constraints on the geometry and aerodynamics of the optimized shape has been explored. Various final shapes generated for an identical initial problem formulation but with different optimization path options (coarse or fine grid, Euler or TLNS), have been aerodynamically evaluated via a common fine-grid TLNS-based analysis. The initial constraint conditions show significant bearing on the optimization results. Also, the results demonstrate that to produce an aerodynamically efficient design, it is imperative to include the viscous physics in the optimization procedure with the proper resolution. Based upon the present results, to better utilize the scarce computational resources, it is recommended that, a number of viscous coarse grid cases using either a preconditioned bi-conjugate gradient (PbCG) or an alternating-direction-implicit (ADI) method, should initially be employed to improve the optimization problem definition, the design space and initial shape. Optimized shapes should subsequently be analyzed using a high fidelity (viscous with fine-grid resolution) flow analysis to evaluate their true performance potential. Finally, a viscous fine-grid-based shape optimization should be conducted, using an ADI method, to accurately obtain the final optimized shape.
The fuel-optimal control problem in aeroassisted noncoplanar orbital transfer is addressed. The equations of motion for the atmospheric maneuver are nonlinear and the optimal (nominal) trajectory and control are obtained. In order to follow the nominal trajectory under actual conditions, a neighboring optimum guidance scheme is designed using linear quadratic regulator theory for onboard real-time implementation. One of the state variables is used as the independent variable in preference to the time. The weighting matrices in the performance index are chosen by a combination of a heuristic method and an optimal modal approach. The necessary feedback control law is obtained in order to minimize the deviations from the nominal conditions. The results are presented to a typical aeroassisted noncoplanar orbital transfer problem.