Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Approximate dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A parallel trajectory optimization tool for aerospace plane guidance

A parallel trajectory optimization algorithm is being developed. One possible mission is to provide real-time, on-line guidance for the National Aerospace Plane. The algorithm solves a discrete-time problem via the augmented Lagrangian nonlinear programming algorithm. The algorithm exploits the dynamic programming structure of the problem to achieve parallelism in calculating cost functions, gradients, constraints, Jacobians, Hessian approximations, search directions, and merit functions. Special additions to the augmented Lagrangian algorithm achieve robust convergence, achieve (almost) superlinear local convergence, and deal with constraint curvature efficiency. The algorithm can handle control and state inequality constraints such as angle-of-attack and dynamic pressure constraints. Portions of the algorithm have been tested. The nonlinear programming core algorithm performs well on a variety of static test problems and on an orbit transfer problem. The parallel search direction algorithm can reduce wall clock time by a factor of 10 for this part of the computation task.

Psiaki, Mark L.↗

A computational algorithm for spacecraft control and momentum management

Developments in the area of nonlinear control theory have shown how coordinate changes in the state and input spaces of a dynamical system can be used to transform certain nonlinear differential equations into equivalent linear equations. These techniques are applied to the control of a spacecraft equipped with momentum exchange devices. An optimal control problem is formulated that incorporates a nonlinear spacecraft model. An algorithm is developed for solving the optimization problem using feedback linearization to transform to an equivalent problem involving a linear dynamical constraint and a functional approximation technique to solve for the linear dynamics in terms of the control. The original problem is transformed into an unconstrained nonlinear quadratic program that yields an approximate solution to the original problem. Two examples are presented to illustrate the results.

Dzielski, John↗

Path Planning: Differential Dynamic Programming and Model Predictive Path Integral Control on VTOL Aircraft

This paper explores two optimal control approaches, widely used in robotics, to establish their viability as real-time trajectory planners for vehicle configurations envisioned for the emerging aviation sector of Urban Air Mobility (UAM). Differential Dynamic Programming (DDP) enables planning over highly nonlinear dynamics using second-order approximations along a nominal trajectory, and displays quadratic convergence to a local solution. Model Predictive Path Integral (MPPI) is a stochastic sampling-based algorithm that can optimize for general cost criteria, including potentially highly nonlinear formulations, and supports parallel computation through the use of modern GPU hardware. In this work, DDP and MPPI were implemented using model predictive control (MPC), and the results indicate they are able to successfully transition the aircraft over different flight envelopes and generate trajectories unique to UAM vehicles.

Differential Dynamic Programming↗

Computational alternatives to obtain time optimal jet engine control

Two computational methods to determine an open loop time optimal control sequence for a simple single spool turbojet engine are described by a set of nonlinear differential equations. Both methods are modifications of widely accepted algorithms which can solve fixed time unconstrained optimal control problems with a free right end. Constrained problems to be considered have fixed right ends and free time. Dynamic programming is defined on a standard problem and it yields a successive approximation solution to the time optimal problem of interest. A feedback control law is obtained and it is then used to determine the corresponding open loop control sequence. The Fletcher-Reeves conjugate gradient method has been selected for adaptation to solve a nonlinear optimal control problem with state variable and control constraints.

Basso, R. J.↗

Testing of DLR C/C-SiC for HIFiRE 8 Scramjet Combustor

Ceramic Matrix Composites (CMCs) have been proposed for hot structures in scramjet combustors. Previous studies have calculated significant weight savings by utilizing CMCs (active and passive) versus actively cooled metallic scramjet structures. Both a C/C and a C/C-SiC material system fabricated by DLR (Stuttgart, Germany) are being considered for use in a passively cooled combustor design for HIFiRE 8, a joint Australia / AFRL hypersonic flight program, expected to fly at Mach 7 for approximately 30 sec, at a dynamic pressure of 55 kPa. Flat panels of the DLR C/C and the C/C-SiC were tested in the NASA Langley Direct Connect Rig (DCR) at Mach 5 and Mach 6 enthalpy for several minutes. Gaseous hydrogen fuel was used to fuel the scramjet combustor. The test panels were instrumented with embedded Type K and Type S thermocouples. Zirconia felt insulation was used in some of the tests to increase the surface temperature of the C/C-SiC panel for approximately 350degF. The final C/C-SiC panel was tested for 3 cycles totaling over 135 sec at Mach 6 enthalpy. Slightly more erosion was observed on the C/C panel than the C/C-SiC panels, but both material systems demonstrated acceptable recession performance for the HIFiRE 8 flight.

Glass, David E.↗

Testing of DLR C/C-SiC and C/C for HIFiRE 8 Scramjet Combustor

Ceramic Matrix Composites (CMCs) have been proposed for use as lightweight hot structures in scramjet combustors. Previous studies have calculated significant weight savings by utilizing CMCs (active and passive) versus actively cooled metallic scramjet structures. Both a carbon/carbon (C/C) and a carbon/carbon-silicon carbide (C/C-SiC) material fabricated by DLR (Stuttgart, Germany) are being considered for use in a passively cooled combustor design for Hypersonic International Flight Research Experimentation (HIFiRE) 8, a joint Australia / Air Force Research Laboratory hypersonic flight program, expected to fly at Mach 7 for approximately 30 sec, at a dynamic pressure of 55 kilopascals. Flat panels of the DLR C/C and C/C-SiC materials were installed downstream of a hydrogen-fueled, dual-mode scramjet combustor and tested for several minutes at conditions simulating flight at Mach 5 and Mach 6. Gaseous hydrogen fuel was used to fuel the scramjet combustor. The test panels were instrumented with embedded Type K and Type S thermocouples. Zirconia felt insulation was used during some of the tests to reduce heat loss from the back surface and thus increase the heated surface temperature of the C/C-SiC panel approximately 177 C (350 F). The final C/C-SiC panel was tested for three cycles totaling over 135 sec at Mach 6 enthalpy. Slightly more erosion was observed on the C/C panel than the C/C-SiC panels, but both material systems demonstrated acceptable recession performance for the HIFiRE 8 flight.

Glass, David E.↗

A self-learning rule base for command following in dynamical systems

In this paper, a self-learning Rule Base for command following in dynamical systems is presented. The learning is accomplished though reinforcement learning using an associative memory called SAM. The main advantage of SAM is that it is a function approximator with explicit storage of training samples. A learning algorithm patterned after the dynamic programming is proposed. Two artificially created, unstable dynamical systems are used for testing, and the Rule Base was used to generate a feedback control to improve the command following ability of the otherwise uncontrolled systems. The numerical results are very encouraging. The controlled systems exhibit a more stable behavior and a better capability to follow reference commands. The rules resulting from the reinforcement learning are explicitly stored and they can be modified or augmented by human experts. Due to overlapping storage scheme of SAM, the stored rules are similar to fuzzy rules.

Tsai, Wei K.↗

Documentation and archiving of the Space Shuttle wind tunnel test data base. Volume 1: Background and description

Development of the space shuttle necessitated an extensive wind tunnel test program, with the cooperation of all the major wind tunnels in the United States. The result was approximately 100,000 hours of space shuttle wind tunnel testing conducted for aerodynamics, heat transfer, and structural dynamics. The test results were converted into Chrysler DATAMAN computer program format to facilitate use by analysts, a very cost effective method of collecting the wind tunnel test results from many test facilities into one centralized location. This report provides final documentation of the space shuttle wind tunnel program. The two-volume set covers evolution of space shuttle aerodynamic configurations and gives wind tunnel test data, titles of wind tunnel data reports, sample data sets, and instructions for accessing the digital data base.

Romere, Paul O.↗

Documentation and archiving of the Space Shuttle wind tunnel test data base. Volume 2: User's Guide to the Archived Data Base

Development of the Space Shuttle necessitated an extensive wind tunnel test program, with the cooperation of all the major wind tunnels in the United States. The result was approximately 100,000 hours of Space Shuttle wind tunnel testing conducted for aerodynamics, heat transfer, and structural dynamics. The test results were converted into Chrysler DATAMAN computer program format to facilitate use by analysts, a very cost effective method of collecting the wind tunnel test results from many test facilities into one centralized location. This report provides final documentation of the Space Shuttle wind tunnel program. The two-volume set covers the evolution of Space Shuttle aerodynamic configurations and gives wind tunnel test data, titles of wind tunnel data reports, sample data sets, and instructions for accessing the digital data base.

Romere, Paul O.↗

An experiment-based comparative study of fuzzy logic control

An approach is presented to the control of a dynamic physical system through the use of approximate reasoning. The approach has been implemented in a program named POLE, and the authors have successfully built a prototype hardware system to solve the cartpole balancing problem in real-time. The approach provides a complementary alternative to the conventional analytical control methodology and is of substantial use when a precise mathematical model of the process being controlled is not available. A set of criteria for comparing controllers based on approximate reasoning and those based on conventional control schemes is furnished.

Berenji, Hamid R.↗

Formulation and validation of high-order linearized models of helicopter flight mechanics

A high-order linearized model of helicopter flight dynamics is extracted from a nonlinear time domain simulation. The model has 29 states that describe the fuselage rigid body degrees of freedom, the flap and lag dynamics in a nonrotating coordinate system, the inflow dynamics, the delayed entry of the horizontal tail into the main rotor wake, and, approximately, the blade torsion dynamics. The nonlinear simulation is obtained by extensively modifying the GENHEL computer program. The results indicate that the agreement between the linearized and the nonlinear model is good for small perturbations, and deteriorates for large amplitude maneuvers.

Kim, Frederick D.↗

A comparative analysis of static and dynamic load balancing strategies

The problem of uniformly distributing the load of a parallel program over a multiprocessor system was considered. A program was analyzed whose structure permits the computation of the optimal static solution. Then four strategies for load balancing were described and their performance compared. The strategies are: (1) the optimal static assignment algorithm which is guaranteed to yield the best static solution, (2) the static binary dissection method which is very fast but suboptimal, (3) the greedy algorithm, a static fully polynomial time approximation scheme, which estimates the optimal solution to arbitrary accuracy, and (4) the predictive dynamic load balancing heuristic which uses information on the precedence relationships within the program and outperforms any of the static methods. It is also shown that the overhead incurred by the dynamic heuristic is reduced considerably if it is started off with a static assignment provided by either of the three strategies.

Iqbal, M. Ashraf↗

Performance tradeoffs in static and dynamic load balancing strategies

The problem of uniformly distributing the load of a parallel program over a multiprocessor system was considered. A program was analyzed whose structure permits the computation of the optimal static solution. Then four strategies for load balancing were described and their performance compared. The strategies are: (1) the optimal static assignment algorithm which is guaranteed to yield the best static solution, (2) the static binary dissection method which is very fast but sub-optimal, (3) the greedy algorithm, a static fully polynomial time approximation scheme, which estimates the optimal solution to arbitrary accuracy, and (4) the predictive dynamic load balancing heuristic which uses information on the precedence relationships within the program and outperforms any of the static methods. It is also shown that the overhead incurred by the dynamic heuristic is reduced considerably if it is started off with a static assignment provided by either of the other three strategies.

Iqbal, M. A.↗

Approximate optimal guidance for the advanced launch system

A real-time guidance scheme for the problem of maximizing the payload into orbit subject to the equations of motion for a rocket over a spherical, non-rotating earth is presented. An approximate optimal launch guidance law is developed based upon an asymptotic expansion of the Hamilton - Jacobi - Bellman or dynamic programming equation. The expansion is performed in terms of a small parameter, which is used to separate the dynamics of the problem into primary and perturbation dynamics. For the zeroth-order problem the small parameter is set to zero and a closed-form solution to the zeroth-order expansion term of Hamilton - Jacobi - Bellman equation is obtained. Higher-order terms of the expansion include the effects of the neglected perturbation dynamics. These higher-order terms are determined from the solution of first-order linear partial differential equations requiring only the evaluation of quadratures. This technique is preferred as a real-time, on-line guidance scheme to alternative numerical iterative optimization schemes because of the unreliable convergence properties of these iterative guidance schemes and because the quadratures needed for the approximate optimal guidance law can be performed rapidly and by parallel processing. Even if the approximate solution is not nearly optimal, when using this technique the zeroth-order solution always provides a path which satisfies the terminal constraints. Results for two-degree-of-freedom simulations are presented for the simplified problem of flight in the equatorial plane and compared to the guidance scheme generated by the shooting method which is an iterative second-order technique.

Feeley, T. S.↗

Dynamics analysis of electrodynamic satellite tethers. Equations of motion and numerical solution algorithms for the tether

The equations of motion are developed for a perfectly flexible, inelastic tether with a satellite at its extremity. The tether is attached to a space vehicle in orbit. The tether is allowed to possess electrical conductivity. A numerical solution algorithm to provide the motion of the tether and satellite system is presented. The resulting differential equations can be solved by various existing standard numerical integration computer programs. The resulting differential equations allow the introduction of approximations that can lead to analytical, approximate general solutions. The differential equations allow more dynamical insight of the motion.

Nacozy, P. E.↗

Wind turbine generator interaction with conventional diesel generators on Block Island, Rhode Island. Volume 2: Data analysis

Assessing the performance of a MOD-OA horizontal axis wind turbine connected to an isolated diesel utility, a comprehensive data measurement program was conducted on the Block Island Power Company installation on Block Island, Rhode Island. The detailed results of that program focusing on three principal areas of (1) fuel displacement (savings), (2) dynamic interaction between the diesel utility and the wind turbine, (3) effects of three models of wind turbine reactive power control are presented. The approximate two month duration of the data acquisition program conducted in the winter months (February into April 1982) revealed performance during periods of highest wind energy penetration and hence severity of operation. Even under such conditions fuel savings were significant resulting in a fuel reduction of 6.7% while the MOD-OA was generating 10.7% of the total electrical energy. Also, electrical disturbance and interactive effects were of an acceptable level.

Wilreker, V. F.↗

General Rotorcraft Aeromechanical Stability Program (GRASP): Theory manual

The general rotorcraft aeromechanical stability program (GRASP) was developed to calculate aeroelastic stability for rotorcraft in hovering flight, vertical flight, and ground contact conditions. GRASP is described in terms of its capabilities and its philosophy of modeling. The equations of motion that govern the physical system are described, as well as the analytical approximations used to derive them. The equations include the kinematical equation, the element equations, and the constraint equations. In addition, the solution procedures used by GRASP are described. GRASP is capable of treating the nonlinear static and linearized dynamic behavior of structures represented by arbitrary collections of rigid-body and beam elements. These elements may be connected in an arbitrary fashion, and are permitted to have large relative motions. The main limitation of this analysis is that periodic coefficient effects are not treated, restricting rotorcraft flight conditions to hover, axial flight, and ground contact. Instead of following the methods employed in other rotorcraft programs. GRASP is designed to be a hybrid of the finite-element method and the multibody methods used in spacecraft analysis. GRASP differs from traditional finite-element programs by allowing multiple levels of substructure in which the substructures can move and/or rotate relative to others with no small-angle approximations. This capability facilitates the modeling of rotorcraft structures, including the rotating/nonrotating interface and the details of the blade/root kinematics for various types. GRASP differs from traditional multibody programs by considering aeroelastic effects, including inflow dynamics (simple unsteady aerodynamics) and nonlinear aerodynamic coefficients.

Hodges, Dewey H.↗