Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Approximate dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

Robot path planning with distance-safety criterion

A method for determining an optimal path with a weighted distance-safety criterion is developed. The goal is to strike a compromise between the shortest path and the centerline path, which is safer. The method is composed of three parts: (i) construction of a region map by dividing the workspace, (ii) interregion optimization to determine the entry and departure points of the path in each region, and (iii) intraregion optimization for determining the (optimal) path segment within each region. The region map is generated by using an approximate Voronoi diagram, and region optimization is achieved using variational dynamic programming. Although developed for 2-D problems, the method can be easily extended to a class of 3-D problems. Numerical examples are presented to demonstrate the method.

Suh, Suk-Hwan↗
NASA NTRS1991

A parallel trajectory optimization tool for aerospace plane guidance

A parallel trajectory optimization algorithm is being developed. One possible mission is to provide real-time, on-line guidance for the National Aerospace Plane. The algorithm solves a discrete-time problem via the augmented Lagrangian nonlinear programming algorithm. The algorithm exploits the dynamic programming structure of the problem to achieve parallelism in calculating cost functions, gradients, constraints, Jacobians, Hessian approximations, search directions, and merit functions. Special additions to the augmented Lagrangian algorithm achieve robust convergence, achieve (almost) superlinear local convergence, and deal with constraint curvature efficiency. The algorithm can handle control and state inequality constraints such as angle-of-attack and dynamic pressure constraints. Portions of the algorithm have been tested. The nonlinear programming core algorithm performs well on a variety of static test problems and on an orbit transfer problem. The parallel search direction algorithm can reduce wall clock time by a factor of 10 for this part of the computation task.

Psiaki, Mark L.↗
NASA NTRS1990

A computational algorithm for spacecraft control and momentum management

Developments in the area of nonlinear control theory have shown how coordinate changes in the state and input spaces of a dynamical system can be used to transform certain nonlinear differential equations into equivalent linear equations. These techniques are applied to the control of a spacecraft equipped with momentum exchange devices. An optimal control problem is formulated that incorporates a nonlinear spacecraft model. An algorithm is developed for solving the optimization problem using feedback linearization to transform to an equivalent problem involving a linear dynamical constraint and a functional approximation technique to solve for the linear dynamics in terms of the control. The original problem is transformed into an unconstrained nonlinear quadratic program that yields an approximate solution to the original problem. Two examples are presented to illustrate the results.

Dzielski, John↗
NASA NTRSDate not supplied

Path Planning: Differential Dynamic Programming and Model Predictive Path Integral Control on VTOL Aircraft

This paper explores two optimal control approaches, widely used in robotics, to establish their viability as real-time trajectory planners for vehicle configurations envisioned for the emerging aviation sector of Urban Air Mobility (UAM). Differential Dynamic Programming (DDP) enables planning over highly nonlinear dynamics using second-order approximations along a nominal trajectory, and displays quadratic convergence to a local solution. Model Predictive Path Integral (MPPI) is a stochastic sampling-based algorithm that can optimize for general cost criteria, including potentially highly nonlinear formulations, and supports parallel computation through the use of modern GPU hardware. In this work, DDP and MPPI were implemented using model predictive control (MPC), and the results indicate they are able to successfully transition the aircraft over different flight envelopes and generate trajectories unique to UAM vehicles.

Differential Dynamic Programming↗
NASA NTRS1976

Computational alternatives to obtain time optimal jet engine control

Two computational methods to determine an open loop time optimal control sequence for a simple single spool turbojet engine are described by a set of nonlinear differential equations. Both methods are modifications of widely accepted algorithms which can solve fixed time unconstrained optimal control problems with a free right end. Constrained problems to be considered have fixed right ends and free time. Dynamic programming is defined on a standard problem and it yields a successive approximation solution to the time optimal problem of interest. A feedback control law is obtained and it is then used to determine the corresponding open loop control sequence. The Fletcher-Reeves conjugate gradient method has been selected for adaptation to solve a nonlinear optimal control problem with state variable and control constraints.

Basso, R. J.↗
NASA NTRS2013

Testing of DLR C/C-SiC for HIFiRE 8 Scramjet Combustor

Ceramic Matrix Composites (CMCs) have been proposed for hot structures in scramjet combustors. Previous studies have calculated significant weight savings by utilizing CMCs (active and passive) versus actively cooled metallic scramjet structures. Both a C/C and a C/C-SiC material system fabricated by DLR (Stuttgart, Germany) are being considered for use in a passively cooled combustor design for HIFiRE 8, a joint Australia / AFRL hypersonic flight program, expected to fly at Mach 7 for approximately 30 sec, at a dynamic pressure of 55 kPa. Flat panels of the DLR C/C and the C/C-SiC were tested in the NASA Langley Direct Connect Rig (DCR) at Mach 5 and Mach 6 enthalpy for several minutes. Gaseous hydrogen fuel was used to fuel the scramjet combustor. The test panels were instrumented with embedded Type K and Type S thermocouples. Zirconia felt insulation was used in some of the tests to increase the surface temperature of the C/C-SiC panel for approximately 350degF. The final C/C-SiC panel was tested for 3 cycles totaling over 135 sec at Mach 6 enthalpy. Slightly more erosion was observed on the C/C panel than the C/C-SiC panels, but both material systems demonstrated acceptable recession performance for the HIFiRE 8 flight.

Glass, David E.↗
NASA NTRS2014

Testing of DLR C/C-SiC and C/C for HIFiRE 8 Scramjet Combustor

Ceramic Matrix Composites (CMCs) have been proposed for use as lightweight hot structures in scramjet combustors. Previous studies have calculated significant weight savings by utilizing CMCs (active and passive) versus actively cooled metallic scramjet structures. Both a carbon/carbon (C/C) and a carbon/carbon-silicon carbide (C/C-SiC) material fabricated by DLR (Stuttgart, Germany) are being considered for use in a passively cooled combustor design for Hypersonic International Flight Research Experimentation (HIFiRE) 8, a joint Australia / Air Force Research Laboratory hypersonic flight program, expected to fly at Mach 7 for approximately 30 sec, at a dynamic pressure of 55 kilopascals. Flat panels of the DLR C/C and C/C-SiC materials were installed downstream of a hydrogen-fueled, dual-mode scramjet combustor and tested for several minutes at conditions simulating flight at Mach 5 and Mach 6. Gaseous hydrogen fuel was used to fuel the scramjet combustor. The test panels were instrumented with embedded Type K and Type S thermocouples. Zirconia felt insulation was used during some of the tests to reduce heat loss from the back surface and thus increase the heated surface temperature of the C/C-SiC panel approximately 177 C (350 F). The final C/C-SiC panel was tested for three cycles totaling over 135 sec at Mach 6 enthalpy. Slightly more erosion was observed on the C/C panel than the C/C-SiC panels, but both material systems demonstrated acceptable recession performance for the HIFiRE 8 flight.

Glass, David E.↗
NASA NTRS1992

A self-learning rule base for command following in dynamical systems

In this paper, a self-learning Rule Base for command following in dynamical systems is presented. The learning is accomplished though reinforcement learning using an associative memory called SAM. The main advantage of SAM is that it is a function approximator with explicit storage of training samples. A learning algorithm patterned after the dynamic programming is proposed. Two artificially created, unstable dynamical systems are used for testing, and the Rule Base was used to generate a feedback control to improve the command following ability of the otherwise uncontrolled systems. The numerical results are very encouraging. The controlled systems exhibit a more stable behavior and a better capability to follow reference commands. The rules resulting from the reinforcement learning are explicitly stored and they can be modified or augmented by human experts. Due to overlapping storage scheme of SAM, the stored rules are similar to fuzzy rules.

Tsai, Wei K.↗
NASA NTRS1995

Documentation and archiving of the Space Shuttle wind tunnel test data base. Volume 1: Background and description

Development of the space shuttle necessitated an extensive wind tunnel test program, with the cooperation of all the major wind tunnels in the United States. The result was approximately 100,000 hours of space shuttle wind tunnel testing conducted for aerodynamics, heat transfer, and structural dynamics. The test results were converted into Chrysler DATAMAN computer program format to facilitate use by analysts, a very cost effective method of collecting the wind tunnel test results from many test facilities into one centralized location. This report provides final documentation of the space shuttle wind tunnel program. The two-volume set covers evolution of space shuttle aerodynamic configurations and gives wind tunnel test data, titles of wind tunnel data reports, sample data sets, and instructions for accessing the digital data base.

Romere, Paul O.↗
NASA NTRS1995

Documentation and archiving of the Space Shuttle wind tunnel test data base. Volume 2: User's Guide to the Archived Data Base

Development of the Space Shuttle necessitated an extensive wind tunnel test program, with the cooperation of all the major wind tunnels in the United States. The result was approximately 100,000 hours of Space Shuttle wind tunnel testing conducted for aerodynamics, heat transfer, and structural dynamics. The test results were converted into Chrysler DATAMAN computer program format to facilitate use by analysts, a very cost effective method of collecting the wind tunnel test results from many test facilities into one centralized location. This report provides final documentation of the Space Shuttle wind tunnel program. The two-volume set covers the evolution of Space Shuttle aerodynamic configurations and gives wind tunnel test data, titles of wind tunnel data reports, sample data sets, and instructions for accessing the digital data base.

Romere, Paul O.↗
DOE OSTI2024

Evaluation of Thermal Scattering Law for U 3 Si 2 Using Temperature-Dependent Phonon Density of States

The thermal scattering law for uranium silicide, a candidate material for high-density nuclear fuel, was evaluated from the temperature-dependent phonon density of states obtained using the quasi-harmonic approximation. For uranium silicide model systems of various volumes near the equilibrium volume, Hellmann-Feynman forces were calculated by performing ab initio lattice dynamics simulations based on density functional theory. Subsequently, the quasi-harmonic approximation was applied by interpolating the results of the harmonic approximation for each volume system. As a sensitivity test, the phonon density of states was calculated for the structures with temperature-dependent volumes at 298 K and 1000 K, obtained by the quasi-harmonic approximation, and the corresponding thermal neutron scattering cross section was evaluated. The temperature-dependent volume and heat capacity of uranium silicide obtained by the quasi-harmonic approximation showed reasonable agreement with experimental data while lattice thermal expansion showed deviation from experimental observations. Thermal scattering cross sections evaluated from 0 K and temperature-dependent phonon density of states exhibited differences of up to 4.1% at 1000 K. This study examines the impact of temperature on the thermal scattering law, employing ab initio lattice dynamics simulations through the quasi-harmonic approximation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1989

An experiment-based comparative study of fuzzy logic control

An approach is presented to the control of a dynamic physical system through the use of approximate reasoning. The approach has been implemented in a program named POLE, and the authors have successfully built a prototype hardware system to solve the cartpole balancing problem in real-time. The approach provides a complementary alternative to the conventional analytical control methodology and is of substantial use when a precise mathematical model of the process being controlled is not available. A set of criteria for comparing controllers based on approximate reasoning and those based on conventional control schemes is furnished.

Berenji, Hamid R.↗
NASA NTRS1990

Formulation and validation of high-order linearized models of helicopter flight mechanics

A high-order linearized model of helicopter flight dynamics is extracted from a nonlinear time domain simulation. The model has 29 states that describe the fuselage rigid body degrees of freedom, the flap and lag dynamics in a nonrotating coordinate system, the inflow dynamics, the delayed entry of the horizontal tail into the main rotor wake, and, approximately, the blade torsion dynamics. The nonlinear simulation is obtained by extensively modifying the GENHEL computer program. The results indicate that the agreement between the linearized and the nonlinear model is good for small perturbations, and deteriorates for large amplitude maneuvers.

Kim, Frederick D.↗
DOE OSTI2021

Solving the Dynamics-Aware Economic Dispatch Problem with the Koopman Operator

The dynamics-aware economic dispatch (DED) problem embeds low-level generator dynamics and operational constraints to enable near real-time scheduling of generation units in a power network. DED produces a more dynamic supervisory control policy than traditional economic dispatch (T-ED) that reduces overall generation costs. However, in contrast to T-ED, DED is a nonlinear, non-convex optimization problem that is computationally prohibitive to solve. We introduce a machine learning-based operator-theoretic approach for solving the DED problem efficiently. Specifically, we develop a novel discrete-time Koopman Operator (KO) formulation that embeds domain information into the structure of the KO to learn high-fidelity approximations of the generator dynamics. Using the KO approximation, the DED problem can be reformulated as a computationally tractable linear program (abbreviated DED-KO). We demonstrate the high solution quality and computational-time savings of the DED-KO model over the original DED formulation on a 9-bus test system.

King, Ethan↗
NASA NTRS1986

A comparative analysis of static and dynamic load balancing strategies

The problem of uniformly distributing the load of a parallel program over a multiprocessor system was considered. A program was analyzed whose structure permits the computation of the optimal static solution. Then four strategies for load balancing were described and their performance compared. The strategies are: (1) the optimal static assignment algorithm which is guaranteed to yield the best static solution, (2) the static binary dissection method which is very fast but suboptimal, (3) the greedy algorithm, a static fully polynomial time approximation scheme, which estimates the optimal solution to arbitrary accuracy, and (4) the predictive dynamic load balancing heuristic which uses information on the precedence relationships within the program and outperforms any of the static methods. It is also shown that the overhead incurred by the dynamic heuristic is reduced considerably if it is started off with a static assignment provided by either of the three strategies.

Iqbal, M. Ashraf↗
NASA NTRS1986

Performance tradeoffs in static and dynamic load balancing strategies

The problem of uniformly distributing the load of a parallel program over a multiprocessor system was considered. A program was analyzed whose structure permits the computation of the optimal static solution. Then four strategies for load balancing were described and their performance compared. The strategies are: (1) the optimal static assignment algorithm which is guaranteed to yield the best static solution, (2) the static binary dissection method which is very fast but sub-optimal, (3) the greedy algorithm, a static fully polynomial time approximation scheme, which estimates the optimal solution to arbitrary accuracy, and (4) the predictive dynamic load balancing heuristic which uses information on the precedence relationships within the program and outperforms any of the static methods. It is also shown that the overhead incurred by the dynamic heuristic is reduced considerably if it is started off with a static assignment provided by either of the other three strategies.

Iqbal, M. A.↗
NASA NTRS1993

Approximate optimal guidance for the advanced launch system

A real-time guidance scheme for the problem of maximizing the payload into orbit subject to the equations of motion for a rocket over a spherical, non-rotating earth is presented. An approximate optimal launch guidance law is developed based upon an asymptotic expansion of the Hamilton - Jacobi - Bellman or dynamic programming equation. The expansion is performed in terms of a small parameter, which is used to separate the dynamics of the problem into primary and perturbation dynamics. For the zeroth-order problem the small parameter is set to zero and a closed-form solution to the zeroth-order expansion term of Hamilton - Jacobi - Bellman equation is obtained. Higher-order terms of the expansion include the effects of the neglected perturbation dynamics. These higher-order terms are determined from the solution of first-order linear partial differential equations requiring only the evaluation of quadratures. This technique is preferred as a real-time, on-line guidance scheme to alternative numerical iterative optimization schemes because of the unreliable convergence properties of these iterative guidance schemes and because the quadratures needed for the approximate optimal guidance law can be performed rapidly and by parallel processing. Even if the approximate solution is not nearly optimal, when using this technique the zeroth-order solution always provides a path which satisfies the terminal constraints. Results for two-degree-of-freedom simulations are presented for the simplified problem of flight in the equatorial plane and compared to the guidance scheme generated by the shooting method which is an iterative second-order technique.

Feeley, T. S.↗