Optimization of stochastic finite state systems.
Optimization of stochastic dynamic system with noisy output
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimization of stochastic dynamic system with noisy output
This final report on computational methods and software systems for dynamics and control of large space structures covers progress to date, projected developments in the final months of the grant, and conclusions. Pertinent reports and papers that have not appeared in scientific journals (or have not yet appeared in final form) are enclosed. The grant has supported research in two key areas of crucial importance to the computer-based simulation of large space structure. The first area involves multibody dynamics (MBD) of flexible space structures, with applications directed to deployment, construction, and maneuvering. The second area deals with advanced software systems, with emphasis on parallel processing. The latest research thrust in the second area, as reported here, involves massively parallel computers.
Dynamic mass transfer equation for design parameters of regenerable absorption beds for carbon dioxide removal in spacecraft life support system
A method of modeling friction forces that impede the motion of parts of dynamic mechanical systems is described. Conventional methods in which the friction effect is assumed a constant force, or torque, in a direction opposite to the relative motion, are applicable only to those cases where applied forces are large in comparison to the friction, and where there is little interest in system behavior close to the times of transitions through zero velocity. An algorithm is described that provides accurate determination of friction forces over a wide range of applied force and velocity conditions. The method avoids the simulation errors resulting from a finite integration interval used in connection with a conventional friction model, as is the case in many digital computer-based simulations. The algorithm incorporates a predictive calculation based on initial conditions of motion, externally applied forces, inertia, and integration step size. The predictive calculation in connection with an external integration process provides an accurate determination of both static and Coulomb friction forces and resulting motions in dynamic simulations. Accuracy of the results is improved over that obtained with conventional methods and a relatively large integration step size is permitted. A function block for incorporation in a specific simulation program is described. The general form of the algorithm facilitates implementation with various programming languages such as FORTRAN or C, as well as with other simulation programs.
This is an oral presentation on dynamic propulsion system modeling for control design, analysis, and simulation. These tools have been developed at NASA Glenn Research Center.
This report presents the results of analysis of cockpit lateral control feel-system studies. Variations in feel-system natural frequency, damping, and command sensing reference (force and position) were investigated, in combination with variations in the aircraft response characteristics. The primary data for the report were obtained from a flight investigation conducted with a variable-stability airplane, with additional information taken from other flight experiments and ground-based simulations for both airplanes and helicopters . The study consisted of analysis of handling qualities ratings and extraction of open-loop, pilot-vehicle describing functions from sum-of-sines tracking data, including, for a limited subset of these data, the development of pilot models. The study confirms the findings of other investigators that the effects on pilot opinion of cockpit feel-system dynamics are not equivalent to a comparable level of added time delay, and until a more comprehensive set of criteria are developed, it is recommended that feel-system dynamics be considered a delay-inducing element in the aircraft response. The best correlation with time-delay requirements was found when the feel-system dynamics were included in the delay measurements, regardless of the command reference. This is a radical departure from past approaches.
Background: In dynamic systems such as heavy-ion collisions, charge susceptibilities and local charge correlations change with time. These changes are accompanied by nonlocal correlations, which spread diffusively with time and are constrained by local charge conservation. Such correlations have been measured at the Relativistic Heavy-Ion Collider (RHIC) and have been linked to the chemical evolution of the matter and possible phase separation or critical phenomena. The evolution of such correlations has been modeled for two-point correlators superimposed onto hydrodynamics, but not for three- or four-point correlators. These higher-order correlators represent an essential basis for calculating the kurtosis and skewness of charge distributions measured at RHIC. For short-range correlations, such as those between charges on the same particle, and the associated charge-balance correlations a theoretical formalism was lacking for handling higher-order correlations. In particular, one needed to understand how higher-order charge fluctuations was split onto lower numbers of particles. For example, correlations of order three have contributions with charge all on one particle, split onto two particle, or split onto three. By assuming local chemical equilibrium of short-range correlations, the sources of the various correlators were found to be uniquely determined. The relevant theoretical foundation is presented here, including a diagrammatic technique to correctly account for all the possible terms to higher-order correlations. Here, we found a consistent theoretical treatment and its applicability, viability, and tractability are discussed. The formalism derived here enables realistic and quantitative modeling of the three- and four-point charge correlations necessary for understanding measurements of the kurtosis and skewness of charge distributions at RHIC. These observables have been promoted as signals of phase transitions or measures of chemical evolution.
Linear dynamic systems governed by first-order linear differential equations in state variables, emphasizing time reversal and differential controllability
One approach to qualitative reasoning about dynamical systems is to extract qualitative information by searching or making queries on databases containing very large numbers of trajectories. The efficiency of such queries depends crucially upon finding an appropriate data structure for trajectories of dynamical systems. Suppose that a large number of parameterized trajectories gamma of a dynamical system evolving in R sup N are stored in a database. Let Eta is contained in set R sup N denote a parameterized path in Euclidean Space, and let the Euclidean Norm denote a norm on the space of paths. A data structure is defined to represent trajectories of dynamical systems, and an algorithm is sketched which answers queries.
X-ray diffraction (XRD) is a necessary technique for understanding states of materials under static and dynamic loading conditions. The higher-pressure Equation of State (EOS) of many materials can only be explored via shock or ramp compression at temperatures and pressures of interest. While static XRD work has yielded EOS measurements in the 100 - 200 GPa regime, dynamic X-ray diffraction (DXRD) can explore EOS phases in the TPa regime, which closely resembles inner-core planetary conditions. DXRD hinges on the ability to measure the exact phase or phase change of a material while under dynamic loading conditions. Macroscopic diagnostic systems (e.g. velocimetry and pyrometry) can infer a phase change but not identify the specific phase entered by a material. While microscopic (atomic-level) diagnostic systems (e.g. DXRD) have been designed and implemented in Department of Energy’s (DOE) National Laboratories complex, the unique nature of Sandia National Laboratories’ Pulsed Power Facility (Z Machine) prohibits the use of such devices. The destructive nature of Z experiments presents a challenge to data capture and retrieval. Furthermore there are electromagnetic interference, X-ray background, and mechanical constraints to consider. Thus, a multi-part X-ray diagnostic for use on the Z Machine and Z-Beamlet Laser system has been designed and analyzed. Portions of this new DYnamic SCintillator Optic (DYSCO) have been built, tested and fielded. A data analysis software has been written. Finally, the radiance profile of the DYSCO’s scintillator has been characterized through experiments performed at the University of Arizona.
The implementation of dynamic power conversion technology in Radioisotope Power Systems (RPS) for spaceflight has potential for improved specific power and efficiency, compared with existing Radioisotope Thermoelectric Generators (RTGs). This proposed expansion of current RPS technology necessitates a full exploration of the requirements, goals, and concerns related to risks in developing and deploying such systems. The nature of dynamic systems also presents a new set of challenges related to the presence of moving machinery not intrinsic to traditional RTG units. A general RPS risk management methodology is outlined, which is used to identify and assess the variables and operational scenarios introducing risk throughout the design, fabrication, and system integration processes. This paper will demonstrate how mission requirements for Dynamic RPS concepts (DRPS) drive decisions throughout the development process. This work will define the standard practices for decision making within the scope of the risks associated with DRPS hardware development and deployment in sensitive spacecraft near sensitive payloads. Examples of potential risk areas are analyzed for the proposed dynamic systems, and compared to those associated with traditional RTG technologies. This analysis shows the promise for DRPS systems to elevate and extend the capabilities for power systems used in future NASA missions.
Dynamic Energy Transport and Integration Lab (DETAIL) at Idaho National Laboratory is to support experimental demonstration and validation research on Nuclear-Renewable Hybrid Energy System [1]. The Thermal Energy Distribution System (TEDS) is a thermal-hydraulic flow loop in DETAIL with its own dedicated control system to support the integration of co-located multiple experimental systems, where a packed-bed thermal energy storage (TES) is installed as a thermal buffer and storage unit. Among various TES options, the packed-bed TES is adopted in TEDS because it offers a low-cost single-tank thermal storage option compared to the traditional two-tank TES. However, since the TES tank is filled with granular fillers having different thermophysical properties from those of TES tank wall, there is a potential thermo-mechanical issue to be carefully addressed like thermal ratcheting which may pose a significant design concern for the packed-bed TES tank. Thermal ratcheting is a thermomechanical process caused by the repeated rearrangement of granular filler inside a TES tank during continuous thermal cycling operation of the packed-bed TES system. If the thermally induced stress exceeds the yield strength of a TES tank wall, catastrophic consequences may happen like rupture of the TES tank. Thus, it is important to understand the phenomenon to ensure the robust operation of the packed-bed TES tank. Given that thermal ratcheting is caused by complex interaction of thermal transport in the porous bed and solid mechanics, the accurate prediction of transient thermal behavior of the packed-bed TES tank, which is the focus of this paper, is critical to the reliable thermal ratcheting analysis. This paper discusses the numerical modeling, simulation, and validation studies that are ongoing at INL to investigate the transient thermal behavior of the packed-bed TES. Of particular concern is the transient thermal process occurring in the packed-bed TES unit that is operated in conjunction with the INL TEDS. The main goal of this research is three-fold: (i) provide preliminary insights into the transient thermal behavior of the TEDS TES tank, (ii) support the thermal measurement and validation plan for TEDS experiment, and (iii) provide transient thermal boundary conditions to support the reliable thermal ratcheting analysis of the TEDS TES tank. For the transient thermal modeling and analysis, a CFD model was developed, and the validity of the modeling approach was examined via comparing the numerical simulation results with the experimental data obtained from various design characteristics of packed-bed TES tanks. Then, the present modeling method was applied for the transient thermal analysis of the TEDS TES tank, and the results are discussed along with the potential improvement of data acquisition strategy for the future TEDS experiments for more precise validation study.
Traditionally, long term measurements of atmospherically propagated sound signals have consisted of time series of multiminute averages. Only recently have continuous measurements with temporal resolution corresponding to turbulent time scales been available. With modern digital data acquisition systems we now have the capability to simultaneously record both acoustical and meteorological parameters with sufficient temporal resolution to allow us to examine in detail relationships between fluctuating sound and the meteorological variables, particularly wind and temperature, which locally determine the acoustic refractive index. The atmospheric acoustic propagation medium can be treated as a nonlinear dynamical system, a kind of signal processor whose innards depend on thermodynamic and turbulent processes in the atmosphere. The atmosphere is an inherently nonlinear dynamical system. In fact one simple model of atmospheric convection, the Lorenz system, may well be the most widely studied of all dynamical systems. In this paper we report some results of our having applied methods used to characterize nonlinear dynamical systems to study the characteristics of acoustical signals propagated through the atmosphere. For example, we investigate whether or not it is possible to parameterize signal fluctuations in terms of fractal dimensions. For time series one such parameter is the limit capacity dimension. Nicolis and Nicolis were among the first to use the kind of methods we have to study the properties of low dimension global attractors.
The efficiency of a structure-control system is a nondimensional parameter which indicates the fraction of the total control power expended usefully in controlling a finite-dimensional system. The balance of control power is wasted on the truncated dynamics serving no useful purpose towards the control objectives. Recently, it has been demonstrated that the concept of efficiency can be used to address a number of control issues encountered in the control of dynamic systems such as the spillover effects, selection of a good input configuration and obtaining reduced order control models. Reference (1) introduced the concept and presented analyses of several Linear Quadratic Regulator designs on the basis of their efficiencies. Encouraged by the results of Ref. (1), Ref. (2) introduces an efficiency modal analysis of a structure-control system which gives an internal characterization of the controller design and establishes the link between the control design and the initial disturbances to affect efficient structure-control system designs. The efficiency modal analysis leads to identification of principal controller directions (or controller modes) distinct from the structural natural modes. Thus ultimately, many issues of the structure-control system revolve around the idea of insuring compatibility of the structural modes and the controller modes with each other, the better the match the higher the efficiency. A key feature in controlling a reduced order model of a high dimensional (or infinity-dimensional distributed parameter system) structural dynamic system must be to achieve high efficiency of the control system while satisfying the control objectives and/or constraints. Formally, this can be achieved by designing the control system and structural parameters simultaneously within an optimization framework. The subject of this paper is to present such a design procedure.
We assume that we are given a time series of data from a dynamical system and our task is to learn the flow map of the dynamical system. We present a collection of results on how to enforce constraints coming from the dynamical system in order to accelerate the training of deep neural networks to represent the flow map of the system as well as increase their predictive ability. In particular, we provide ways to enforce constraints during training for all three major modes of learning, namely supervised, unsupervised and reinforcement learning. In general, the dynamic constraints need to include terms which are analogous to memory terms in model reduction formalisms. Such memory terms act as a restoring force which corrects the errors committed by the learned flow map during prediction. For supervised learning, the constraints are added to the objective function. For the case of unsupervised learning, in particular generative adversarial networks, the constraints are introduced by augmenting the input of the discriminator. Finally, for the case of reinforcement learning and in particular actor-critic methods, the constraints are added to the reward function. In addition, for the reinforcement learning case, we present a novel approach based on homotopy of the action-value function in order to stabilize and accelerate training. We use numerical results for the Lorenz system to illustrate the various constructions.
This paper presents the results of a transient computer simulation that was developed to study phase change energy storage techniques for Space Station Freedom (SSF) solar dynamic (SD) power systems. Such SD systems may be used in future growth SSF configurations. Two solar dynamic options are considered in this paper: Brayton and Rankine. Model elements consist of a single node receiver and concentrator, and takes into account overall heat engine efficiency and power distribution characteristics. The simulation not only computes the energy stored in the receiver phase change material (PCM), but also the amount of the PCM required for various combinations of load demands and power system mission constraints. For a solar dynamic power system in low earth orbit, the amount of stored PCM energy is calculated by balancing the solar energy input and the energy consumed by the loads corrected by an overall system efficiency. The model assumes an average 75 kW SD power system load profile which is connected to user loads via dedicated power distribution channels. The model then calculates the stored energy in the receiver and subsequently estimates the quantity of PCM necessary to meet peaking and contingency requirements. The model can also be used to conduct trade studies on the performance of SD power systems using different storage materials.
We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.
A novel approach of integrated system identification and modal state estimation is proposed for control of linear dynamical systems including flexible space structures. There are four steps involved in this approach. First, the relation between a stochastic state space model of a dynamical system and the coefficients of its autoregressive model with exogenous input is derived. Second, an adaptive least-squares transversal predictor is used to estimate the coefficients of the model. Third, a state space model and a steady state Kalman filter gain of the dynamical system are then identified from the coefficients of the model by using the eigensystem realization algorithm. Fourth, a modal state estimator is constructed using the modal parameters of the identified model. On-line implementation of this algorithm can continually improve the modal parameters and the filter gain. It can also gradually update the system model when the system characteristics are slowly changing. A numerical example is used to illustrate the feasibility of the new approach.