Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

Design of optimal partial state feedback controllers for linear systems in stochastic environments

The problem of obtaining an optimal control law, which is constrained to be a feedback of the available measurements, is considered for both continuous and discrete time linear systems subjected to additive white process noise and measurement noise. Necessary conditions are obtained for minimizing a quadratic performance function for both finite and infinite duration cases. The feedback gain matrices are constrained to be constant for the infinite duration cases. For all the cases considered, algorithms are derived for generating sequences of feedback gain matrices which successively improve the performance function. Computational aspects are discussed via application to two continuous time processes, including a helicopter/slung load system subjected to measurement noise and random wind gust input.

Joshi, S. M.↗
NASA NTRS1991

Integrated adaptive filtering and design for control experiments of flexible structures

A novel method is presented of identifying a state space model and a state estimator for linear stochastic systems from input and output data. The method is primarily based on the relations between the state space model and the finite difference model for linear stochastic systems derived through projection filters. It is proven that least squares identification of a finite difference model converges to the model derived from the projection filters. System pulse response samples are computed from the coefficients of the finite difference model. In estimating the corresponding state estimator gain, a z-domain method is used. First the deterministic component of the output is subtracted out, and then the state estimator gain is obtained by whitening the remaining signal. Experimental example is used to illustrate the feasibility of the method.

Huang, Jen-Kuang↗
NASA NTRS1983

On Restructurable Control System Theory

The state of stochastic system and control theory as it impacts restructurable control issues is addressed. The multivariable characteristics of the control problem are addressed. The failure detection/identification problem is discussed as a multi-hypothesis testing problem. Control strategy reconfiguration, static multivariable controls, static failure hypothesis testing, dynamic multivariable controls, fault-tolerant control theory, dynamic hypothesis testing, generalized likelihood ratio (GLR) methods, and adaptive control are discussed.

Athans, M.↗
NASA NTRS1975

Optimal policies for identification of stochastic linear systems

The problem of designing closed-loop policies for identification of multiinput-multioutput linear discrete-time systems with random time-varying parameters is considered in this paper using a Bayesian approach. A sensitivity index gives a measure of performance for the closed-loop laws. The computation of the optimal laws is shown to be nontrivial, an exercise in stochastic control, but open-loop, affine, and open-loop feedback optimal inputs are shown to yield tractable problems. Numerical examples are given. For time-invariant systems, the criterion considered is shown to be related to the trace of the information matrix associated with the system.

Lopez-Toledo, A. A.↗
DOE OSTI2024

Investigation of the notch sensitivity of tailorable long fiber discontinuous prepreg composite laminates

Tailorable discontinuous fiber composite laminates provide relative formability beyond that of continuous fiber laminates, while achieving improved mechanical performance over comparable stochastic systems. Here, in this work, the notch sensitivity of engineered prepreg platelet molded composite (PPMC) laminates is investigated using the open-hole tension (OHT) test and compared to available data for stochastic PPMCs and continuous fiber laminates made with the same material. The press-formed thermoplastic composites (AS4/PEKK) were molded with a quasi-isotropic stacking sequence. The discontinuous PPMC laminate was found to be notch insensitive with OHT strengths ranging from 145.4 MPa (CV $=$ 7%) for d/w $=$ 0.5 to 229.3 MPa (CV $=$ 9%) for d/w $=$ 0.25. The highly ordered meso-structure of the engineered PPMC laminate yields comparatively excellent mechanical properties for relatively thin laminates in contrast to stochastic systems. Both net- and gross-section failures were observed for d/w $=$ 0.25, which suggests that the engineered PPMC laminates studied here maintain a degree of inherent, internal stress concentrations that compete with those caused by geometric features such as a circular hole. Computational simulations of the OHT tests with explicitly represented platelets were found to be in good agreement with experimental measurements. The progressive failure analysis was used to conduct a numerical investigation of the stacking sequence and platelet meso-morphology.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗
DOE OSTI2021

Modeling Noise: Paths toward AI-Enabled Stochastic Earth System Models and Parameterizations

Some of the key challenges in Earth system prediction arise from an uncertain representation of unpredictable natural variability, across time and space scales. This variability, hereafter referred to as noise, represents the quantity against which the strength of a signal of interest is measured to assess predictability. Underestimating or overestimating this noise in Earth system models can lead to issues ranging between overconfidence in an erroneous prediction and a lack thereof in an otherwise accurate one. Noise is part of the physical processes in the Earth system and can amplify or damp a signal of interest in a complex manner that is not systematically characterized. Specifically, while there has been significant progress in our understanding of multiscale interactions among known modes of variability (potentially predictable signals), how these are impacted by the noise is not clear. Recent effort toward stochastic parametrization schemes that provide a representation of noise due to uncertain sub-grid processes in climate models (Berner et al., 2017 and references therein) has shown promise not only in reducing biases and improving probabilistic prediction but also in improving the representation of natural variability in the model toward what is observed. However, today’s standard schemes for stochastic parametrization are still simplistic as they do not take the state of the atmosphere into account (other than by the use of multiplicative noise for model tendencies). Furthermore they require hand-tuning and trial-and-error testing for the magnitude of the added noise, which is difficult in a chaotic system that is as complex as the Earth system.

58 GEOSCIENCES↗
NASA NTRS1991

Hybrid state-space self-tuning control using dual-rate sampling

This paper presents a hybrid state-space self-tuning control scheme using dual-rate sampling for suboptimal digital adaptive control of linear time-invariant continuous-time multivariable stochastic systems with unknown parameters. An equivalent fast-rate discrete-time state-space innovation model (with estimated states) of the continuous-time system is constructed by using the estimated system parameters and Kalman gain. To utilize the existing optimal regional-pole assignment method developed in the continuous-time domain, the constructed fast-rate discrete-time model is converted into an equivalent continuous-time model for the development of a state-feedback optimal control law with pole placement in a specific region. The developed analog optimal control law is then converted into an equivalent pseudo-slow-rate digital control law via the proposed digital redesign technique, which can be realized via slow-rate digital electronics. The proposed method enables the development of a digitally implementable advanced control algorithm for digital adaptive control of continuous-time multivariable stochastic systems which may be unstable and/or have nonminimum phase.

Shieh, Leang S.↗
NASA NTRS1971

Closed-loop control of stochastic nonlinear systems

Technique resolves problems in complex control systems, such as those used for space vehicle guidance and control. Main disadvantage of procedure is that it is only appropriate in situations where trajectory concept is valid.

Schmidt, G. T.↗
NASA NTRS1975

Stochastic control system parameter identifiability

The parameter identification problem of general discrete time, nonlinear, multiple input/multiple output dynamic systems with Gaussian white distributed measurement errors is considered. The knowledge of the system parameterization was assumed to be known. Concepts of local parameter identifiability and local constrained maximum likelihood parameter identifiability were established. A set of sufficient conditions for the existence of a region of parameter identifiability was derived. A computation procedure employing interval arithmetic was provided for finding the regions of parameter identifiability. If the vector of the true parameters is locally constrained maximum likelihood (CML) identifiable, then with probability one, the vector of true parameters is a unique maximal point of the maximum likelihood function in the region of parameter identifiability and the constrained maximum likelihood estimation sequence will converge to the vector of true parameters.

Lee, C. H.↗
DOE OSTI2023

Operation Optimization Using Reinforcement Learning with Integrated Artificial Reasoning Framework

In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.

Kim, Junyung↗