Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Data-driven Minimum Entropy Control for Stochastic Nonlinear Systems using the Cumulant-Generating Function

Here, we present a novel minimum entropy control algorithm for a class of stochastic nonlinear systems subjected to non-Gaussian noises. The entropy control can be considered as an optimization problem for the system randomness attenuation, but the mean value has to be considered separately. To overcome this disadvantage, a new representation of the system stochastic properties was given using the cumulant-generating function based on the moment-generating function, in which the mean value and the entropy was reflected by the shape of the cumulant-generating function. Based on the samples of the system output and control input, a time-variant linear model was identified, and the minimum entropy optimization was transformed to system stabilization. Then, an optimal control strategy was developed to achieve the randomness attenuation, and the boundedness of the controlled system output was analyzed. The effectiveness of the presented control algorithm was demonstrated by a numerical example. In this paper, a data-driven minimum entropy design is presented without pre-knowledge of the system model; entropy optimization is achieved by the system stabilization approach in which the stochastic distribution control and minimum entropy are unified using the same identified structure; and a potential framework is obtained since all the existing system stabilization methods can be adopted to achieve the minimum entropy objective.

42 ENGINEERING↗

A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods have difficulties in efficiently estimating the posterior distribution and maximizing the mutual information (MI) between data and parameters. Recent work proposed the use of gradient ascent to maximize a lower bound on MI to deal with these issues. However, the approach requires a sampling path to compute the pathwise gradient of the MI lower bound with respect to the design variables, and such a pathwise gradient is usually inaccessible for implicit models. In this paper, we propose a novel approach that leverages recent advances in stochastic approximate gradient ascent incorporated with a smoothed variational MI estimator for efficient and robust BED. Without the necessity of pathwise gradients, our approach allows the design process to be achieved through a unified procedure with an approximate gradient for implicit models. Several experiments show that our approach outperforms baseline methods, and significantly improves the scalability of BED in high-dimensional problems.

Zhang, Jiaxin↗

A fault tolerant approach to state estimation and failure detection in nonlinear systems

The design problem considered in the present investigation involves a nonlinear discrete time stochastic system where replicated sensors provide redundant observations of inputs and outputs of the system, compensate for sensor 'normal operating' bias levels, and generate reliable estimates for the plant states in the presence of possible sensor failures. The resulting fault tolerant design should utilize inherent analytical redundancy and be capable of detecting many different types and levels of sensor failures. In addition, it should have minimal complexity. In connection with these goals, a sensor fault tolerant system design methodology is developed. The performance of the considered approach to an application is discussed, taking into account the design of a sensor fault tolerant system using analytic redundancy for the Terminal Configured Vehicle research aircraft in a microwave landing system environment.

Lancraft, R. E.↗

Divergence of Solutions to Perturbation-Based Advection-Dispersion Moment Equations

Moment equation methods are popular and powerful tools for modeling transport processes in randomly heterogeneous porous media, but the application of these methods to advection-dispersion equations often leads to erroneous oscillations. Perturbative methods, required to close systems of moment equations, become inaccurate for large perturbations; however, little quantitative theory exists for determining when this occurs for advection-dispersion equations. We consider three different methods (asymptotic approximation, Eulerian truncation, and iterative solution) for closing and solving advection-dispersion moment equations describing transport in stratified porous media with random permeability. We obtain approximate analytical expressions for time above which the asymptotic approximation to the mean diverges, in particular quantifying the impact that dispersion has on delaying---but not eliminating---divergence. We demonstrate that Eulerian truncation and iterative solution methods do not eliminate divergent behavior either. Our divergence criteria provide \emph{a priori} estimates that signal a warning to the practitioner of stochastic advection-dispersion equations to carefully consider whether to apply perturbative approaches.

58 GEOSCIENCES↗

An ensemble Kalman filter for statistical estimation of physics constrained nonlinear regression models

A central issue in contemporary science is the development of nonlinear data driven statistical–dynamical models for time series of noisy partial observations from nature or a complex model. It has been established recently that ad-hoc quadratic multi-level regression models can have finite-time blow-up of statistical solutions and/or pathological behavior of their invariant measure. Recently, a new class of physics constrained nonlinear regression models were developed to ameliorate this pathological behavior. Here a new finite ensemble Kalman filtering algorithm is developed for estimating the state, the linear and nonlinear model coefficients, the model and the observation noise covariances from available partial noisy observations of the state. Several stringent tests and applications of the method are developed here. In the most complex application, the perfect model has 57 degrees of freedom involving a zonal (east–west) jet, two topographic Rossby waves, and 54 nonlinearly interacting Rossby waves; the perfect model has significant non-Gaussian statistics in the zonal jet with blocked and unblocked regimes and a non-Gaussian skewed distribution due to interaction with the other 56 modes. We only observe the zonal jet contaminated by noise and apply the ensemble filter algorithm for estimation. Numerically, we find that a three dimensional nonlinear stochastic model with one level of memory mimics the statistical effect of the other 56 modes on the zonal jet in an accurate fashion, including the skew non-Gaussian distribution and autocorrelation decay. On the other hand, a similar stochastic model with zero memory levels fails to capture the crucial non-Gaussian behavior of the zonal jet from the perfect 57-mode model.

97 MATHEMATICS AND COMPUTING↗

Ensemble-type numerical uncertainty information from single model integrations

We suggest an algorithm that quantifies the discretization error of time-dependent physical quantities of interest (goals) for numerical models of geophysical fluid dynamics. The goal discretization error is estimated using a sum of weighted local discretization errors. The key feature of our algorithm is that these local discretization errors are interpreted as realizations of a random process. The random process is determined by the model and the flow state. From a class of local error random processes we select a suitable specific random process by integrating the model over a short time interval at different resolutions. The weights of the influences of the local discretization errors on the goal are modeled as goal sensitivities, which are calculated via automatic differentiation. The integration of the weighted realizations of local error random processes yields a posterior ensemble of goal approximations from a single run of the numerical model. From the posterior ensemble we derive the uncertainty information of the goal discretization error. This algorithm bypasses the requirement of detailed knowledge about the models discretization to generate numerical error estimates. The algorithm is evaluated for the spherical shallow-water equations. For two standard test cases we successfully estimate the error of regional potential energy, track its evolution, and compare it to standard ensemble techniques. The posterior ensemble shares linear-error-growth properties with ensembles of multiple model integrations when comparably perturbed. The posterior ensemble numerical error estimates are of comparable size as those of a stochastic physics ensemble.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Hybrid Method for Tensor Decompositions that Leverages Stochastic and Deterministic Optimization

In this paper, we propose a hybrid method that uses stochastic and deterministic search to compute the maximum likelihood estimator of a low-rank count tensor with Poisson loss via state-of-theart local methods. Our approach is inspired by Simulated Annealing for global optimization and allows for fine-grain parameter tuning as well as adaptive updates to algorithm parameters. We present numerical results that indicate our hybrid approach can compute better approximations to the maximum likelihood estimator with less computation than the state-of-the-art methods by themselves.

97 MATHEMATICS AND COMPUTING↗

Gaussian Process Emulators for Volcanic Ash Dispersion Model Tephra2

It is necessary to predict volcanic ash deposition since falling ash is harmful to human activities. Because simulators built for this purpose are computationally expensive, it is popular to use statistical emulators for geophysical hazard analyses, where a large number of simulations are required. Gaussian stochastic process emulators are able to approximate expensive simulations in an accurate and efficient way. Using a relatively small number of simulation runs, a well-trained emulator can accurately predict simulation outputs at massive new input points in a few seconds. Under different explosive eruption conditions, we constructed Gaussian stochastic process emulators for Tephra2, a simulation tool for estimating the accumulation of volcanic ash over a region. Historical wind records are used as input wind data, without assuming a Gaussian wind speed profile or common wind direction among elevations. While there are several inputs for Tephra2, we use no more than three physically motivated variables as emulator inputs to reduce the computational cost of emulations. The emulator outputs predict the mass of tephra per unit area at 50281 grid points around a predetermined vent location.

58 GEOSCIENCES↗

Stellar Mass Calibrations for Local Low-mass Galaxies

The stellar masses of galaxies are measured from integrated light via several methods—however, few of these methods were designed for low-mass (M ⋆ ≲ 10 8 M ⊙ ) “dwarf” galaxies, whose properties (e.g., stochastic star formation, low metallicity) pose unique challenges for estimating stellar masses. In this work, we quantify the precision and accuracy at which stellar masses of low-mass galaxies can be recovered using UV/optical/IR photometry. We use mock observations of 469 low-mass galaxies from a variety of models, including both semi-empirical models (GRUMPY and UniverseMachine-SAGA) and cosmological baryonic zoom-in simulations (MARVELous Dwarfs and FIRE-2), to test literature color–M ⋆ /L relations and multiwavelength spectral energy distribution (SED) mass estimators. We identify a list of “best practices” for measuring stellar masses of low-mass galaxies from integrated photometry. We find that literature color–M ⋆ /L relations are often unable to capture the bursty star formation histories (SFHs) of low-mass galaxies, and we develop an updated prescription for stellar mass based on g − r color that is better able to recover stellar masses for the bursty low-mass galaxies in our sample (with ∼0.1 dex precision). SED fitting can also precisely recover stellar masses of low-mass galaxies, but this requires thoughtful choices about the form of the assumed SFH: Parametric SFHs can underestimate stellar mass by as much as ∼0.4 dex, while nonparametric SFHs recover true stellar masses with insignificant offset (−0.03 ± 0.11 dex). Finally, we also caution that noninformative (wide) dust attenuation priors may introduce M ⋆ uncertainties of up to ∼0.6 dex.

de los Reyes, Mithi A. C. [Amherst College, MA (Un↗

Adaptive statistical pattern classifiers for remotely sensed data

A technique for the adaptive estimation of nonstationary statistics necessary for Bayesian classification is developed. The basic approach to the adaptive estimation procedure consists of two steps: (1) an optimal stochastic approximation of the parameters of interest and (2) a projection of the parameters in time or position. A divergence criterion is developed to monitor algorithm performance. Comparative results of adaptive and nonadaptive classifier tests are presented for simulated four dimensional spectral scan data.

Gonzalez, R. C.↗

Adaptive Bayes classifiers for remotely sensed data

An algorithm is developed for a learning, adaptive, statistical pattern classifier for remotely sensed data. The estimation procedure consists of two steps: (1) an optimal stochastic approximation of the parameters of interest, and (2) a projection of the parameters in time and space. The results reported are for Gaussian data in which the mean vector of each class may vary with time or position after the classifier is trained.

Raulston, H. S.↗

Identification and control of spacecraft

Information on the identification and control of spacecraft is given. Maximum likelihood estimation, identification accuracy issues, steady state identifiability analysis and stochastic error with process noise are among the topics addressed.

Greene, C. S.↗

Can stochastic, dissipative wave fields be treated as random walk generators

A suggestion by Meek et al. (1985) that the gravity wave field be viewed as stochastic, with significant nonlinearities, is applied to calculate diffusivities. The purpose here is to calculate the diffusivity for stochastic wave model and compare it with previous diffusivity estimates. The researchers do this for an idealized case in which the wind velocity changes but slowly, and for which saturation is the principal mechanism by which wave energy is lost. A related calculation was given in a very brief way (Weinstock, 1976), but the approximations were not fully justified, nor were the physical pre-suppositions clearly explained. The observations of Meek et al. (1985) have clarified the pre-suppositions for the researchers and provided a rationalization and improvement of the approximations employed.

Weinstock, J.↗

Generalized covariance analysis for partially autonomous deep space missions

A new covariance analysis method is presented that is suitable for the evaluation of multiple impulsive controllers acting on some stochastic process x. The method accommodates batch and sequential estimators with equal ease and accounts for time-delay effects in a natural manner. The formalism is developed in terms of a generalized state vector that is formed from the system state vector x, augmented by various fixed epoch estimates, and a data vector formed from discrete time observations of the system. Recursions are developed for time transition, measurement incorporation, and impulsive control updating of the generalized covariance matrix. Means of limiting the dimensional growth of the generalized state vector via the processes of estimator epoch adjustment and measurement vector deflation are described and the application of numerically stable matrix factorization methods to the generalized covariance recursions is outlined. The method is applied to the Magellan spacecraft to demonstrate the capability of ground-based optimal estimation and control of gyro/star scanner misalignment.

Boone, Jack N.↗

Spectral Density of Laser Beam Scintillation in Wind Turbulence: Theory - Part 1

The temporal spectral density of the log-amplitude scintillation of a laser beam wave due to a spatially dependent vector-valued crosswind (deterministic as well as random) is evaluated. The path weighting functions for normalized spectral moments are derived, and offer a potential new technique for estimating the wind velocity profile. The Tatarskii-Klyatskin stochastic propagation equation for the Markov turbulence model is used with the solution approximated by the Rytov method. The Taylor 'frozen-in' hypothesis is assumed for the dependence of the refractive index on the wind velocity, and the Kolmogorov spectral density is used for the refractive index field.

Balakrishnan, A. V.↗

3D Lunar Terrain Reconstruction from Apollo Images

Generating accurate three dimensional planetary models is becoming increasingly important as NASA plans manned missions to return to the Moon in the next decade. This paper describes a 3D surface reconstruction system called the Ames Stereo Pipeline that is designed to produce such models automatically by processing orbital stereo imagery. We discuss two important core aspects of this system: (1) refinement of satellite station positions and pose estimates through least squares bundle adjustment; and (2) a stochastic plane fitting algorithm that generalizes the Lucas-Kanade method for optimal matching between stereo pair images.. These techniques allow us to automatically produce seamless, highly accurate digital elevation models from multiple stereo image pairs while significantly reducing the influence of image noise. Our technique is demonstrated on a set of 71 high resolution scanned images from the Apollo 15 mission

Broxton, Michael J.↗