Engineering Papers⌕ Search

Engineering topics

Geoga, Christopher J.

Publications and source records attributed to Geoga, Christopher J..

Scalable computations for nonstationary Gaussian processes

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be very slow to converge when estimating many spatially varying parameters. In this paper, we present a computational framework which couples an algebraic block diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.

97 MATHEMATICS AND COMPUTING↗

Fitting Matérn smoothness parameters using automatic differentiation

The Mat$\acute{e}$rn covariance function is ubiquitous in the application of Gaussian processes to spatial statistics and beyond. Perhaps the most important reason for this is that the smoothness parameter $\nu$ gives complete control over the mean-square differentiability of the process, which has significant implications for the behavior of estimated quantities such as interpolants and forecasts. Unfortunately, derivatives of the Mat$\acute{e}$rn covariance function with respect to $\nu$ require derivatives of the modified second-kind Bessel function $K$ $\nu$ with respect to $\nu$. While closed form expressions of these derivatives do exist, they are prohibitively difficult and expensive to compute. For this reason, many software packages require fixing $\nu$ as opposed to estimating it, and all existing software packages that attempt to offer the functionality of estimating $\nu$ use finite difference estimates for $\partial$ $\nu$ $K$ $\nu$ . In this work, we introduce a new implementation of $K$$\nu$ that has been designed to provide derivatives via automatic differentiation (AD), and whose resulting derivatives are significantly faster and more accurate than those computed using finite differences. Here, we provide comprehensive testing for both speed and accuracy and show that our AD solution can be used to build accurate Hessian matrices for second-order maximum likelihood estimation in settings where Hessians built with finite difference approximations completely fail.

97 MATHEMATICS AND COMPUTING↗

Flexible nonstationary spatiotemporal modeling of high-frequency monitoring data

Many physical datasets are generated by collections of instruments that make measurements at regular time intervals. For such regular monitoring data, we extend the framework of half-spectral covariance functions to the case of nonstationarity in space and time and demonstrate that this method provides a natural and tractable way to incorporate complex behaviors into a covariance model. Further, we use this method with fully time-domain computations to obtain bona fide maximum likelihood estimators—as opposed to using Whittle-type likelihood approximations, for example—that can still be computed conveniently. Additionally, we apply this method to very high-frequency Doppler LIDAR vertical wind velocity measurements, demonstrating that the model can expressively capture the extreme nonstationarity of dynamics above and below the atmospheric boundary layer and, more importantly, the interaction of the process dynamics across it.

54 ENVIRONMENTAL SCIENCES↗

Frequency–wavenumber spectral analysis of spatio-temporal flows

We propose a fully spatio-temporal approach for identifying spatially varying modes of oscillation in fluid dynamics simulation output by means of multitaper frequency–wavenumber spectral analysis. One-dimensional spectrum estimation has proven to be a valuable tool in the analysis of turbulence data applied spatially to determine the rate of energy transport between spatial scales, or temporally to determine frequencies of oscillatory flows. It also allows for the quantitative comparison of flow characteristics between two scenarios using a standard basis. It has the limitation, however, that it neglects coupling between spatial and temporal structures. Two-dimensional frequency–wavenumber spectral analysis allows one to decompose waveforms into standing or travelling variety. The extended higher-dimensional multitaper method proposed here is shown to have improved statistical properties over conventional non-parametric spectral estimators, and is accompanied by confidence intervals which estimate their uncertainty. Multitaper frequency–wavenumber analysis is applied to a canonical benchmark problem, namely, a direct numerical simulation of von Kármán vortex shedding off a square wall-mounted cylinder with two inflow scenarios with matching momentum-thickness Reynolds numbers $Re_{\unicode[STIX]{x1D703}}\approx 1000$ at the obstacle. Frequency–wavenumber analysis of a two-dimensional section of these data reveals that although both the laminar and turbulent inflow scenarios show a turbulent $-5/3$ cascade in wavenumber ( $\unicode[STIX]{x1D708}$ ) and frequency ( $f$ ), the flow characteristics differ in that there is a significantly more prominent discrete harmonic oscillation near $(f,\unicode[STIX]{x1D708})=(0.2,0.21)$ in wavenumber and frequency in the laminar inflow scenario than the turbulent scenario. This frequency–wavenumber pair corresponds to a travelling wave with velocity near one near the centre path of the vortex street.

Geoga, Christopher J. (ORCID:0000000250604799)↗