Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Learning Weight Uncertainty with Stochastic Gradient MCMC for Shape Classification

Learning the representation of shape cues in 2D & 3D objects for recognition is a fundamental task in computer vision. Deep neural networks (DNNs) have shown promising performance on this task. Due to the large variability of shapes, accurate recognition relies on good estimates of model uncertainty, ignored in traditional training of DNNs, typically learned via stochastic optimization. This paper leverages recent advances in stochastic gradient Markov Chain Monte Carlo (SG-MCMC) to learn weight uncertainty in DNNs. It yields principled Bayesian interpretations for the commonly used Dropout/DropConnect techniques and incorporates them into the SG-MCMC framework. Extensive experiments on 2D & 3D shape datasets and various DNN models demonstrate the superiority of the proposed approach over stochastic optimization. Our approach yields higher recognition accuracy when used in conjunction with Dropout and Batch-Normalization.

convolutional neural network↗

Transformations based on continuous piecewise-affine velocity fields

Here, we propose novel finite-dimensional spaces of well-behaved Rn → Rn transformations. The latter are obtained by (fast and highly-accurate) integration of continuous piecewise-affine velocity fields. The proposed method is simple yet highly expressive, effortlessly handles optional constraints (e.g., volume preservation and/or boundary conditions), and supports convenient modeling choices such as smoothing priors and coarse-to-fine analysis. Importantly, the proposed approach, partly due to its rapid likelihood evaluations and partly due to its other properties, facilitates tractable inference over rich transformation spaces, including using Markov-Chain Monte-Carlo methods. Its applications include, but are not limited to: monotonic regression (more generally, optimization over monotonic functions); modeling cumulative distribution functions or histograms; time-warping; image warping; image registration; real-time diffeomorphic image editing; data augmentation for image classifiers. Our GPU-based code is publicly available.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A stochastic-dynamical approach to the study of the natural variability of the climate

A method, suggested by Leith (1975), which employed stochastic-dynamic forecasts obtained from a general circulation model in such a way as to satisfy the definition of climatic noise, was used to validate assumptions accounting for the effects of external influences in estimating the climatic noise. Two assumptions were investigated: (1) that the weather fluctuations can be represented as a Markov process, and (2) that changing external conditions do not influence the atmosphere's statistical properties on short time scales. The general circulation model's simulation of the daily weather fluctuations was generated by performing integrations with prescribed climatological boundary conditions for random initial atmospheric states, with resulting dynamical forecasts providing an ensemble of simulated data for the autoregressive modeling of weather fluctuations. To estimate the climatic noise from the observational data (consisting of hourly values of sea level pressure and surface temperature at 54 U.S. stations for the month of January for the years 1949-1975) use of the short time-scale assumption is made. The simulated and observed data were found not to be consistent with either white noise or a Markov process of weather fluctuations. Good agreement was found between the results of the hypothetical testing of the simulated and the observed surface temperatures; and only partial support was found for the short time-scale assumption, i.e., for sea level pressure.

Straus, D. M.↗

A Stochastic Intracellular Model of Anthrax Infection With Spore Germination Heterogeneity

We present a stochastic mathematical model of the intracellular infection dynamics of Bacillus anthracis in macrophages. Following inhalation of B. anthracis spores, these are ingested by alveolar phagocytes. Ingested spores then begin to germinate and divide intracellularly. This can lead to the eventual death of the host cell and the extracellular release of bacterial progeny. Some macrophages successfully eliminate the intracellular bacteria and will recover. Here, a stochastic birth-and-death process with catastrophe is proposed, which includes the mechanism of spore germination and maturation of B. anthracis . The resulting model is used to explore the potential for heterogeneity in the spore germination rate, with the consideration of two extreme cases for the rate distribution: continuous Gaussian and discrete Bernoulli. We make use of approximate Bayesian computation to calibrate our model using experimental measurements from in vitro infection of murine peritoneal macrophages with spores of the Sterne 34F2 strain of B. anthracis . The calibrated stochastic model allows us to compute the probability of rupture, mean time to rupture, and rupture size distribution, of a macrophage that has been infected with one spore. We also obtain the mean spore and bacterial loads over time for a population of cells, each assumed to be initially infected with a single spore. Our results support the existence of significant heterogeneity in the germination rate, with a subset of spores expected to germinate much later than the majority. Furthermore, in agreement with experimental evidence, our results suggest that most of the spores taken up by macrophages are likely to be eliminated by the host cell, but a few germinated spores may survive phagocytosis and lead to the death of the infected cell. Finally, we discuss how this stochastic modelling approach, together with dose-response data, allows us to quantify and predict individual infection risk following exposure.

59 BASIC BIOLOGICAL SCIENCES↗

Demonstration of emulator-based Bayesian calibration of safety analysis codes: Theory and formulation

System codes for simulation of safety performance of nuclear plants may contain parameters whose values are not known very accurately. New information from tests or operating experience is incorporated into safety codes by a process known as calibration, which reduces uncertainty in the output of the code and thereby improves its support for decision-making. The work reported here implements several improvements on classic calibration techniques afforded by modern analysis techniques. The key innovation has come from development of code surrogate model (or code emulator) construction and prediction algorithms. Use of a fast emulator makes the calibration processes used here with Markov Chain Monte Carlo (MCMC) sampling feasible. This study uses Gaussian Process (GP) based emulators, which have been used previously to emulate computer codes in the nuclear field. The present work describes the formulation of an emulator that incorporates GPs into a factor analysis-type or pattern recognition-type model. This “function factorization” Gaussian Process (FFGP) model allows overcoming limitations present in standard GP emulators, thereby improving both accuracy and speed of the emulator-based calibration process. Calibration of a friction-factor example using a Method of Manufactured Solution is performed to illustrate key properties of the FFGP based process.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

New constraints on parametrised modified gravity from correlations of the CMB with large scale structure

We study the effects of modified theories of gravity on the cosmic microwave background (CMB) anisotropies power spectrum, and in particular on its large scales, where the integrated Sachs-Wolfe (ISW) effect is important. Starting with a general parametrisation, we then specialise to f(R) theories and theories with Yukawa-type interactions between dark matter particles. In these models, the evolution of the metric potentials is altered, and the contribution to the ISW effect can differ significantly from that in the standard model of cosmology. We proceed to compare these predictions with observational data for the CMB and the ISW, performing a full Monte Carlo Markov chain (MCMC) analysis. In the case of f(R) theories, the result is an upper limit on the lengthscale associated to the extra scalar degree of freedom characterising these theories. With the addition of data from the Hubble diagram of Type Ia supernovae, we obtain an upper limit on the lengthscale of the theory of B{sub 0} < 0.4, or correspondingly λ{sub 1} < 1900 Mpc/h at 95% c.l. improving previous CMB constraints. For Yukawa-type models we get a bound on the coupling 0.75 < β{sub 1} < 1.25 at the 95% c.l. We also discuss the implications of the assumed priors on the estimation of modified gravity parameters, showing that a marginally less conservative choice improves the f(R) constraints to λ{sub 1} < 1400 Mpc/h, corresponding to B{sub 0} < 0.2 at 95% c.l.

79 ASTRONOMY AND ASTROPHYSICS↗

Design of Experiments, Model Calibration and Data Assimilation

This presentation provides an overview of emulation, calibration and experiment design for computer experiments. Emulation refers to building a statistical surrogate from a carefully selected and limited set of model runs to predict unsampled outputs. The standard kriging approach to emulation of complex computer models is presented. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Markov chain Monte Carlo (MCMC) algorithms are often used to sample the calibrated parameter distribution. Several MCMC algorithms commonly employed in practice are presented, along with a popular diagnostic for evaluating chain behavior. Space-filling approaches to experiment design for selecting model runs to build effective emulators are discussed, including Latin Hypercube Design and extensions based on orthogonal array skeleton designs and imposed symmetry requirements. Optimization criteria that further enforce space-filling, possibly in projections of the input space, are mentioned. Designs to screen for important input variations are summarized and used for variable selection in a nuclear fuels performance application. This is followed by illustration of sequential experiment design strategies for optimization, global prediction, and rare event inference.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Adding GPU Support to the Markov Chain Monte Carlo Code Catmip

In geophysics, we are confronted with many under-determined inverse problems. For example, all of our observations of earthquakes are made at the Earth’s surface. So, when we try to infer how slip during an earthquake evolves in space and time, we find that there are many potential slip histories that are consistent with our limited observations and our understanding of earthquake physics. One way to approach these problems is with Bayesian analysis which allows us to infer the ensemble of all potential slip models that satisfy the observations and our prior knowledge of earthquake physics. In Bayesian analysis, our prior knowledge is known as the prior probability density function or prior PDF, the fit to the data is known as the data likelihood, and the target PDF that satisfies both the prior PDF and data likelihood is known as the posterior PDF. However, simulating the posterior PDF typically requires using Markov Chain Monte Carlo (MCMC) to draw tens of billions of random realizations of earthquake slip models, which may not be computationally feasible. To make this and similar geophysical inversions computationally tractable, we developed the Cascading Adaptive Transitional Metropolis In Parallel (CATMIP) algorithm. CATMIP is an efficient parallel Markov Chain Monte Carlo (MCMC) sampler that is used for model fitting and uncertainty quantification in geophysics. Example use cases are earthquake rupture modeling, determining mineral composition on Mars, reconstructing the history of ocean salinity, and historical earthquake relocation. CATMIP employs many parallel instances of the Metropolis algorithm for sampling in a transitioning framework. Transitioning is a process in which a set of random samples at equilibrium with a known probability density function (PDF) are used as seeds for the Markov chains to sample successive target PDFs that incrementally move the distribution from the starting seeds to the final desired PDF that describes the relative plausibility of potential values for the model parameters. The algorithm is implemented as a Master-Worker model employing MPI for communication. The worker processes are loosely coupled with global parameters periodically optimized by the master process. This provides a very high amount of parallelism with little communication between updates. During the presentation we will discuss the history of the algorithm and elaborate the earthquake rupture modeling use case for the CATMIP package. Our first step toward GPU optimization was to optimize the code for the CPU. CPU profiling revealed that most of the compute time is spent in calls to level 2 BLAS routines and calls to GSL random number generators. We revised the algorithm to employ level 3 BLAS routines instead. In our presentation we will describe how this was accomplished. Adding GPU support to CATMIP consisted mostly of replacing the calls to GSL with calls to GPU vendor-provided library routines. A small number of loops were directly implemented in CUDA. In the presentation will provide implementation details. Finally, we will discuss methods for profiling and opportunities for further optimizing GPU execution. By creating a code with the flexibility to run on either a CPU or GPU architecture, CATMIP can be used on systems ranging from large CPU-based HPC environments to single servers with GPU acceleration and everything in between.

HECC↗

Risk Analysis of the Space Shuttle: Pre-Challenger Bayeisan Prediction of Failure

Dalal et al performed a statistical analysis of field and nozzle O-ring data collected prior to the ill-fated launch of the Challenger in January 1986. The purpose of their analysis was to show how statistical analysis could be used to provide information to decisionmakers prior to the launch, information that could have been expected to lead to a decision to abort the launch due to the low temperatures (~30o F.) present at the launch pad on the morning of the scheduled launch. Dalal et al. performed a frequentist analysis of the O-ring data, and found that a logistic regression model provided a relatively good fit to the past data. In the second portion of their paper, Dalal et al. propagated parameter uncertainties through the fitted logistic regression model in order to estimate the probability of shuttle failure due to O-ring failure at the estimated launch temperature of ~30o F. Because their analysis was frequentist in nature, probability distributions representing epistemic uncertainty in the input parameters were not available, and the authors had to resort to an approximate approach based on bootstrap confidence intervals. In this paper, we will re-evaluate the analyses of Dalal et al. from a Bayesian perspective. Markov chain Monte Carlo (MCMC) sampling will be used to sample from the joint posterior distribution of the model parameters, and to sample from the posterior predictive distributions at the estimated launch temperature, a temperature that had not been observed in prior launches of the space shuttle. Uncertainties, which are represented by probability distributions in the Bayesian approach, are propagated through the model to obtain a probability distribution for O-ring failure, and subsequently for shuttle failure as a result of O-ring failure. No approximations are required in the Bayesian approach and the resulting distributions can be input to a decision analysis to obtain expected utility for the decision to launch.

42 ENGINEERING↗

Bayesian Modeling of Population Variability -- Practical Guidance and Pitfalls

With the advent of easy-to-use open-source software for Markov chain Monte Carlo (MCMC) simulation, hierarchical Bayesian analysis is gaining in popularity. This paper presents practical guidance for hierarchical Bayes analysis of typical problems in probabilistic safety assessment (PSA). The guidance is related to choosing parameterizations that accelerate convergence of the MCMC sampling and to illustrating the potential sensitivity of the results to the functional form chosen for the first-stage prior. This latter issue has significant ramifications because the mean of the average population variability curve (PVC) from hierarchical Bayes (or the mean of the point estimate distribution from empirical Bayes) can be very sensitive to this choice in cases where variability is large. Numerical examples are provided to illustrate the issues discussed.

99 GENERAL AND MISCELLANEOUS↗

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.

approximate Bayesian inference, model inversion, v↗

Adaptive Bayesian Inference for Prediction

Performing rigorous predictive simulation necessitates that all available data be incorporated into the modeling process in order to accurately quantify uncertainties in predictions of the model. Statistical Bayesian inference is the most commonly used approach for incorporating data into uncertainty estimates. Statistical Bayesian inference uses data and an assumed error model to inform posterior distributions of model input variables and model discrepancies. An explicit characterization of the posterior distribution is not formed, but rather methods such as Markov chain Monte-Carlo (MCMC) are used to draw samples from the posterior. These samples are then used to evaluate statistics, such as integrals, of predicted quantities of interest (QoI). Recently the authors have developed an alternative reformulation of Bayesian inference based upon a measure-theoretic inversion technique. Unlike traditional statistical Bayesian inference, this reformulation allows us to directly interrogate the posterior distribution and, consequently, to generate samples from the posterior without MCMC. In this work we use forward propagation uncertainty quantification techniques to reduce the cost of approximating the posterior distribution. Specifically we investigate goal-oriented adaptive sparse grid approximation methods. These adaptive methods concentrate high-fidelity model evaluations in regions of the parameter space that both significantly contribute to the uncertainty in specified QoI and are informed by the available data. Numerical results are presented to compare our approach with the standard statistical Bayesian approach and to demonstrate the effectiveness of the goal-oriented adaptivity.

97 MATHEMATICS AND COMPUTING↗

The exit-time problem for a Markov jump process

The purpose of this paper is to consider the exit-time problem for a finite-range Markov jump process, i.e, the distance the particle can jump is bounded independent of its location. Additionally, such jump diffusions are expedient models for anomalous transport exhibiting super-diffusion or nonstandard normal diffusion. We refer to the associated deterministic equation as a volume-constrained nonlocal diffusion equation. The volume constraint is the nonlocal analogue of a boundary condition necessary to demonstrate that the nonlocal diffusion equation is well-posed and is consistent with the jump process. A critical aspect of the analysis is a variational formulation and a recently developed nonlocal vector calculus. Finally, this calculus allows us to pose nonlocal backward and forward Kolmogorov equations, the former equation granting the various moments of the exit-time distribution.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Deriving Physical Properties from Broadband Photometry with Prospector: Description of the Model and a Demonstration of its Accuracy Using 129 Galaxies in the Local Universe

Broadband photometry of galaxies measures an unresolved mix of complex stellar populations, gas, and dust. Interpreting these data is a challenge for models: many studies have shown that properties derived from modeling galaxy photometry are uncertain by a factor of two or more, and yet answering key questions in the field now requires higher accuracy than this. Here, we present a new model framework specifically designed for these complexities. Our model, Prospector- α , includes dust attenuation and re-radiation, a flexible attenuation curve, nebular emission, stellar metallicity, and a six-component nonparametric star formation history. The flexibility and range of the parameter space, coupled with Monte Carlo Markov chain sampling within the Prospector inference framework, is designed to provide unbiased parameters and realistic error bars. We assess the accuracy of the model with aperture-matched optical spectroscopy, which was excluded from the fits. We compare spectral features predicted solely from fits to the broadband photometry to the observed spectral features. Our model predicts H α luminosities with a scatter of ∼0.18 dex and an offset of ∼0.1 dex across a wide range of morphological types and stellar masses. This agreement is remarkable, as the H α luminosity is dependent on accurate star formation rates, dust attenuation, and stellar metallicities. The model also accurately predicts dust-sensitive Balmer decrements, spectroscopic stellar metallicities, polycyclic aromatic hydrocarbon mass fractions, and the age- and metallicity-sensitive features D{sub n}4000 and H δ . Although the model passes all these tests, we caution that we have not yet assessed its performance at higher redshift or the accuracy of recovered stellar masses.

79 ASTRONOMY AND ASTROPHYSICS↗

BayesCLUMPY: BAYESIAN INFERENCE WITH CLUMPY DUSTY TORUS MODELS

Our aim is to present a fast and general Bayesian inference framework based on the synergy between machine learning techniques and standard sampling methods and apply it to infer the physical properties of clumpy dusty torus using infrared photometric high spatial resolution observations of active galactic nuclei. We make use of the Metropolis-Hastings Markov Chain Monte Carlo algorithm for sampling the posterior distribution function. Such distribution results from combining all a priori knowledge about the parameters of the model and the information introduced by the observations. The main difficulty resides in the fact that the model used to explain the observations is computationally demanding and the sampling is very time consuming. For this reason, we apply a set of artificial neural networks that are used to approximate and interpolate a database of models. As a consequence, models not present in the original database can be computed ensuring continuity. We focus on the application of this solution scheme to the recently developed public database of clumpy dusty torus models. The machine learning scheme used in this paper allows us to generate any model from the database using only a factor of 10{sup -4} of the original size of the database and a factor of 10{sup -3} in computing time. The posterior distribution obtained for each model parameter allows us to investigate how the observations constrain the parameters and which ones remain partially or completely undetermined, providing statistically relevant confidence intervals. As an example, the application to the nuclear region of Centaurus A shows that the optical depth of the clouds, the total number of clouds, and the radial extent of the cloud distribution zone are well constrained using only six filters. The code is freely available from the authors.

79 ASTRONOMY AND ASTROPHYSICS↗

Stochastic simulation of occupant-driven energy use in a bottom-up residential building stock model

The residential buildings sector is one of the largest electricity consumers worldwide and contributes disproportionally to peak electricity demand in many regions. Strongly driven by occupant activities, household energy consumption is stochastic and heterogeneous in nature. However, most residential energy models applied by industry use homogeneous, deterministic activity schedules, which work well for predictions of annual energy consumption, but can result in unrealistic hourly or sub-hourly electric load profiles, with exaggerated or muted peaks. The increasing proportion of variable renewable energy generators means that representing the heterogeneity and stochasticity of occupant behavior is now crucial for reliable planning at both bulk-power and distribution-system scales. This work presents a novel and open-source occupancy simulation approach that can simulate a diverse set of individual occupant and household event schedules for all major electricity, fuel, and hot water end uses. To accomplish this, we evaluated three alternative occupant activity simulation approaches before selecting a hybrid combining time-inhomogeneous Markov chains and probability-sampling of event durations and magnitudes. Further, we integrated the stochastic occupancy simulation with an open-source bottom-up physics-simulation building stock model and published a set of 550,000 diverse household end-use activity schedules representing a national housing stock. The simulator was verified against time-use survey data, and simulation results were validated against measured end-use electricity data for accuracy and reliability. While we use data for the United States, our application demonstrates how similar approaches could be applied using the time-use survey data collected in many countries around the world.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

First study of reionization in the Planck 2015 normalized closed ΛCDM inflation model

We study reionization in two non-flat ΛCDM inflation models that best fit the Planck 2015 cosmic microwave background (CMB) anisotropy observations, ignoring or in conjunction with baryon acoustic oscillation distance measurements. We implement a principal component analysis (PCA) to estimate the uncertainties in the reionization history from a joint quasar–CMB data set. A thorough Markov Chain Monte Carlo analysis is done over the parameter space of the PCA modes for both non-flat ΛCDM inflation models as well as the original Planck 2016 tilted, spatially flat ΛCDM inflation model. Although both flat and non-flat models can closely match the low-redshift ( z ≲ 6) observations, we notice a possible tension between high-redshift ( z ~ 8) Lyman α emitter data and the non-flat models. This is solely due to the fact that the closed models have a relatively higher reionization optical depth compared to the flat one, which in turn demands more high-redshift ionizing sources and favours an extended reionization starting as early as z ≈ 14. We conclude that as opposed to flat cosmology, for the non-flat cosmology models (i) the escape fraction needs steep redshift evolution and even unrealistically high values at some redshifts and (ii) most of the physical parameters require to have non-monotonic redshift evolution, especially apparent when Lyman α emitter data are included in the analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Stimulated ionization scattering of a wave beam forming a discharge channel in a magnetic mirror trap

The stimulated scattering of a whistler wave beam forming an extended discharge channel in a magnetic mirror trap is discovered and investigated experimentally. It is shown that the beam is scattered by relaxaction oscillations of the lattice of plasma inhomogeneities excited by the beam field. The spectrum of the pump field in the RF discharge plasma is found to broaden considerably and to contain individual modulation peaks corresponding to lattice oscillations. The peaks are observed at working gas pressures at which the electron mean free path is close to the wavelength of the standing wave forming the discharge channel. A physical model describing the phenomena observed is developed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗