Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Sanov and central limit theorems for output statistics of quantum Markov chains

In this paper, we consider the statistics of repeated measurements on the output of a quantum Markov chain. We establish a large deviations result analogous to Sanov’s theorem for the multi-site empirical measure associated to finite sequences of consecutive outcomes of a classical stochastic process. Our result relies on the construction of an extended quantum transition operator (which keeps track of previous outcomes) in terms of which we compute moment generating functions, and whose spectral radius is related to the large deviations rate function. As a corollary to this, we obtain a central limit theorem for the empirical measure. Such higher level statistics may be used to uncover critical behaviour such as dynamical phase transitions, which are not captured by lower level statistics such as the sample mean. As a step in this direction, we give an example of a finite system whose level-1 (empirical mean) rate function is independent of a model parameter while the level-2 (empirical measure) rate is not.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Uncertainty Quantification in Climate Modeling and Projection

The projection of future climate is one of the most complex problems undertaken by the scientific community. Although scientists have been striving to better understand the physical basis of the climate system and to improve climate models, the overall uncertainty in projections of future climate has not been significantly reduced (e.g., from the IPCC AR4 to AR5). With the rapid increase of complexity in Earth system models, reducing uncertainties in climate projections becomes extremely challenging. Since uncertainties always exist in climate models, interpreting the strengths and limitations of future climate projections is key to evaluating risks, and climate change information for use in Vulnerability, Impact, and Adaptation (VIA) studies should be provided with both well-characterized and well-quantified uncertainty. The workshop reported herein aimed at providing participants, many of them from developing countries, information on strategies to quantify the uncertainty in climate model projections and assess the reliability of climate change information for decision-making. The program included a mixture of lectures on fundamental concepts in Bayesian inference and sampling, applications, and hands-on computer laboratory exercises employing software packages for Bayesian inference, Markov Chain Monte Carlo methods, and global sensitivity analyses. The lectures covered a range of scientific issues underlying the evaluation of uncertainties in climate projections, such as the effects of uncertain initial and boundary conditions, uncertain physics, and limitations of observational records. Progress in quantitatively estimating uncertainties in hydrologic, land surface, and atmospheric models at both regional and global scales was also reviewed. The application of Uncertainty Quantification (UQ) concepts to coupled climate system models is still in its infancy. The Coupled Model Intercomparison Project (CMIP) multi-model ensemble currently represents the primary data for assessing reliability and uncertainties of climate change information. An alternative approach is to generate similar ensembles by perturbing parameters within a single-model framework. One of workshop’s objectives was to give participants a deeper understanding of these approaches within a Bayesian statistical framework. However, there remain significant challenges still to be resolved before UQ can be applied in a convincing way to climate models and their projections.

54 ENVIRONMENTAL SCIENCES↗

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗

SU-F-R-44: Modeling Lung SBRT Tumor Response Using Bayesian Network Averaging

Purpose: The prediction of tumor control after a patient receives lung SBRT (stereotactic body radiation therapy) has proven to be challenging, due to the complex interactions between an individual’s biology and dose-volume metrics. Many of these variables have predictive power when combined, a feature that we exploit using a graph modeling approach based on Bayesian networks. This provides a probabilistic framework that allows for accurate and visually intuitive predictive modeling. The aim of this study is to uncover possible interactions between an individual patient’s characteristics and generate a robust model capable of predicting said patient’s treatment outcome. Methods: We investigated a cohort of 32 prospective patients from multiple institutions whom had received curative SBRT to the lung. The number of patients exhibiting tumor failure was observed to be 7 (event rate of 22%). The serum concentration of 5 biomarkers previously associated with NSCLC (non-small cell lung cancer) was measured pre-treatment. A total of 21 variables were analyzed including: dose-volume metrics with BED (biologically effective dose) correction and clinical variables. A Markov Chain Monte Carlo technique estimated the posterior probability distribution of the potential graphical structures. The probability of tumor failure was then estimated by averaging the top 100 graphs and applying Baye’s rule. Results: The optimal Bayesian model generated throughout this study incorporated the PTV volume, the serum concentration of the biomarker EGFR (epidermal growth factor receptor) and prescription BED. This predictive model recorded an area under the receiver operating characteristic curve of 0.94(1), providing better performance compared to competing methods in other literature. Conclusion: The use of biomarkers in conjunction with dose-volume metrics allows for the generation of a robust predictive model. The preliminary results of this report demonstrate that it is possible to accurately model the prognosis of an individual lung SBRT patient’s treatment.

60 APPLIED LIFE SCIENCES↗

A Reanalysis of Public Galactic Bulge Gravitational Microlensing Events from OGLE-III and -IV

Abstract Modern surveys of gravitational microlensing events have progressed to detecting thousands per year, and surveys are capable of probing Galactic structure, stellar evolution, lens populations, black hole physics, and the nature of dark matter. One of the key avenues for doing this is the microlensing Einstein radius crossing time (t E) distribution. However, systematics in individual light curves as well as oversimplistic modeling can lead to biased results. To address this, we developed a model to simultaneously handle the microlensing parallax due to Earth's motion, systematic instrumental effects, and unlensed stellar variability with a Gaussian process model. We used light curves for nearly 10,000 OGLE-III and -IV Milky Way bulge microlensing events and fit each with our model. We also developed a forward model approach to infer the t E distribution by forward modeling from the data rather than using point estimates from individual events. We find that modeling the variability in the baseline removes a source of significant bias in individual events, and the previous analyses overestimated the number of t E > 100 day events due to their oversimplistic model ignoring parallax effects. We use our fits to identify the hundreds filling a regime in the microlensing parameter space that are 50% pure of black holes. Finally, we have released the largest-ever catalog of Markov Chain Monte Carlo parameter estimates for microlensing events.

79 ASTRONOMY AND ASTROPHYSICS↗

Robust estimation of charge carrier diffusivity using transient photoluminescence microscopy

Transient microscopy has emerged as a powerful tool for imaging the diffusion of excitons and free charge carriers in optoelectronic materials. In many excitonic materials, extraction of diffusion coefficients can be simplified because of the linear relationship between signal intensity and local excited state population. However, in materials where transport is dominated by free charge carriers, extracting diffusivities accurately from multidimensional data is complicated by the nonlinear dependence of the measured signal on the local charge carrier density. To obtain accurate estimates of charge carrier diffusivity from transient microscopy data, statistically robust fitting algorithms coupled to efficient 3D numerical solvers that faithfully relate local carrier dynamics to raw experimental measurables are sometimes needed. Here, we provide a detailed numerical framework for modeling the spatiotemporal dynamics of free charge carriers in bulk semiconductors with significant solving speed reduction and for simulating the corresponding transient photoluminescence microscopy data. To demonstrate the utility of this approach, we apply a fitting algorithm using a Markov chain Monte Carlo sampler to experimental data on bulk CdS and methylammonium lead bromide (MAPbBr 3 ) crystals. Parameter analyses reveal that transient photoluminescence microscopy can be used to obtain robust estimates of charge carrier diffusivities in optoelectronic materials of interest, but that other experimental approaches should be used for obtaining carrier recombination constants. Additionally, simplifications can be made to the fitting model depending on the experimental conditions and material systems studied. Our open-source simulation code and fitting algorithm are made freely available to the scientific community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Probabilistic constrained Bayesian inversion for transpiration cooling

Abstract To enable safe operations in applications such as rocket combustion chambers, the materials require cooling to avoid material damage. Here, transpiration cooling is a promising cooling technique. Numerous studies investigate possibilities to simulate and evaluate the complex cooling mechanism. One naturally arising question is the amount of coolant required to ensure a safe operation. To study this, we introduce an approach that determines the posterior probability distribution of the Reynolds number using an inverse problem and constraining the maximum temperature of the system under parameter uncertainties. Mathematically, this chance inequality constraint is dealt with by a generalized polynomial chaos expansion of the system. The posterior distribution will be evaluated by different Markov chain Monte Carlo based methods. A novel method for the constrained case is proposed and tested among others on two‐dimensional transpiration cooling models.

97 MATHEMATICS AND COMPUTING↗

RECONSTRUCTING THE INITIAL DENSITY FIELD OF THE LOCAL UNIVERSE: METHODS AND TESTS WITH MOCK CATALOGS

Our research objective in this paper is to reconstruct an initial linear density field, which follows the multivariate Gaussian distribution with variances given by the linear power spectrum of the current cold dark matter model and evolves through gravitational instabilities to the present-day density field in the local universe. For this purpose, we develop a Hamiltonian Markov Chain Monte Carlo method to obtain the linear density field from a posterior probability function that consists of two components: a prior of a Gaussian density field with a given linear spectrum and a likelihood term that is given by the current density field. The present-day density field can be reconstructed from galaxy groups using the method developed in Wang et al. Using a realistic mock Sloan Digital Sky Survey DR7, obtained by populating dark matter halos in the Millennium simulation (MS) with galaxies, we show that our method can effectively and accurately recover both the amplitudes and phases of the initial, linear density field. To examine the accuracy of our method, we use N-body simulations to evolve these reconstructed initial conditions to the present day. The resimulated density field thus obtained accurately matches the original density field of the MS in the density range 0.3{approx}<{rho}/ {rho}-bar {approx}<20 without any significant bias. In particular, the Fourier phases of the resimulated density fields are tightly correlated with those of the original simulation down to a scale corresponding to a wavenumber of {approx}1 h Mpc{sup -1}, much smaller than the translinear scale, which corresponds to a wavenumber of {approx}0.15 h Mpc{sup -1}.

79 ASTRONOMY AND ASTROPHYSICS↗

Non-Markovian disentanglement dynamics of a two-qubit system

We investigate the disentanglement dynamics of a two-qubit system in the non-Markovian approach. It is shown that only for weak coupling between the system and environment does an exponential decay of entanglement appear, for certain classes of two-qubit entangled states. When the coupling between qubit and the environment becomes stronger, entanglement sudden death always appears even if the dissipation environment is at zero temperature.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sampling rare fluctuations of discrete-time Markov chains

We describe a simple method that can be used to sample the rare fluctuations of discrete-time Markov chains. Here, we focus on the case of Markov chains with well-defined steady-state measures, and derive expressions for the large-deviation rate functions (and upper bounds on such functions) for dynamical quantities extensive in the length of the Markov chain. We illustrate the method using a series of simple examples, and use it to study the fluctuations of a lattice-based model of active matter that can undergo motility-induced phase separation.

79 ASTRONOMY AND ASTROPHYSICS↗

Training Restricted Boltzmann Machines With a D-Wave Quantum Annealer

Restricted Boltzmann Machine (RBM) is an energy-based, undirected graphical model. It is commonly used for unsupervised and supervised machine learning. Typically, RBM is trained using contrastive divergence (CD). However, training with CD is slow and does not estimate the exact gradient of the log-likelihood cost function. In this work, the model expectation of gradient learning for RBM has been calculated using a quantum annealer (D-Wave 2000Q), where obtaining samples is faster than Markov chain Monte Carlo (MCMC) used in CD. Training and classification results of RBM trained using quantum annealing are compared with the CD-based method. The performance of the two approaches is compared with respect to the classification accuracies, image reconstruction, and log-likelihood results. The classification accuracy results indicate comparable performances of the two methods. Image reconstruction and log-likelihood results show improved performance of the CD-based method. It is shown that the samples obtained from quantum annealer can be used to train an RBM on a 64-bit “bars and stripes” dataset with classification performance similar to an RBM trained with CD. Though training based on CD showed improved learning performance, training using a quantum annealer could be useful as it eliminates computationally expensive MCMC steps of CD.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An MCMC Study of General Squark Flavour Mixing in the MSSM

We present an extensive study of non-minimally flavour violating (NMFV) terms in the Lagrangian of the Minimal Supersymmetric Standard Model (MSSM). We impose a variety of theoretical and experimental constraints and perform a detailed scan of the parameter space by means of a Markov Chain Monte-Carlo (MCMC) setup. This represents the first study of several non-zero flavour-violating elements within the MSSM. We present the results of the MCMC scan with a special focus on the flavour-violating parameters. Based on these results, we define benchmark scenarios for future studies of NMFV effects at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Performance and state-space analyses of systems using Petri nets

The goal of any modeling methodology is to develop a mathematical description of a system that is accurate in its representation and also permits analysis of structural and/or performance properties. Inherently, trade-offs exist between the level detail in the model and the ease with which analysis can be performed. Petri nets (PN's), a highly graphical modeling methodology for Discrete Event Dynamic Systems, permit representation of shared resources, finite capacities, conflict, synchronization, concurrency, and timing between state changes. By restricting the state transition time delays to the family of exponential density functions, Markov chain analysis of performance problems is possible. One major drawback of PN's is the tendency for the state-space to grow rapidly (exponential complexity) compared to increases in the PN constructs. It is the state space, or the Markov chain obtained from it, that is needed in the solution of many problems. The theory of state-space size estimation for PN's is introduced. The problem of state-space size estimation is defined, its complexities are examined, and estimation algorithms are developed. Both top-down and bottom-up approaches are pursued, and the advantages and disadvantages of each are described. Additionally, the author's research in non-exponential transition modeling for PN's is discussed. An algorithm for approximating non-exponential transitions is developed. Since only basic PN constructs are used in the approximation, theory already developed for PN's remains applicable. Comparison to results from entropy theory show the transition performance is close to the theoretic optimum. Inclusion of non-exponential transition approximations improves performance results at the expense of increased state-space size. The state-space size estimation theory provides insight and algorithms for evaluating this trade-off.

Watson, James Francis, III↗

A simple stochastic quadrant model for the transport and deposition of particles in turbulent boundary layers

We present a simple stochastic quadrant model for calculating the transport and deposition of heavy particles in a fully developed turbulent boundary layer based on the statistics of wall-normal fluid velocity fluctuations obtained from a fully developed channel flow. Individual particles are tracked through the boundary layer via their interactions with a succession of random eddies found in each of the quadrants of the fluid Reynolds shear stress domain in a homogeneous Markov chain process. In this way, we are able to account directly for the influence of ejection and sweeping events as others have done but without resorting to the use of adjustable parameters. Deposition rate predictions for a wide range of heavy particles predicted by the model compare well with benchmark experimental measurements. In addition, deposition rates are compared with those obtained from continuous random walk models and Langevin equation based ejection and sweep models which noticeably give significantly lower deposition rates. Various statistics related to the particle near wall behavior are also presented. Finally, we consider the model limitations in using the model to calculate deposition in more complex flows where the near wall turbulence may be significantly different.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Statistics of X-ray flares of Sagittarius A{sup ⋆}: Evidence for solar-like self-organized criticality phenomena

X-ray flares have routinely been observed from the supermassive black hole at our Galactic center, Sagittarius A{sup ⋆} (Sgr A{sup ⋆}). The nature of these flares remains largely unclear, despite many theoretical models. In this paper, we study the statistical properties of the Sgr A{sup ⋆} X-ray flares by fitting the count rate (CR) distribution and the structure function of the light curve with a Markov Chain Monte Carlo method. With the 3-million-second Chandra observations accumulated in the Sgr A{sup ⋆} X-ray Visionary Project, we construct the theoretical light curves through Monte Carlo simulations. We find that the 2–8 keV X-ray light curve can be decomposed into a quiescent component with a constant CR of 6×10{sup −3} count s{sup −1} and a flare component with a power-law fluence distribution dN/dE∝E{sup −α{sub E}} with α{sub E}=1.65±0.17. The duration–fluence correlation can also be modeled as a power law T∝E{sup α{sub E}{sub T}} with α{sub ET}<0.55 (95% confidence). These statistical properties are consistent with the theoretical prediction of the self-organized criticality system with the spatial dimension S = 3. We suggest that the X-ray flares represent plasmoid ejections driven by magnetic reconnection (similar to solar flares) in the accretion flow onto the black hole.

79 ASTRONOMY AND ASTROPHYSICS↗

Using Black Hole Mergers to Explore Structure Formation

Observations of gravitational waves from massive black hole mergers will open a new window into the era of structure formation in the early universe. Past efforts have concentrated on calculating merger rates using different physical assumptions, resulting in merger rate estimates that span a wide range (0.1 - 1 0A4 mergers/year). We develop a semi-analytical, phenomenological model of massive black hole mergers that includes plausible combinations of several physical parameters, which we then turn around to determine how well observations with the Laser Interferometer Space Antenna (LISA) will be able to enhance our understanding of the universe during the critical z approx. 5 - 30 epoch. Our approach involves generating synthetic LISA observable data (total BH masses, BH mass ratios, redshifts, merger rates), which are then analyzed using a Markov Chain Monte Carlo method, thus finding constraints for the physical parameters of the mergers. We find that our method works well at estimating merger parameters and that the number of merger events is a key discriminant among models, therefore making our method robust against observational uncertainties. Our approach can also be extended to more physically-driven models and more general problems in cosmology.

Alicea-Munoz, E.↗

A NEW METHOD TO DIRECTLY MEASURE THE JEANS SCALE OF THE INTERGALACTIC MEDIUM USING CLOSE QUASAR PAIRS

Although the baryons in the intergalactic medium (IGM) trace dark matter fluctuations on megaparsec scales, on smaller scales ∼100 kpc, fluctuations are suppressed because the finite temperature gas is pressure supported against gravity, analogous to the classical Jeans argument. This Jeans filtering scale, which quantifies the small-scale structure of the IGM, has fundamental cosmological implications. First, it provides a thermal record of heat injected by ultraviolet photons during cosmic reionization events, and thus constrains the thermal and reionization history of the universe. Second, the Jeans scale determines the clumpiness of the IGM, a critical ingredient in models of cosmic reionization. Third, it sets the minimum mass scale for gravitational collapse from the IGM, and hence plays a pivotal role in galaxy formation. Unfortunately, it is extremely challenging to measure the Jeans scale via the standard technique of analyzing purely longitudinal Lyα forest spectra, because the thermal Doppler broadening of absorption lines along the line-of-sight, is highly degenerate with Jeans smoothing. In this work, we show that the Jeans filtering scale can be directly measured by characterizing the coherence of correlated Lyα forest absorption in close quasar pairs, with separations small enough ∼100 kpc to resolve it. We present a novel technique for this purpose, based on the probability density function (PDF) of phase angle differences of homologous longitudinal Fourier modes in close quasar pair spectra. A Bayesian formalism is introduced based on the phase angle PDF, and Markov Chain Monte Carlo techniques are used to characterize the precision of a hypothetical Jeans scale measurement, and explore degeneracies with other thermal parameters governing the IGM. A semi-analytical model of the Lyα forest is used to generate a large grid (500) of thermal models from a dark matter only simulation. Our full parameter study indicates that a realistic sample of only 20 close quasar pair spectra can pinpoint the Jeans scale to ≅ 5% precision, independent of the amplitude T{sub 0} and slope γ of the temperature-density relation of the IGM T=T{sub 0}(ρ/ ρ-bar ){sup γ-1}. This exquisite sensitivity arises because even long-wavelength one-dimensional Fourier modes ∼10 Mpc, i.e., two orders of magnitude larger than the Jeans scale, are nevertheless dominated by projected small-scale three-dimensional (3D) power. Hence phase angle differences between all modes of quasar pair spectra actually probe the shape of the 3D power spectrum on scales comparable to the pair separation. We show that this new method for measuring the Jeans scale is unbiased and is insensitive to a battery of systematics that typically plague Lyα forest measurements, such as continuum fitting errors, imprecise knowledge of the noise level and/or spectral resolution, and metal-line absorption.

79 ASTRONOMY AND ASTROPHYSICS↗

Transitions in genetic toggle switches driven by dynamic disorder in rate coefficients

In biochemical systems, intrinsic noise may drive the system switch from one stable state to another. We investigate how kinetic switching between stable states in a bistable network is influenced by dynamic disorder, i.e., fluctuations in the rate coefficients. Using the geometric minimum action method, we first investigate the optimal transition paths and the corresponding minimum actions based on a genetic toggle switch model in which reaction coefficients draw from a discrete probability distribution. For the continuous probability distribution of the rate coefficient, we then consider two models of dynamic disorder in which reaction coefficients undergo different stochastic processes with the same stationary distribution. In one, the kinetic parameters follow a discrete Markov process and in the other they follow continuous Langevin dynamics. We find that regulation of the parameters modulating the dynamic disorder, as has been demonstrated to occur through allosteric control in bistable networks in the immune system, can be crucial in shaping the statistics of optimal transition paths, transition probabilities, and the stationary probability distribution of the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗