Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MARKOV PROCESS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Cluster dynamics modelling of materials: A new hybrid deterministic/stochastic coupling approach

Deterministic simulations of the rate equations governing cluster dynamics in materials are limited by the number of equations to integrate. Stochastic simulations are limited by the high frequency of certain events. We propose a coupling method combining deterministic and stochastic approaches. It allows handling different time scale phenomena for cluster dynamics. This method, based on a splitting of the dynamics, is generic and we highlight two different hybrid deterministic/stochastic methods. These coupling schemes are highly parallelizable and specifically designed to treat large size cluster problems. The proof of concept is made on a simple model of vacancy clustering under thermal ageing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

GraMeR: Gra ph Me ta R einforcement learning for multi-objective influence maximization

Influence maximization (IM) is a combinatorial problem of identifying a subset of seed nodes in a network (graph), which when activated, provide a maximal spread of influence in the network for a given diffusion model and a budget for seed set size. IM has numerous applications such as viral marketing, epidemic control, sensor placement and other network-related tasks. However, its practical uses are limited due to the computational complexity of current algorithms. Recently, deep reinforcement learning has been leveraged to solve IM in order to ease the computational burden. However, there are serious limitations in current approaches, including narrow IM formulation that only consider influence via spread and ignore self-activation, low scalability to large graphs, and lack of generalizability across graph families leading to a large running time for every test network. In this work, we address these limitations through a unique approach that involves: (1) Formulating a generic IM problem as a Markov decision process that handles both intrinsic and influence activations; (2)incorporating generalizability via meta-learning across graph families. There are previous works that combine deep reinforcement learning with graph neural network, but this work solves a more realistic IM problem and incorporates generalizability across graphs via meta reinforcement learning. Extensive experiments are carried out in various standard networks to validate performance of the proposed Graph Meta Reinforcement learning (GraMeR) framework. Finally, the results indicate that GraMeR is multiple orders faster and generic than conventional approaches when applied on small to medium scale graphs.

97 MATHEMATICS AND COMPUTING↗

Timing of testing and treatment for asymptomatic diseases

Many papers in the medical literature analyze the cost-effectiveness of screening for diseases by comparing a limited number of a priori testing policies under estimated problem parameters. However, this may be insufficient to determine the best timing of the tests or incorporate changes over time. In this paper, we develop and solve a Markov Decision Process (MDP) model for a simple class of asymptomatic diseases in order to provide the building blocks for analysis of a more general class of diseases. We provide a computationally efficient method for determining a cost-effective dynamic intervention strategy that takes into account (i) the results of the previous test for each individual and (ii) the change in the individual’s behavior based on awareness of the disease. We demonstrate the usefulness of the approach by applying the results to screening decisions for Hepatitis C (HCV) using medical data, and compare our findings to current HCV screening recommendations.

59 BASIC BIOLOGICAL SCIENCES↗

Night-time naturally ventilated offices: Statistical simulations of window-use patterns from field monitoring

This paper investigates occupant behaviour of window-use in night-time naturally ventilated offices on the basis of a pilot field study, conducted during the summers of 2006 and 2007 in Cambridge, UK, and then demonstrates the effects of employing night-time ventilation on indoor thermal conditions using predictive models of occupant window-use. A longitudinal field study shows that occupants make good use of night-time natural ventilation strategies when provided with openings that allow secure ventilation, and that there is a noticeable time of day effect in window-use patterns (i.e. increased probability of action on arrival and departure). We develop logistic models of window-use for night-time naturally ventilated offices, which are subsequently applied to a behaviour algorithm, including Markov chains and Monte Carlo methods. The simulations using the behaviour algorithm demonstrate a good agreement with the observational data of window-use, and reveal how building design and occupant behaviour collectively affect the thermal performance of offices. They illustrate that the provision of secure ventilation leads to more frequent use of the window, and thus contributes significantly to the achievement of a comfortable indoor environment during the daytime occupied period. For example, the maximum temperature for a night-time ventilated office is found to be 3 C below the predicted value for a daytime-only ventilated office. (author)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A stochastic method for stand-alone photovoltaic system sizing

Photovoltaic systems utilize solar energy to generate electrical energy to meet load demands. Optimal sizing of these systems includes the characterization of solar radiation. Solar radiation at the Earth's surface has random characteristics and has been the focus of various academic studies. The objective of this study was to stochastically analyze parameters involved in the sizing of photovoltaic generators and develop a methodology for sizing of stand-alone photovoltaic systems. Energy storage for isolated systems and solar radiation were analyzed stochastically due to their random behavior. For the development of the methodology proposed stochastic analysis were studied including the Markov chain and beta probability density function. The obtained results were compared with those for sizing of stand-alone using from the Sandia method (deterministic), in which the stochastic model presented more reliable values. Both models present advantages and disadvantages; however, the stochastic one is more complex and provides more reliable and realistic results. (author)

14 SOLAR ENERGY↗

Bayesian population analysis of a washin-washout physiologically based pharmacokinetic model for acetone

The aim of this study was to derive improved estimates of population variability and uncertainty of physiologically based pharmacokinetic (PBPK) model parameters, especially of those related to the washin-washout behavior of polar volatile substances. This was done by optimizing a previously published washin-washout PBPK model for acetone in a Bayesian framework using Markov chain Monte Carlo simulation. The sensitivity of the model parameters was investigated by creating four different prior sets, where the uncertainty surrounding the population variability of the physiological model parameters was given values corresponding to coefficients of variation of 1%, 25%, 50%, and 100%, respectively. The PBPK model was calibrated to toxicokinetic data from 2 previous studies where 18 volunteers were exposed to 250-550 ppm of acetone at various levels of workload. The updated PBPK model provided a good description of the concentrations in arterial, venous, and exhaled air. The precision of most of the model parameter estimates was improved. New information was particularly gained on the population distribution of the parameters governing the washin-washout effect. The results presented herein provide a good starting point to estimate the target dose of acetone in the working and general populations for risk assessment purposes.

60 APPLIED LIFE SCIENCES↗

Stochastic quantization for complex actions

We use the stochastic quantization method to study systems with complex valued path integral weights. We assume a Langevin equation with a memory kernel and Einstein's relations with colored noise. The equilibrium solution of this non-Markovian Langevin equation is analyzed. We show that for a large class of elliptic non-Hermitian operators acting on scalar functions on Euclidean space, which define different models in quantum field theory, converge to an equilibrium state in the asymptotic limit of the Markov parameter {tau}{yields}{infinity}. Moreover, as we expected, we obtain the Schwinger functions of the theory.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stopping Power of Different Ions in Si Measured with a Bulk Sample Method and Bayesian Inference Data Analysis

The accuracy of ion beam analysis experiments depends critically on the stopping power values available. While for H and He ions accuracies normally better than 5% are achieved by usual interpolative schemes such as SRIM, for heavier ions the accuracy is worse. One of the main reasons is that the experimental data bases are very sparse, even for important materials such as Si. New measurements are therefore needed. Measurement of stopping power is often made with transmission in thin films, with the usual problems of film thickness homogeneity. We have previously developed an alternative method based on measuring bulk spectra, and fitting the yield by treating the stopping power as a fit parameter in a Bayesian inference Markov chain Monte Carlo procedure included in the standard IBA code NDF. We report on improvements of the method and on its application to the determination of the stopping power of {sup 7}Li in Si. To validate the method, we also apply it to the stopping of {sup 4}He in Si, which is known with 2% accuracy.

36 MATERIALS SCIENCE↗

Quantum Filtering and Control in Example: Unstable Qubits

A brief account of the quantum unstable controlled dynamics admitting continuous demolition measurement is given. The dynamical programming method for optimization of quantum control with convex constraints and concave cost functions of quantum conditional state is presented. Consideration is given to open loop control corresponding to deterministic conditionally-Markov dynamics of a quantum unstable system. A single controlled decaying qubit conditioned by its survival is considered as an example.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A self-consistent treatment of electron transfer in the limit of strong friction via the mixed quantum classical Liouville method

Electron transfer is investigated at the limit of strong friction. The analysis is based on the generic model of a two-state system bilinearly coupled to a harmonic bath. The dynamics is described within the framework of the mixed quantum classical Liouville (MQCL) equation, which is known to be exact for this model. In the case of zero electronic coupling, it is shown that while the dynamics of the electronic populations can be described by a Markovian quantum Smoluchowski equation, that of the electronic coherences are inherently non-Markovian. A non-Markovian modified Zusman equation is derived in the presence of electronic coupling and shown to be self-consistent in cases where the standard Zusman equation is not.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Non-Markovian Effects in Turbulent Diffusion in Magnetized Plasmas

The derivation of the kinetic equations for inhomogeneous plasma in an external magnetic field is presented. The Fokker-Planck-type equations with the non-Markovian kinetic coefficients are proposed. In the time-local limit (small correlation times with respect to the distribution function relaxation time) the relations obtained recover the results known from the appropriate quasilinear theory and the Dupree-Weinstock theory of plasma turbulence. The equations proposed are used to describe zonal flow generation and to estimate the diffusion coefficient for saturated turbulence.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Friction-induced Resonance of a Stochastic Oscillator

The influence of the friction coefficient on the long-time behavior of the output signal of a harmonic oscillator with fluctuating frequency subjected to an external periodic force and an additive thermal noise is considered. The colored fluctuations of the oscillator frequency are modeled as a three-level Markovian telegraph noise. The main purpose of this work is to demonstrate, based on exact expressions, that the resonance is manifested in the dependence of the response function and the complex susceptibility of the oscillator upon the friction coefficient. The advantage of the latter effect is that the control parameter is the damping coefficient, which can easily be varied in possible experiments as well as potential technological applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Turbulent Transport in Fusion Plasmas, Effects of Toroidicity and Fluid Closure

Basic aspects of turbulent transport in toroidal magnetized plasmas are discussed. In particular Kadomtsev's mixing length estimate is found to work well for the Cyclone base case at the experimental gradient. Generalizations to include non-Markovian effects and off diagonal fluxes are given. The importance of toroidal effects is stressed These enter particularly strongly in convective or off diagonal fluxes. This feature applies also to momentum ttransport.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Pati-Salam Supersymmetric SM (PSSSM)

Grand Unified Theories based on an E{sub 6} gauge group embed all Higgs- and matter fields within one 27 dimensional fundamental representation. In addition each 27 contains a right handed neutrino, an NMSSM-like standard model singlet and a pair of exotic particles, that couple quarks to leptons. The extended particle content spoils simple gauge unification as in the MSSM. By embedding the SM into a Pati-Salam gauge group above 10{sup 16} GeV, one obtains a unification below the Planck-scale. We present a Markov chain Monte-Carlo algorithm to systematically scan the high dimensional parameter space and calculate low-energy spectra, as well as first results of our studies of the LHC phenomenology of leptoquarks and leptoquarkinos with the event generator WHIZARD.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Extraction of the Susy and Higgs parameters

If supersymmetry is discovered by the next generation of collider experiments, it will be crucial to determine its fundamental high-scale parameters. Three scenarios have been recently investigated by the SFitter collaboration : the case where the LHC 'only' measures a light Higgs like signal, the case where SUSY signal are discovered at the LHC, and the dream scenario, where LHC and ILC measurements can be combined.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

MonteCUBES

We introduce the software package MonteCUBES, which is designed to easily and effectively perform Markov Chain Monte Carlo simulations for analyzing neutrino oscillation experiments. We discuss the methods used in the software as well as why we believe that it is particularly useful for simulating new physics effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Noncommutative Poisson boundaries of unital quantum operations

In this paper, Poisson boundaries of unital quantum operations (also called Markov operators) are investigated. In the case of unital quantum channels, compact operators belonging to Poisson boundaries are characterized. Using the characterization of amenable groups by the injectivity of their von Neumann algebras, we will answer negatively some conjectures appearing in the work of Arias et al. ['Fixed points of quantum operations', J. Math. Phys. 43, 5872 (2002)] about injectivity of the commuting algebra of the Kraus operators of unital quantum operations and their injective envelopes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗