Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Analysis of the methods for the derivation of binary kinetic equations in the theory of fluorescence concentration quenching

In the framework of unified many-particle approach the familiar problem of fluorescence concentration quenching in the presence of pumping (light pulse) of arbitrary intensity is considered. This process is a vivid and the simplest example of multistage bulk reaction including bimolecular irreversible quenching reaction and reversible monomolecular transformation as elementary stages. General relation between the kinetics of multistage bulk reaction and that of the elementary stage of quenching has been established. This allows one to derive general kinetic equations (of two types) for the multistage reaction in question on the basis of general kinetic equations (differential and integro-differential) of elementary stage of quenching. Relying on the same unified many-particle approach we have developed binary approximations with the use of two (frequently employed in the literature) many-particle methods (such as simple superposition approximation and the method of extracting pair channels in three-particle correlation evolution) to the derivation of non-Markovian binary kinetic equations. The possibility of reducing the obtained binary equations to the Markovian equations of formal chemical kinetics has been considered. As an example the exact solution of the problem (for the specific case) is examined, and the applicability of two many particle methods of derivation of binary equations is analyzed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Influence of neighboring levels in three-pulse photon-echo processes

It is the purpose of the present paper to study the dynamics underlying a three-pulse photon-echo process performed on a vibronic system coupled to non-Markovian baths, when a neighboring level enters into the global dynamical evolution because of broadband excitation required in these experiments. Particular emphasis is on the energy gap between the vibronic levels, but also on the fluctuation amplitudes and correlation times of their corresponding thermal baths. The photon-echo signal appears to be very sensitive to the additional interfering contributions introduced by the neighboring vibronic level. It is shown that these contributions associated to the pathways involving different vibronic states are modulated by their corresponding energy gap. As a consequence, these contributions to the integrated photon-echo signal strongly decrease for large energy gaps. Also, an oscillating behavior is observed on the time dependence of the photon-echo signal resulting from the summation of the contributions provided by the individual vibronic levels. Moreover, the influence of the non-Markovian character of the baths, accountable for inhomogeneous broadening, affects the amplitude and the time dependence of the photon-echo signal, as well as its dependence with the delay time of the laser pulses. Of course, for longer times a Markovian dynamical evolution is recovered.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Long range excitonic transport in a biomimetic system inspired by the bacterial light-harvesting apparatus

Photosynthesis, the process by which energy from sunlight drives cellular metabolism, relies on a unique organization of light-harvesting and reaction center complexes. Recently, the organization of light-harvesting LH2 complexes and dimeric reaction center-light-harvesting I-PufX core complexes in membranes of purple non-sulfur bacteria was revealed by atomic force microscopy [S. Bahatyrova et al., Nature (London) 430, 1058 (2004)]. Here, we discuss optimal exciton transfer in a biomimetic system closely modeled on the structure of LH2 and its organization within the membrane using a Markovian quantum model with dissipation and trapping added phenomenologically. In a deliberate manner, we neglect the high level detail of the bacterial light-harvesting complex and its interaction with the phonon bath in order to elucidate a set of design principles that may be incorporated in artificial pigment-scaffold constructs in a supramolecular assembly. We show that our scheme reproduces many of the most salient features found in their natural counterpart and may be largely explained by simple electrostatic considerations. Most importantly, we show that quantum effects act primarily to enforce robustness with respect to spatial and spectral disorder between and within complexes. The implications of such an arrangement are discussed in the context of biomimetic photosynthetic analogs capable of transferring energy efficiently across tens to hundreds of nanometers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Stochastic Intracellular Model of Anthrax Infection With Spore Germination Heterogeneity

We present a stochastic mathematical model of the intracellular infection dynamics of Bacillus anthracis in macrophages. Following inhalation of B. anthracis spores, these are ingested by alveolar phagocytes. Ingested spores then begin to germinate and divide intracellularly. This can lead to the eventual death of the host cell and the extracellular release of bacterial progeny. Some macrophages successfully eliminate the intracellular bacteria and will recover. Here, a stochastic birth-and-death process with catastrophe is proposed, which includes the mechanism of spore germination and maturation of B. anthracis . The resulting model is used to explore the potential for heterogeneity in the spore germination rate, with the consideration of two extreme cases for the rate distribution: continuous Gaussian and discrete Bernoulli. We make use of approximate Bayesian computation to calibrate our model using experimental measurements from in vitro infection of murine peritoneal macrophages with spores of the Sterne 34F2 strain of B. anthracis . The calibrated stochastic model allows us to compute the probability of rupture, mean time to rupture, and rupture size distribution, of a macrophage that has been infected with one spore. We also obtain the mean spore and bacterial loads over time for a population of cells, each assumed to be initially infected with a single spore. Our results support the existence of significant heterogeneity in the germination rate, with a subset of spores expected to germinate much later than the majority. Furthermore, in agreement with experimental evidence, our results suggest that most of the spores taken up by macrophages are likely to be eliminated by the host cell, but a few germinated spores may survive phagocytosis and lead to the death of the infected cell. Finally, we discuss how this stochastic modelling approach, together with dose-response data, allows us to quantify and predict individual infection risk following exposure.

59 BASIC BIOLOGICAL SCIENCES↗

THE HALO MASS FUNCTION FROM EXCURSION SET THEORY. I. GAUSSIAN FLUCTUATIONS WITH NON-MARKOVIAN DEPENDENCE ON THE SMOOTHING SCALE

A classic method for computing the mass function of dark matter halos is provided by excursion set theory, where density perturbations evolve stochastically with the smoothing scale, and the problem of computing the probability of halo formation is mapped into the so-called first-passage time problem in the presence of a barrier. While the full dynamical complexity of halo formation can only be revealed through N-body simulations, excursion set theory provides a simple analytic framework for understanding various aspects of this complex process. In this series of papers we propose improvements of both technical and conceptual aspects of excursion set theory, and we explore up to which point the method can reproduce quantitatively the data from N-body simulations. In Paper I of the series, we show how to derive excursion set theory from a path {integral} formulation. This allows us both to derive rigorously the absorbing barrier boundary condition, that in the usual formulation is just postulated, and to deal analytically with the non-Markovian nature of the random walk. Such a non-Markovian dynamics inevitably enters when either the density is smoothed with filters such as the top-hat filter in coordinate space (which is the only filter associated with a well-defined halo mass) or when one considers non-Gaussian fluctuations. In these cases, beside 'Markovian' terms, we find 'memory' terms that reflect the non-Markovianity of the evolution with the smoothing scale. We develop a general formalism for evaluating perturbatively these non-Markovian corrections, and in this paper we perform explicitly the computation of the halo mass function for Gaussian fluctuations, to first order in the non-Markovian corrections due to the use of a top-hat filter in coordinate space. In Paper II of this series we propose to extend excursion set theory by treating the critical threshold for collapse as a stochastic variable, which better captures some of the dynamical complexity of the halo formation phenomenon, while in Paper III we use the formalism developed in this paper to compute the effect of non-Gaussianities on the halo mass function.

79 ASTRONOMY AND ASTROPHYSICS↗

Coupling to rotational manifolds to improve gas-phase pump–probe spectroscopic models

The physical picture of gas-phase optical transitions is normally presented as an isolated two-level system balanced by upward and downward processes. Isolated models assume a phenomenological treatment of collisional dephasing but do not strictly account for collisional population exchange with the rotational baths. While this assumption is valid under low-intensity conditions, where excitation is rate-limiting, isolated models can deviate from Beer’s Law at sufficient pressures and monochromatic intensities when both collisional broadening and power broadening are comparable to (or greater than) lifetime broadening, which are not uncommon conditions for cavity enhanced spectroscopies in the mid-IR spectral range. Although this problem has been addressed by rate-equation models for linear absorption measurements, a general treatment for multi-level quantum mechanical models suitable for non-linear absorption measurements (two-photon/two-color/pump–probe) is lacking. Isolated models require physical parameter inputs that disagree with expected values by at least an order of magnitude. These non-physical models undermine the ability to predict non-linear signal strengths under untested conditions and thereby limit the potential to optimize the sensitivity of non-linear spectroscopies and to expand their analytical applications (e.g., new analytes and/or buffer gases, changes in cavity free-spectral-range, changes in intracavity powers or wavelengths, and accurate investigation of physical phenomena). In this study, we derive bath-coupled models for gaseous pump–probe spectroscopy by application of the quantum Lindblad equation and detailed balance. Bath-coupled models are shown to fit data consistently across variations in intensity and agree with all physically expected values.

Cavity ring-down spectroscopy↗

Generalized quantum Fokker-Planck equation for photoinduced nonequilibrium processes with positive definiteness condition

This work provides a detailed derivation of a generalized quantum Fokker-Planck equation (GQFPE) appropriate for photo-induced quantum dynamical processes. The path integral method pioneered by Caldeira and Leggett (CL) [Physica A 121, 587 (1983)] is extended by utilizing a nonequilibrium influence functional applicable to different baths for the ground and the excited electronic states. Both nonequilibrium and non-Markovian effects are accounted for consistently by expanding the paths in the exponents of the influence functional up to the second order with respect to time. This procedure results in approximations involving only single time integrations for the exponents of the influence functional but with additional time dependent boundary terms that have been ignored in previous works. The boundary terms complicate the derivation of a time evolution equation but do not affect position dependent physical observables or the dynamics in the steady state limit. For an effective density operator with the boundary terms factored out, a time evolution equation is derived, through short time expansion of the effective action and Gaussian integration in analytically continued complex domain of space. This leads to a compact form of the GQFPE with time dependent kernels and additional terms, which renders the resulting equation to be in the Dekker form [Phys. Rep. 80, 1 (1981)]. Major terms of the equation are analyzed for the case of Ohmic spectral density with Drude cutoff, which shows that the new GQFPE satisfies the positive definiteness condition in medium to high temperature limit. Steady state limit of the GQFPE is shown to approach the well-known expression derived by CL in the high temperature and Markovian bath limit and also provides additional corrections due to quantum and non-Markovian effects of the bath.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

THE HALO MASS FUNCTION FROM EXCURSION SET THEORY. II. THE DIFFUSING BARRIER

In excursion set theory, the computation of the halo mass function is mapped into a first-passage time process in the presence of a barrier, which in the spherical collapse model is a constant and in the ellipsoidal collapse model is a fixed function of the variance of the smoothed density field. However, N-body simulations show that dark matter halos grow through a mixture of smooth accretion, violent encounters, and fragmentations, and modeling halo collapse as spherical, or even as ellipsoidal, is a significant oversimplification. In addition, the very definition of what is a dark matter halo, both in N-body simulations and observationally, is a difficult problem. We propose that some of the physical complications inherent to a realistic description of halo formation can be included in the excursion set theory framework, at least at an effective level, by taking into account that the critical value for collapse is not a fixed constant {delta}{sub c}, as in the spherical collapse model, nor a fixed function of the variance {sigma} of the smoothed density field, as in the ellipsoidal collapse model, but rather is itself a stochastic variable, whose scatter reflects a number of complicated aspects of the underlying dynamics. Solving the first-passage time problem in the presence of a diffusing barrier we find that the exponential factor in the Press-Schechter mass function changes from exp{l_brace}-{delta}{sup 2}{sub c}/2{sigma}{sup 2{r_brace}} to exp{l_brace}-a{delta}{sup 2}{sub c}/2{sigma}{sup 2{r_brace}}, where a = 1/(1 + D{sub B}) and D{sub B} is the diffusion coefficient of the barrier. The numerical value of D{sub B} , and therefore the corresponding value of a, depends among other things on the algorithm used for identifying halos. We discuss the physical origin of the stochasticity of the barrier and, from recent N-body simulations that studied the properties of the collapse barrier, we deduce a value D{sub B} {approx_equal} 0.25. Our model then predicts a {approx_equal} 0.80, in excellent agreement with the exponential fall off of the mass function found in N-body simulations, for the same halo definition. Combining this result with the non-Markovian corrections computed in Paper I of this series, we derive an analytic expression for the halo mass function for Gaussian fluctuations and we compare it with N-body simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Flood hazard model calibration using multiresolution model output

Riverine floods pose a considerable risk to many communities. Improving flood hazard projections has the potential to inform the design and implementation of flood risk management strategies. Current flood hazard projections are uncertain, especially due to uncertain model parameters. Calibration methods use observations to quantify model parameter uncertainty. With limited computational resources, researchers typically calibrate models using either relatively few expensive model runs at high spatial resolutions or many cheaper runs at lower spatial resolutions. This leads to an open question: is it possible to effectively combine information from the high and low resolution model runs? We propose a Bayesian emulation–calibration approach that assimilates model outputs and observations at multiple resolutions. As a case study for a riverine community in Pennsylvania, we demonstrate our approach using the LISFLOOD-FP flood hazard model. Here, the multiresolution approach results in improved parameter inference over the single resolution approach in multiple scenarios. Results vary based on the parameter values and the number of available models runs. Our method is general and can be used to calibrate other high dimensional computer models to improve projections.

multiresolution↗

The Finite Horizon Optimal Multi-Modes Switching Problem: The Viscosity Solution Approach

In this paper we show existence and uniqueness of a solution for a system of m variational partial differential inequalities with inter-connected obstacles. This system is the deterministic version of the Verification Theorem of the Markovian optimal m-states switching problem. The switching cost functions are arbitrary. This problem is in relation with the valuation of firms in a financial market.

97 MATHEMATICS AND COMPUTING↗

Portfolio Optimization in a Semi-Markov Modulated Market

We address a portfolio optimization problem in a semi-Markov modulated market. We study both the terminal expected utility optimization on finite time horizon and the risk-sensitive portfolio optimization on finite and infinite time horizon. We obtain optimal portfolios in relevant cases. A numerical procedure is also developed to compute the optimal expected terminal utility for finite horizon problem.

97 MATHEMATICS AND COMPUTING↗

An Excursion-Theoretic Approach to Stability of Discrete-Time Stochastic Hybrid Systems

We address stability of a class of Markovian discrete-time stochastic hybrid systems. This class of systems is characterized by the state-space of the system being partitioned into a safe or target set and its exterior, and the dynamics of the system being different in each domain. We give conditions for L{sub 1}-boundedness of Lyapunov functions based on certain negative drift conditions outside the target set, together with some more minor assumptions. We then apply our results to a wide class of randomly switched systems (or iterated function systems), for which we give conditions for global asymptotic stability almost surely and in L{sub 1}. The systems need not be time-homogeneous, and our results apply to certain systems for which functional-analytic or martingale-based estimates are difficult or impossible to get.

97 MATHEMATICS AND COMPUTING↗

Controlled Nonlinear Stochastic Delay Equations: Part II: Approximations and Pipe-Flow Representations

This is the second part of a work dealing with key issues that have not been addressed in the modeling and numerical optimization of nonlinear stochastic delay systems. We consider new classes of models, such as those with nonlinear functions of several controls (such as products), each with is own delay, controlled random Poisson measure driving terms, admissions control with delayed retrials, and others. Part I was concerned with issues concerning the class of admissible controls and their approximations, since the classical definitions are inadequate for our models. This part is concerned with transportation equation representations and their approximations. Such representations of nonlinear stochastic delay models have been crucial in the development of numerical algorithms with much reduced memory and computational requirements. The representations for the new models are not obvious and are developed. They also provide a template for the adaptation of the Markov chain approximation numerical methods.

97 MATHEMATICS AND COMPUTING↗

Viscosity Solutions of Systems of PDEs with Interconnected Obstacles and Switching Problem

This paper deals with existence and uniqueness of a solution in viscosity sense, for a system of m variational partial differential inequalities with inter-connected obstacles. A particular case is the Hamilton-Jacobi-Bellmann system of the Markovian stochastic optimal m-states switching problem. The switching cost functions depend on (t,x). The main tool is the notion of systems of reflected backward stochastic differential equations with oblique reflection.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Weak Necessary and Sufficient Stochastic Maximum Principle for Markovian Regime-Switching Diffusion Models

In this paper we prove a weak necessary and sufficient maximum principle for Markovian regime switching stochastic optimal control problems. Instead of insisting on the maximum condition of the Hamiltonian, we show that 0 belongs to the sum of Clarke’s generalized gradient of the Hamiltonian and Clarke’s normal cone of the control constraint set at the optimal control. Under a joint concavity condition on the Hamiltonian and a convexity condition on the terminal objective function, the necessary condition becomes sufficient. We give four examples to demonstrate the weak stochastic maximum principle.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Workforce planning: a review of methodologies

Workforce planning deals with determining the number of employees and associated skills necessary to meet the future operational needs of an organization. A workforce system consists of six elements: recruitment, attrition, promotion, training, retention, and scheduling. Historically, several workforce modeling and analysis methodologies have been developed to capture these elements. This paper reviews the results of workforce and manpower models published within peer-reviewed literature between 1959 and 2021 to provide an in-depth analysis of current models. The focus of this review is on analytical, simulation, and empirical models found in literature that were collected based on a citation requirement and keyword search criteria. Results demonstrate the trends in workforce modeling research and discuss the common uses of each model type and the advantages/disadvantages related to each model. Based on the common attributes of workforce systems, the discussion focuses on the most frequently used model type for each element and the best use for each model. Lastly, recommendations are made for the development of workforce models that allow the most comprehensive view of the workforce systems of the future.

42 ENGINEERING↗

Maximum Kolmogorov-Sinai Entropy Versus Minimum Mixing Time in Markov Chains

We establish a link between the maximization of Kolmogorov Sinai entropy (KSE) and the minimization of the mixing time for general Markov chains. Since the maximisation of KSE is analytical and easier to compute in general than mixing time, this link provides a new faster method to approximate the minimum mixing time dynamics. It could be interesting in computer sciences and statistical physics, for computations that use random walks on graphs that can be represented as Markov chains.

97 MATHEMATICS AND COMPUTING↗

The Tightness of the Kesten–Stigum Reconstruction Bound of Symmetric Model with Multiple Mutations

It is well known that reconstruction problems, as the interdisciplinary subject, have been studied in numerous contexts including statistical physics, information theory and computational biology, to name a few. We consider a 2q-state symmetric model, with two categories of q states in each category, and 3 transition probabilities: the probability to remain in the same state, the probability to change states but remain in the same category, and the probability to change categories. We construct a nonlinear second-order dynamical system based on this model and show that the Kesten–Stigum reconstruction bound is not tight when q≥4.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗