Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markovian processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Memory effect and phase transition in a hierarchical trap model for spin glasses

Here, we introduce an efficient dynamical tree method that enables us to explicitly demonstrate the thermoremanent magnetization memory effect in a hierarchical energy landscape. Our simulation nicely reproduces the nontrivial waiting-time and waiting-temperature dependences in this nonequilibrium phenomenon. We further investigate the condensation effect, in which a small set of microstates dominates the thermodynamic behavior in the multilayer trap model. Importantly, a structural phase transition of the multilayer tree model is shown to coincide with the onset of the condensation phenomenon. Our results underscore the importance of hierarchical structure and demonstrate the intimate relation between the glassy behavior and structure of barrier trees.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Fracton Hydrodynamics without Time-Reversal Symmetry

Here, we present an effective field theory for the nonlinear fluctuating hydrodynamics of a single conserved charge with or without time-reversal symmetry, based on the Martin-Siggia-Rose formalism. Applying this formalism to fluids with only charge and multipole conservation, and with broken time-reversal symmetry, we predict infinitely many new dynamical universality classes, including some with arbitrarily large upper critical dimensions. Using large scale simulations of classical Markov chains, we find numerical evidence for a breakdown of hydrodynamics in quadrupole-conserving models with broken time-reversal symmetry in one spatial dimension. Our framework can be applied to the hydrodynamics around stationary states of open systems, broadening the applicability of previously developed ideas and methods to a wide range of systems in driven and active matter.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Non-Gaussian Generalized Two-Mode Squeezing: Applications to Two-Ensemble Spin Squeezing and Beyond

Bosonic two-mode squeezed states are paradigmatic entangled Gaussian states that have wide utility in quantum information and metrology. Here, in this study, we show that the basic structure of these states can be generalized to arbitrary bipartite quantum systems in a manner that allows simultaneous, Heisenberg-limited estimation of two independent parameters for finite-dimensional systems. Further, we show that these general states can always be stabilized by a relatively simple Markovian dissipative process. In the specific case where the two subsystems are ensembles of two-level atoms or spins, our generalized states define a notion of two-mode spin squeezing that is valid beyond the Gaussian limit and that enables true multiparameter estimation. We discuss how generalized Ramsey measurements allow one to reach the two-parameter quantum Cramér-Rao bound, and how the dissipative preparation scheme is compatible with current experiments.

Mamaev, Mikhail [Univ. of Chicago, IL (United Stat↗
DOE OSTI2026

Coupled Lindblad Pseudomode Theory for Simulating Open Quantum Systems

Coupled Lindblad pseudomode theory is a promising approach for simulating non-Markovian quantum dynamics on both classical and quantum platforms, with dynamics that can be realized as a quantum channel. We provide theoretical evidence that the number of coupled pseudomodes only needs to scale as polylog⁡(𝑇/𝜖) in the simulation time 𝑇 and precision 𝜖. Inspired by the realization problem in control theory, we also develop a robust numerical algorithm for constructing the coupled modes that avoid the nonconvex optimization required by existing approaches. We demonstrate the effectiveness of our method by computing population dynamics and absorption spectra for the spin-boson model. Furthermore, this Letter provides a significant theoretical and computational improvement to the coupled Lindblad framework, which impacts a broad range of applications from classical simulations of quantum impurity problems to quantum simulations on near-term quantum platforms.

Anderson impurity model↗
NASA NTRS2004

On the Stability of Jump-Linear Systems Driven by Finite-State Machines with Markovian Inputs

This paper presents two mean-square stability tests for a jump-linear system driven by a finite-state machine with a first-order Markovian input process. The first test is based on conventional Markov jump-linear theory and avoids the use of any higher-order statistics. The second test is developed directly using the higher-order statistics of the machine s output process. The two approaches are illustrated with a simple model for a recoverable computer control system.

Patilkulkarni, Sudarshan↗
NASA NTRS2004

Towards Stability Analysis of Jump Linear Systems with State-Dependent and Stochastic Switching

This paper analyzes the stability of hierarchical jump linear systems where the supervisor is driven by a Markovian stochastic process and by the values of the supervised jump linear system s states. The stability framework for this class of systems is developed over infinite and finite time horizons. The framework is then used to derive sufficient stability conditions for a specific class of hybrid jump linear systems with performance supervision. New sufficient stochastic stability conditions for discrete-time jump linear systems are also presented.

Tejada, Arturo↗
DOE OSTI2023

Non-Markovian Hole Excess Noise in Avalanche Amorphous Selenium Thin Films

Enhancing the signal-to-noise ratio in avalanche photodiodes by utilizing impact ionization gain requires materials exhibiting low excess noise factors. Amorphous selenium (a-Se) as a wide bandgap at ~2.1 eV, a solid-state avalanche layer, demonstrates single-carrier hole impact ionization gain and manifests ultralow thermal generation rates. A comprehensive study of the history dependent and non-Markovian nature of hot hole transport in a-Se was modeled using a Monte Carlo (MC) random walk of single hole free flights, interrupted by instantaneous phonon, disorder, hole–dipole, and impact-ionization scattering interactions. The hole excess noise factors were simulated for 0.1–15 μm a-Se thin-films as a function of mean avalanche gain. The hole excess noise factors in a-Se decreases with an increase in electric field, impact ionization gain, and device thickness. The history dependent nature of branching of holes is explained using a Gaussian avalanche threshold distance distribution and the dead space distance, which increases determinism in the stochastic impact ionization process. An ultralow non-Markovian excess noise factor of ~1 was simulated for 100 nm a-Se thin films corresponding to avalanche gains of 1000. Future detector designs can utilize the nonlocal/non-Markovian nature of the hole avalanche in a-Se, to enable a true solid-state photomultiplier with noiseless gain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Generalized master equation for particle transport in binary random media with renewal statistics

Particle transport in binary stochastic mixtures is classically modeled assuming Markovian or exponential mixing statistics but in many applications material memory invalidates the Markov assumption. For non-Markovian mixing characterized by alternating renewal processes, a transport-theoretic framework is presented that provides an exact description of transport in nonscattering random binary media with general non-exponential statistics. Our approach is to Markovianize the problem by augmenting the {material type, particle flux} state space with the age or distance from the last interface. A Chapman-Kolmogorov equation is formulated for the joint probability density of the material type, particle flux, and age, and subsequently reduced to a generalized Master equation (GME) in differential form. This constitutes the primary result of this work. A state-updating Monte Carlo algorithm consistent with the GME is developed and benchmarked against analytical solutions for multiple chord-length laws. For purely absorbing renewal statistical media, the GME reproduces analytical benchmarks for the equilibrium age distribution, interior mean/variance of material-conditioned fluxes, and boundary transmittance. Simulations further demonstrate that a Markov (exponential) approximation of non-exponential statistics can introduce large errors in transmittance and interior flux profiles. Lastly, the reintroduction of memory due to scattering is briefly addressed through heuristic considerations.

Fluctuations & noise↗
NASA NTRS1996

Discrete Deterministic and Stochastic Petri Nets

Petri nets augmented with timing specifications gained a wide acceptance in the area of performance and reliability evaluation of complex systems exhibiting concurrency, synchronization, and conflicts. The state space of time-extended Petri nets is mapped onto its basic underlying stochastic process, which can be shown to be Markovian under the assumption of exponentially distributed firing times. The integration of exponentially and non-exponentially distributed timing is still one of the major problems for the analysis and was first attacked for continuous time Petri nets at the cost of structural or analytical restrictions. We propose a discrete deterministic and stochastic Petri net (DDSPN) formalism with no imposed structural or analytical restrictions where transitions can fire either in zero time or according to arbitrary firing times that can be represented as the time to absorption in a finite absorbing discrete time Markov chain (DTMC). Exponentially distributed firing times are then approximated arbitrarily well by geometric distributions. Deterministic firing times are a special case of the geometric distribution. The underlying stochastic process of a DDSPN is then also a DTMC, from which the transient and stationary solution can be obtained by standard techniques. A comprehensive algorithm and some state space reduction techniques for the analysis of DDSPNs are presented comprising the automatic detection of conflicts and confusions, which removes a major obstacle for the analysis of discrete time models.

MATHEMATICAL MODELS↗
DOE OSTI2024

Evolution of highly multimodal Rayleigh–Taylor instabilities

Rayleigh–Taylor (RT) instabilities are important fluid instabilities that arise in inertial confinement fusion (ICF) capsule implosions, and many other contexts. Multi-mode coupling is observed in experiments and plays a substantial role in material mix from RT instabilities. In this work, we study the evolution of highly multimodal perturbations (power law distribution) that approximate those found at manufactured material interfaces. We use simulations of over 2000 different perturbations in the LANL code xRAGE to identify distinct phases in the processes of bubble growth and bubble merger which can be visualized in a 2D phase portrait with clear regimes of mode growth and decay. Our results show that the dynamic evolution of the instability strongly depends on the mode of the perturbations and mode interactions. The merger process accelerates bubble growth. A non-Markovian region and a transition of the instability from: (1) initial exponential growth to (2) linear growth and to (3) quadratic growth and asymptotic behavior, are clearly captured in the phase space. We have developed a quantitative model of bubble growth that reproduces the dynamic behavior of ensembles of perturbations. Implications for ICF capsules designed for robustness against instabilities are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2006

Towards a Theory of Sampled-Data Piecewise-Deterministic Markov Processes

The analysis and design of practical control systems requires that stochastic models be employed. Analysis and design tools have been developed, for example, for Markovian jump linear continuous and discrete-time systems, piecewise-deterministic processes (PDP's), and general stochastic hybrid systems (GSHS's). These model classes have been used in many applications, including fault tolerant control and networked control systems. This paper presents initial results on the analysis of a sampled-data PDP representation of a nonlinear sampled-data system with a jump linear controller. In particular, it is shown that the state of the sampled-data PDP satisfies the strong Markov property. In addition, a relation between the invariant measures of a sampled-data system driven by a stochastic process and its associated discrete-time representation are presented. As an application, when the plant is linear with no external input, a sufficient testable condition for the convergence in distribution to the invariant delta Dirac measure is given.

Herencia-Zapana, Heber↗
NASA NTRS1997

Energy Transfer and Triadic Interactions in Compressible Turbulence

Using a two-point closure theory, the Eddy-Damped-Quasi-Normal-Markovian (EDQNM) approximation, we have investigated the energy transfer process and triadic interactions of compressible turbulence. In order to analyze the compressible mode directly, the Helmholtz decomposition is used. The following issues were addressed: (1) What is the mechanism of energy exchange between the solenoidal and compressible modes, and (2) Is there an energy cascade in the compressible energy transfer process? It is concluded that the compressible energy is transferred locally from the solenoidal part to the compressible part. It is also found that there is an energy cascade of the compressible mode for high turbulent Mach number (M(sub t) greater than or equal to 0.5). Since we assume that the compressibility is weak, the magnitude of the compressible (radiative or cascade) transfer is much smaller than that of solenoidal cascade. These results are further confirmed by studying the triadic energy transfer function, the most fundamental building block of the energy transfer.

Bataille, F.↗
NASA NTRS2000

Analysis of Phase-Type Stochastic Petri Nets With Discrete and Continuous Timing

The Petri net formalism is useful in studying many discrete-state, discrete-event systems exhibiting concurrency, synchronization, and other complex behavior. As a bipartite graph, the net can conveniently capture salient aspects of the system. As a mathematical tool, the net can specify an analyzable state space. Indeed, one can reason about certain qualitative properties (from state occupancies) and how they arise (the sequence of events leading there). By introducing deterministic or random delays, the model is forced to sojourn in states some amount of time, giving rise to an underlying stochastic process, one that can be specified in a compact way and capable of providing quantitative, probabilistic measures. We formalize a new non-Markovian extension to the Petri net that captures both discrete and continuous timing in the same model. The approach affords efficient, stationary analysis in most cases and efficient transient analysis under certain restrictions. Moreover, this new formalism has the added benefit in modeling fidelity stemming from the simultaneous capture of discrete- and continuous-time events (as opposed to capturing only one and approximating the other). We show how the underlying stochastic process, which is non-Markovian, can be resolved into simpler Markovian problems that enjoy efficient solutions. Solution algorithms are provided that can be easily programmed.

Jones, Robert L.↗
NASA NTRS1982

Reliability calculation using randomization for Markovian fault-tolerant computing systems

The randomization technique for computing transient probabilities of Markov processes is presented. The technique is applied to a Markov process model of a simplified fault tolerant computer system for illustrative purposes. It is applicable to much larger and more complex models. Transient state probabilities are computed, from which reliabilities are derived. An accelerated version of the randomization algorithm is developed which exploits ''stiffness' of the models to gain increased efficiency. A great advantage of the randomization approach is that it easily allows probabilities and reliabilities to be computed to any predetermined accuracy.

Miller, D. R.↗
NASA NTRS2004

Bayesian Vision for Shape Recovery

We present a new Bayesian vision technique that aims at recovering a shape from two or more noisy observations taken under similar lighting conditions. The shape is parametrized by a piecewise linear height field, textured by a piecewise linear irradiance field, and we assume Gaussian Markovian priors for both shape vertices and irradiance variables. The observation process. also known as rendering, is modeled by a non-affine projection (e.g. perspective projection) followed by a convolution with a piecewise linear point spread function. and contamination by additive Gaussian noise. We assume that the observation parameters are calibrated beforehand. The major novelty of the proposed method consists of marginalizing out the irradiances considered as nuisance parameters, which is achieved by Laplace approximations. This reduces the inference to minimizing an energy that only depends on the shape vertices, and therefore allows an efficient Iterated Conditional Mode (ICM) optimization scheme to be implemented. A Gaussian approximation of the posterior shape density is computed, thus providing estimates both the geometry and its uncertainty. We illustrate the effectiveness of the new method by shape reconstruction results in a 2D case. A 3D version is currently under development and aims at recovering a surface from multiple images, reconstructing the topography by marginalizing out both albedo and shading.

Jalobeanu, Andre↗
DOE OSTI2026

Conservation laws and effective hadronization models

Hadronization models based on local string-breaking dynamics are typically Markovian by construction, yet the physical ensemble of final states is shaped by global constraints that couple the entire fragmentation trajectory. Recasting hadronization as a conditioned stochastic diffusion process provides a precise mathematical resolution to this tension. In particular, this language reveals explicitly that constraints stemming from conservation laws induce non-Markovian correlations between otherwise independent fragmentation steps, and that these correlations can be absorbed exactly into a renormalization of the local dynamics through a Doob $h$-transform. We develop this formalism for a $q\bar{q}$ string in the chiral limit, where the longitudinal-transverse factorization of the Lund kernel becomes exact, enabling systematic power counting and clean ultraviolet (UV)/infrared (IR) separation. The dynamics organize naturally into a tower of effective theories distinguished by the remaining string mass, spanning a UV fixed point with scale-invariant transport coefficients, an intermediate regime where transverse phase space induces controlled running, and an IR boundary layer where non-local effects enter at leading order. The tower exhibits genuine Wilsonian structure, including $β$-functions, anomalous dimensions, and systematic matching conditions. The resulting framework achieves a clean factorization of universal microscopic fragmentation dynamics from infrared constraint effects, and opens new directions for both the theoretical analysis and practical simulation of hadronization.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗
DOE OSTI2022

Nonadiabatic transition paths from quantum jump trajectories

We present a means of studying rare reactive pathways in open quantum systems using transition path theory and ensembles of quantum jump trajectories. This approach allows for the elucidation of reactive paths for dissipative, nonadiabatic dynamics when the system is embedded in a Markovian environment. Here, we detail the dominant pathways and rates of thermally activated processes and the relaxation pathways and photoyields following vertical excitation in a minimal model of a conical intersection. We find that the geometry of the conical intersection affects the electronic character of the transition state as defined through a generalization of a committor function for a thermal barrier crossing event. Similarly, the geometry changes the mechanism of relaxation following a vertical excitation. Relaxation in models resulting from small diabatic coupling proceeds through pathways dominated by pure dephasing, while those with large diabatic coupling proceed through pathways limited by dissipation. The perspective introduced here for the nonadiabatic dynamics of open quantum systems generalizes classical notions of reactive paths to fundamentally quantum mechanical processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗