Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MARKOV PROCESS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

TU-AB-202-11: Tumor Segmentation by Fusion of Multi-Tracer PET Images Using Copula Based Statistical Methods

Purpose: Multi-tracer PET imaging is getting more attention in radiotherapy by providing additional tumor volume information such as glucose and oxygenation. However, automatic PET-based tumor segmentation is still a very challenging problem. We propose a statistical fusion approach to joint segment the sub-area of tumors from the two tracers FDG and FMISO PET images. Methods: Non-standardized Gamma distributions are convenient to model intensity distributions in PET. As a serious correlation exists in multi-tracer PET images, we proposed a new fusion method based on copula which is capable to represent dependency between different tracers. The Hidden Markov Field (HMF) model is used to represent spatial relationship between PET image voxels and statistical dynamics of intensities for each modality. Real PET images of five patients with FDG and FMISO are used to evaluate quantitatively and qualitatively our method. A comparison between individual and multi-tracer segmentations was conducted to show advantages of the proposed fusion method. Results: The segmentation results show that fusion with Gaussian copula can receive high Dice coefficient of 0.84 compared to that of 0.54 and 0.3 of monomodal segmentation results based on individual segmentation of FDG and FMISO PET images. In addition, high correlation coefficients (0.75 to 0.91) for the Gaussian copula for all five testing patients indicates the dependency between tumor regions in the multi-tracer PET images. Conclusion: This study shows that using multi-tracer PET imaging can efficiently improve the segmentation of tumor region where hypoxia and glucidic consumption are present at the same time. Introduction of copulas for modeling the dependency between two tracers can simultaneously take into account information from both tracers and deal with two pathological phenomena. Future work will be to consider other families of copula such as spherical and archimedian copulas, and to eliminate partial volume effect by considering dependency between neighboring voxels.

60 APPLIED LIFE SCIENCES↗

WE-AB-207B-02: A Bayesian Network Approach for Joint Prediction of Tumor Control and Radiation Pneumonitis (RP) in Non-Small-Cell Lung Cancer (NSCLC)

Purpose: NSCLC radiotherapy treatment is a trade-off between controlling the tumor while limiting radiation-induced toxicities. Here we identify hierarchical biophysical relationships that could simultaneously influence both local control (LC) and RP by using an integrated Bayesian Networks (BN) approach. Methods: We studied 79 NSCLC patients treated on prospective protocol with 56 cases of LC and 21 events of RP. Beyond dosimetric information, each patient had 193 features including 12 clinical factors, 60 circulating blood cytokines before and during radiotherapy, 62 microRNAs, and 59 single-nucleotide polymorphisms (SNPs). The most relevant biophysical predictors for both LC and RP were identified using a Markov blanket local discovery algorithm and the corresponding BN was constructed using a score-learning algorithm. The area under the free-response receiver operating characteristics (AU-FROC) was used for performance evaluation. Cross-validation was employed to guard against overfitting pitfalls. Results: A BN revealing the biophysical interrelationships jointly in terms of LC and RP was developed and evaluated. The integrated BN included two SNPs, one microRNA, one clinical factor, three pre-treatment cytokines, relative changes of two cytokines between pre and during-treatment, and gEUDs of the GTV (a=-20) and lung (a=1). On cross-validation, the AUC prediction of independent LC was 0.85 (95% CI: 0.75–0.95) and RP was 0.83 (0.73–0.92). The AU-FROC of the integrated BN to predict both LC/RP was 0.81 (0.71–0.90) based on 2000 stratified bootstrap, indicating minimal loss in joint prediction power. Conclusions: We developed a new approach for multiple outcome utility application in radiotherapy based on integrated BN techniques. The BN developed from large-scale retrospective data is able to simultaneously predict LC and RP in NSCLC treatments based on individual patient characteristics. The joint prediction is only slightly compromised compared to independent predictions. Our approach shows promise for use in clinical decision support system for personalized radiotherapy subject to multiple endpoints. These studies were supported by a grant from the NCI/NIH P01-CA59827.

60 APPLIED LIFE SCIENCES↗

Electron diffraction study of the structural features of kaolinites

The structural variations of kaolinites have been investigated based on oblique-texture electron diffraction patterns. The features of manifestation of the 2D lattice of kaolinite layers in the geometry of the 20l and 13l reflections have been revealed. The manifestation of violations in the regular alternation of layers in kaolinites in the diffraction patterns has been analyzed using a numerical simulation of the diffraction profiles along the first (02l, 11l) and second (20l, 13l) ellipses of oblique-texture electron diffraction patterns. The simulation was performed for finite sequences of ten layers using the statistical Markov model in the quasihomogeneous approximation. It is shown that oblique-texture electron diffraction patterns can be used to reveal the coexistence of two phases with different structural perfections and particle morphologies in kaolinite samples.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Stacking faults in lizardites 1T from electron diffraction data and modeling of diffraction effects

Stacking faults in lizardites 1T (polytype group A) have been studied by analyzing the oblique-texture electron diffraction patterns in combination with a numerical simulation of diffraction patterns. The simulation of diffraction profiles was performed for finite (10-layer) sequences using the statistical Markov model in the quasi-homogeneous approximation. Diffraction criteria are revealed, which indicate the presence of defects in lizardite 1T; these defects are related to the change in the layer orientation by 180 Degree-Sign and displacements of adjacent layers by a/3. It is shown that in the case of the statistical distribution of defects, along with pairs of adjacent layers with layer packing features typical of polytype groups D and B, there are also sequences of layers 1T(A), correspondingly rotated by 180 Degree-Sign or displaced by a/3 and 2a/3 with respect to the layers in the 1T matrix. The data obtained give deeper insight into the variations in layer packing in lizardites 1T.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Impact of non-Markovian effects on the fission rate and time

The impact of non-Markovian effects on the fission rate and time is studied on the basis of a generalized one-dimensional Langevin equation. Relevant calculations were performed under the assumption of an exponentially correlated random force appearing in Langevin equations and a constant correlation time. An increase in the fission rate and a decrease in the mean fission time with increasing random-force correlation time were revealed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The alpha and omega of the scientific work of Academician Moisei Aleksandrovich Markov

A brief survey of the scientific, scientific-administrative, and public activity of M. A. Markov is given in regard with his centenary (May 13, 1908–October 1, 1994). The outstanding contribution of Moisei Aleksandrovich to the theory of elementary particle physics, gravitation, and cosmology is pointed out.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Supersymmetry in superspace: 35 years of the research activity in LTP

This is an overview of the all-years research activity in supersymmetry in the Markov-Ogievetsky group at the Bogoliubov Laboratory of Theoretical Physics. It started shortly after the discovery of supersymmetry and is lasting for more than 30 years. In this survey the main emphasis is made on the superspace geometric approaches and unconstrained superfield formulations. Alongside such milestones as the geometric formulation of supergravity and the harmonic superspace approach to extended supersymmetry, some other developments largely contributed by the Dubna theorists are briefly accounted for.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Self-consistent description of e{sup −} e{sup +}γ{sup −} plasma created from the vacuum in a strong electric laser field

In the present work a closed system of kinetic equations is obtained for the description of the vacuum creation of an electron-positron plasma and secondary photons due to a strong laser field. An estimate for the photon energy distribution is obtained. In the Markovian approximation the photon distribution has a 1/ k spectrum (flicker noise).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Gauge fields, nonlinear realizations, supersymmetry

This is a brief survey of the all-years research activity in the Sector “Supersymmetry” (the former Markov Group) at the Bogoliubov Laboratory of Theoretical Physics. The focus is on the issues related to gauge fields, spontaneously broken symmetries in the nonlinear realizations approach, and diverse aspects of supersymmetry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Cyclotomic Shuffles

Analogues of 1-shuffle elements for complex reflection groups of type G(m,1,n) are introduced. A geometric interpretation for G(m,1,n) in terms of rotational permutations of polygonal cards is given. We compute the eigenvalues, and their multiplicities, of the 1-shuffle element in the algebra of the group G(m,1,n). Considering shuffling as a random walk on the group G(m,1,n), we estimate the rate of convergence to randomness of the corresponding Markov chain. We report on the spectrum of the 1-shuffle analogue in the cyclotomic Hecke algebra H(m,1,n) for m=2 and small n.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Review of mixing length estimates and effects of toroidicity in a fluid model for turbulent transport in tokamaks

Basic aspects of turbulent transport in toroidal magnetized plasmas are discussed. In particular the fluid closure has strong effects on zonal flows which are needed to create an absorbing boundary for long wave lengths and also to obtain the Dimits nonlinear upshift. The fluid resonance in the energy equation is found to be instrumental for generating the L–H transition, the spin-up of poloidal rotation in internal transport barriers, as well as the nonlinear Dimits upshift. The difference between the linearly fastest growing mode number and the corresponding longer nonlinear correlation length is also addressed. It is found that the Kadomtsev mixing length result is consistent with the non-Markovian diagonal limit of the transport at the nonlinearly obtained correlation length.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Magnetotransport in a 2D system with strong scatterers: Renormalization of Hall coefficient caused by non-Markovian effects

We show that a sharp dependence of the Hall coefficient R on the magnetic field B arises in two-dimensional electron systems with strong scatterers. The phenomenon is due to classical memory effects. We calculate analytically the dependence of R on B for the case of scattering by antidots (modeled by hard disks of radius a), randomly distributed with concentration n{sub 0} << 1/a{sup 2}. We demonstrate that in very weak magnetic fields ({omega}{sub c}{tau}{sub tr} {<=} n{sub 0}a{sup 2}), memory effects lead to a considerable renormalization of the Boltzmann value of the Hall coefficient: {delta}R/R {approx} 1. With increasing magnetic field, the relative correction to R decreases, then changes sign, and saturates at the value {delta}R/R {approx} -n{sub 0}a{sup 2}. We also discuss the effect of the smooth disorder on the dependence of R on B.

36 MATERIALS SCIENCE↗

Quantum Dynamics of a Domain Wall in the Presence of Dephasing

We compare quantum dynamics in the presence of Markovian dephasing for a particle hopping on a chain and for an Ising domain wall whose motion leaves behind a string of flipped spins. Exact solutions show that on an infinite chain, the transport responses of the models are nearly identical. However, on finitelength chains, the broadening of discrete spectral lines is much more noticeable in the case of a domain wall.

97 MATHEMATICS AND COMPUTING↗

The Electron-Conformational Model of Ryanodine Receptors of the Heart Cell

The main ideas of an electron-conformational (EC) model of ligand-activated ryanodine channels (RyR) that reduces many degrees of freedom of this gigantic nanoscopic molecular complex to two so-called electron and conformational degrees of freedom are presented. In the toy model, the conformational potential or energy profile of the RyR channel represents two branches that describe the dependence of energy on the conformational coordinate (reaction coordinate) in the initial and ligand-activated states, respectively. A model extension that takes into account both the tetrameric structure of the RyR channel and additional (orthogonal) rotational conformational mode has been considered. The EC model has been demonstrated to give a biophysical basis to the traditional phenomenological model of Markov chains. To demonstrate the possibilities of the EC model, we refer to examples of model description of the dynamics of isolated RyR channels and clusters of RyR channels in release units of the heart cell.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Reciprocity Relations for Nonlinear Systems

A quantum proof of reciprocity relations for nonlinear nonstationary systems in the magnetic field is obtained in the approximation of the Markovian relaxation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Learning Robust Marking Policies for Adaptive Mesh Refinement

Here in this work, we revisit the marking decisions made in the standard adaptive finite element method (AFEM). Experience shows that a naïve marking policy leads to inefficient use of computational resources for adaptive mesh refinement (AMR). Consequently, using AMR in practice often involves ad-hoc or time-consuming offline parameter tuning to set appropriate parameters for the marking subroutine. To address these practical concerns, we recast AMR as a Markov decision process in which refinement parameters can be selected on-the-fly at run time, without the need for pre-tuning by expert users. In this new paradigm, the refinement parameters are also chosen adaptively via a marking policy that can be optimized using methods from reinforcement learning. We use the Poisson equation to demonstrate our techniques on h- and hp-refinement benchmark problems, and our experiments suggest that superior marking policies remain undiscovered for many classical AFEM applications. Furthermore, an unexpected observation from this work is that marking policies trained on one family of PDEs are sometimes robust enough to perform well on problems far outside the training family. For illustration, we show that a simple hp-refinement policy trained on 2D domains with only a single re-entrant corner can be deployed on far more complicated 2D domains, and even 3D domains, without significant performance loss. For reproduction and broader adoption, we accompany this work with an open-source implementation of our methods.

97 MATHEMATICS AND COMPUTING↗

Automated Adversary-in-the-Loop Cyber-Physical Defense Planning

Security of cyber-physical systems (CPS) continues to pose new challenges due to the tight integration and operational complexity of the cyber and physical components. To address these challenges, this article presents a domain-aware, optimization-based approach to determine an effective defense strategy for CPS in an automated fashion—by emulating a strategic adversary in the loop that exploits system vulnerabilities, interconnection of the CPS, and the dynamics of the physical components. Our approach builds on an adversarial decision-making model based on a Markov Decision Process (MDP) that determines the optimal cyber (discrete) and physical (continuous) attack actions over a CPS attack graph. The defense planning problem is modeled as a non-zero-sum game between the adversary and defender. We use a model-free reinforcement learning method to solve the adversary’s problem as a function of the defense strategy. We then employ Bayesian optimization (BO) to find an approximate best-response for the defender to harden the network against the resulting adversary policy. This process is iterated multiple times to improve the strategy for both players. We demonstrate the effectiveness of our approach on a ransomware-inspired graph with a smart building system as the physical process. Numerical studies show that our method converges to a Nash equilibrium for various defender-specific costs of network hardening.

97 MATHEMATICS AND COMPUTING↗

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗