Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

AN EMBEDDED ACTIVE NUCLEUS IN THE OH MEGAMASER GALAXY IRAS16399–0937

We present a multiwavelength study of the OH megamaser galaxy IRAS16399–0937, based on new Hubble Space Telescope (HST)/Advanced Camera for Surveys F814W and Hα+[N II] images and archive data from HST, Two Micron All Sky Survey, Spitzer, Herschel and the Very Large Array. This system has a double nucleus, whose northern (IRAS16399N) and southern (IRAS16399S) components have a projected separation of ∼6'' (3.4 kpc) and have previously been identified based on optical spectra as a low ionization nuclear emission line region (LINER) and starburst nucleus, respectively. The nuclei are embedded in a tidally distorted common envelope, in which star formation is mostly heavily obscured. The infrared spectrum is dominated by strong polycyclic aromatic hydrocarbon, but deep silicate and molecular absorption features are also present, and are strongest in the IRAS16399N nucleus. The 0.435-500 μm spectral energy distribution was fitted with a model including stellar, interstellar medium and active galactic nucleus (AGN) torus components using our new Markov Chain Monte Carlo code, CLUMPYDREAM. The results indicate that the IRAS16399N contains an AGN (L {sub bol} ∼ 10{sup 44} erg s{sup –1}) deeply embedded in a quasi-spherical distribution of optically thick clumps with a covering fraction ≈1. We suggest that these clumps are the source of the OHM emission in IRAS16399–0937. The high torus covering fraction precludes AGN photoionization as the origin of the LINER spectrum, however, the spectrum is consistent with shocks (v ∼ 100-200 km s{sup –1}). We infer that the ∼10{sup 8} M {sub ☉} black hole in IRAS16399N is accreting at a small fraction (∼1%) of its Eddington rate. The low accretion rate and modest nuclear star formation rates suggest that while the gas-rich major merger forming the IRAS16399–0937 system has triggered widespread star formation, the massive gas inflows expected from merger simulations have not yet fully developed.

79 ASTRONOMY AND ASTROPHYSICS↗

Fracton Hydrodynamics without Time-Reversal Symmetry

Here, we present an effective field theory for the nonlinear fluctuating hydrodynamics of a single conserved charge with or without time-reversal symmetry, based on the Martin-Siggia-Rose formalism. Applying this formalism to fluids with only charge and multipole conservation, and with broken time-reversal symmetry, we predict infinitely many new dynamical universality classes, including some with arbitrarily large upper critical dimensions. Using large scale simulations of classical Markov chains, we find numerical evidence for a breakdown of hydrodynamics in quadrupole-conserving models with broken time-reversal symmetry in one spatial dimension. Our framework can be applied to the hydrodynamics around stationary states of open systems, broadening the applicability of previously developed ideas and methods to a wide range of systems in driven and active matter.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Generalized master equation for particle transport in binary random media with renewal statistics

Particle transport in binary stochastic mixtures is classically modeled assuming Markovian or exponential mixing statistics but in many applications material memory invalidates the Markov assumption. For non-Markovian mixing characterized by alternating renewal processes, a transport-theoretic framework is presented that provides an exact description of transport in nonscattering random binary media with general non-exponential statistics. Our approach is to Markovianize the problem by augmenting the {material type, particle flux} state space with the age or distance from the last interface. A Chapman-Kolmogorov equation is formulated for the joint probability density of the material type, particle flux, and age, and subsequently reduced to a generalized Master equation (GME) in differential form. This constitutes the primary result of this work. A state-updating Monte Carlo algorithm consistent with the GME is developed and benchmarked against analytical solutions for multiple chord-length laws. For purely absorbing renewal statistical media, the GME reproduces analytical benchmarks for the equilibrium age distribution, interior mean/variance of material-conditioned fluxes, and boundary transmittance. Simulations further demonstrate that a Markov (exponential) approximation of non-exponential statistics can introduce large errors in transmittance and interior flux profiles. Lastly, the reintroduction of memory due to scattering is briefly addressed through heuristic considerations.

Fluctuations & noise↗

Stimulated ionization scattering of a wave beam forming a discharge channel in a magnetic mirror trap

The stimulated scattering of a whistler wave beam forming an extended discharge channel in a magnetic mirror trap is discovered and investigated experimentally. It is shown that the beam is scattered by relaxaction oscillations of the lattice of plasma inhomogeneities excited by the beam field. The spectrum of the pump field in the RF discharge plasma is found to broaden considerably and to contain individual modulation peaks corresponding to lattice oscillations. The peaks are observed at working gas pressures at which the electron mean free path is close to the wavelength of the standing wave forming the discharge channel. A physical model describing the phenomena observed is developed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Probabilistic Motion Planning of Balloons in Strong, Uncertain Wind Fields

This paper introduces a new algorithm for probabilistic motion planning in arbitrary, uncertain vector fields, with emphasis on high-level planning for Montgolfiere balloons in the atmosphere of Titan. The goal of the algorithm is to determine what altitude--and what horizontal actuation, if any is available on the vehicle--to use to reach a goal location in the fastest expected time. The winds can vary greatly at different altitudes and are strong relative to any feasible horizontal actuation, so the incorporation of the winds is critical for guidance plans. This paper focuses on how to integrate the uncertainty of the wind field into the wind model and how to reach a goal location through the uncertain wind field, using a Markov decision process (MDP). The resulting probabilistic solutions enable more robust guidance plans and more thorough analysis of potential paths than existing methods.

Wolf, Michael T.↗

Planetary Crater Detection and Registration Using Marked Point Processes, Multiple Birth and Death Algorithms, and Region-Based Analysis

Because of the large variety of sensors and spacecraft collecting data, planetary science needs to integrate various multi-sensor and multi-temporal images. These multiple data represent a precious asset, as they allow the study of targets spectral responses and of changes in the surface structure; because of their variety, they also require accurate and robust registration. A new crater detection algorithm, used to extract features that will be integrated in an image registration framework, is presented. A marked point process-based method has been developed to model the spatial distribution of elliptical objects (i.e. the craters) and a birth-death Markov chain Monte Carlo method, coupled with a region-based scheme aiming at computational efficiency, is used to find the optimal configuration fitting the image. The extracted features are exploited, together with a newly defined fitness function based on a modified Hausdorff distance, by an image registration algorithm whose architecture has been designed to minimize the computational time.

Image Processing; Pattern Recognition↗

Planetary Crater Detection and Registration Using Marked Point Processes, Multiple Birth and Death Algorithms, and Region-Based Analysis

Because of the large variety of sensors and spacecraft collecting data, planetary science needs to integrate various multi-sensor and multi-temporal images. These multiple data represent a precious asset, as they allow the study of targets spectral responses and of changes in the surface structure; because of their variety, they also require accurate and robust registration. A new crater detection algorithm, used to extract features that will be integrated in an image registration framework, is presented. A marked point process-based method has been developed to model the spatial distribution of elliptical objects (i.e. the craters) and a birth-death Markov chain Monte Carlo method, coupled with a region-based scheme aiming at computational efficiency, is used to find the optimal configuration fitting the image. The extracted features are exploited, together with a newly defined fitness function based on a modified Hausdorff distance, by an image registration algorithm whose architecture has been designed to minimize the computational time.

Image Processing:Pattern Recognition↗

Solution of resource allocation problem for identification of cost-effective measures to reduce nuclear proliferation risks

This report presents a methodology of selection of cost-effective measures to reduce nuclear proliferation risks. The methodology relies on a graded security model used in practice in different applications. The method is based on the controlled finite Markov chain approach set in combination with discrete dynamic programming and MCDM (Multi Criteria Decision Making) techniques that enables the expert to select the cost-effective measures to reduce nuclear proliferation risks depending on availability of resources. The analysis performed with different number of possible measures confirms the conclusions that the implementation of extra-large costs may not produce the required effect, and the increase in resources above a certain level does not appear sensitive. Diversification in improving the effectiveness of other measures seems more rational and efficient for the whole system than the unlimited improvement of the effectiveness of only one measure.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Multi-point nonequilibrium umbrella sampling and associated fluctuation relations

We describe a simple method of umbrella trajectory sampling for Markov chains. The method allows the estimation of large-deviation rate functions, for path-extensive dynamic observables, for an arbitrary number of models within a certain family. The general relationship between probability distributions of dynamic observables of members of this family is an extended fluctuation relation. When the dynamic observable is chosen to be entropy production, members of this family include the forward Markov chain and its time reverse, whose probability distributions are related by the expected simple fluctuation relation.

97 MATHEMATICS AND COMPUTING↗

Tension in the void: cosmic rulers strain inhomogeneous cosmologies

New constraints on inhomogeneous Lemaitre-Tolman-Bondi (LTB) models alternative to Dark Energy are presented, focusing on adiabatic profiles with space-independent Big Bang and baryon fraction. The Baryon Acoustic Oscillation (BAO) scale at early times is computed in terms of the asymptotic value and then projected to different redshifts by following the geodesics of the background metric. Additionally, a model-independent method to constraint the local expansion rate using a prior on supernovae luminosity is presented. Cosmologies described by an adiabatic GBH matter profile with Ω{sub out} = 1 and Ω{sub out} ≤ 1 are investigated using a Markov Chain Monte Carlo analysis including the latest BAO data from the WiggleZ collaboration and the local expansion rate from the Hubble Space Telescope, together with Union2 type Ia supernovae data and the position and height of the Cosmic Microwave Background acoustic peaks. The addition of BAO data at higher redshifts increases considerably their constraining power and represents a new drawback for this type of models, yielding a value of the local density parameter Ω{sub in}∼>0.2 which is 3σ apart from the value Ω{sub in}∼<0.15 found using supernovae. The situation does not improve if the asymptotic flatness assumption is dropped, and a Bayesian analysis shows that constrained GBH models are ruled out at high confidence. We emphasize that these are purely geometric probes, that only recently have become sufficiently constraining to independently rule out the whole class of adiabatic LTB models.

79 ASTRONOMY AND ASTROPHYSICS↗

Kepler Uniform Modeling of KOIs: MCMC Notes for Data Release 25

This document describes data products related to the reported planetary parameters and uncertainties for the Kepler Objects of Interest (KOIs) based on a Markov-Chain-Monte-Carlo (MCMC) analysis. Reported parameters, uncertainties and data products can be found at the NASA Exoplanet Archive . The codes used for this data analysis are available on the Github website (Rowe 2016). The relevant paper for details of the calculations is Rowe et al. (2015). The main differences between the model fits discussed here and those in the DR24 catalogue are that the DR25 light curves were used in the analysis, our processing of the MAST light curves took into account different data flags, the number of chains calculated was doubled to 200 000, and the parameters which are reported are based on a damped least-squares fit, instead of the median value from the Markov chain or the chain with the lowest 2 as reported in the past.

DR25↗

Reinforcement Learning for Intentional Islanding in Resilient Power Transmission Systems

Intentional islanding is the process of identifying and deliberately decomposing the transmission network to form self-sustained islands from an endangered network during disruptions to improve resilience and security. Most existing intentional islanding models are offline resilience decision tools and hence do not provide outage responses in a timely manner. In this paper, a reinforcement learning (RL) based model for intentional islanding is developed, which offers real-time switching control, online deployability, and adaptability to varying system conditions. The intentional islanding process is formulated as a Markov decision process, where the optimal transmission switching policy is learned using the RL approach. The control policy is learned over an environment that encompasses a Power System Simulator for Engineering (PSS/E) model of the transmission network, facilitated by an interface to the standard openAI Gym framework. The proposed RL-based methodology aims to form stable and self-sustainable islands by ensuring voltage stability while reducing the power mismatch in the formed islands. A proximal policy optimization algorithm is designed, which is suitable for controlling the on/off status of the switches with multi-layer perceptron as value and actor networks. The effectiveness of the proposed framework in the self-recovery of the grid by island formation is applied on the modified IEEE 39-bus test network and validated by dynamic simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Pati-Salam Supersymmetric SM (PSSSM)

Grand Unified Theories based on an E{sub 6} gauge group embed all Higgs- and matter fields within one 27 dimensional fundamental representation. In addition each 27 contains a right handed neutrino, an NMSSM-like standard model singlet and a pair of exotic particles, that couple quarks to leptons. The extended particle content spoils simple gauge unification as in the MSSM. By embedding the SM into a Pati-Salam gauge group above 10{sup 16} GeV, one obtains a unification below the Planck-scale. We present a Markov chain Monte-Carlo algorithm to systematically scan the high dimensional parameter space and calculate low-energy spectra, as well as first results of our studies of the LHC phenomenology of leptoquarks and leptoquarkinos with the event generator WHIZARD.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory

This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.

Markov decision process↗

Bayesian Inversion of Seismic and Electromagnetic Data for Marine Gas Reservoir Characterization Using Multi-chain Markov Chain Monte Carlo Sampling

In this study we developed an efficient Bayesian inversion framework for interpreting marine seismic amplitude versus angle (AVA) and controlled source electromagnetic (CSEM) data for marine reservoir characterization. The framework uses a multi-chain Markov-chain Monte Carlo (MCMC) sampler, which is a hybrid of DiffeRential Evolution Adaptive Metropolis (DREAM) and Adaptive Metropolis (AM) samplers. The inversion framework is tested by estimating reservoir-fluid saturations and porosity based on marine seismic and CSEM data. The multi-chain MCMC is scalable in terms of the number of chains, and is useful for computationally demanding Bayesian model calibration in scientific and engineering problems. As a demonstration, the approach is used to efficiently and accurately estimate the porosity and saturations in a representative layered synthetic reservoir. The results indicate that the seismic AVA and CSEM joint inversion provides better estimation of reservoir saturations than the seismic AVA-only inversion, especially for the parameters in deep layers. The performance of the inversion approach for various levels of noise in observational data was evaluated – reasonable estimates can be obtained with noise levels up to 25%. Sampling efficiency due to the use of multiple chains was also checked and was found to have almost linear scalability.

Ren, Huiying↗

Resonance fluorescence of strongly driven two-level system coupled to multiple dissipative reservoirs

We present a theoretical formalism for resonance fluorescence radiating from a two-level system (TLS) driven by any periodic driving and coupled to multiple reservoirs. The formalism is derived analytically based on the combination of Floquet theory and Born–Markov master equation. The formalism allows us to calculate the spectrum when the Floquet states and quasienergies are analytically or numerically solved for simple or complicated driving fields. We can systematically explore the spectral features by implementing the present formalism. To exemplify this theory, we apply the unified formalism to comprehensively study a generic model that a harmonically driven TLS is simultaneously coupled to a radiative reservoir and a dephasing reservoir. We demonstrate that the significant features of the fluorescence spectra, the driving-induced asymmetry and the dephasing-induced asymmetry, can be attributed to the violation of detailed balance condition, and explained in terms of the driving-related transition quantities between Floquet-states and their steady populations. In addition, we find the distinguished features of the fluorescence spectra under the biharmonic and multiharmonic driving fields in contrast with that of the harmonic driving case. In the case of the biharmonic driving, we find that the spectra are significantly different from the result of the RWA under the multiple resonance conditions. By the three concrete applications, we illustrate that the present formalism provides a routine tool for comprehensively exploring the fluorescence spectrum of periodically strongly driven TLSs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A stochastic method for stand-alone photovoltaic system sizing

Photovoltaic systems utilize solar energy to generate electrical energy to meet load demands. Optimal sizing of these systems includes the characterization of solar radiation. Solar radiation at the Earth's surface has random characteristics and has been the focus of various academic studies. The objective of this study was to stochastically analyze parameters involved in the sizing of photovoltaic generators and develop a methodology for sizing of stand-alone photovoltaic systems. Energy storage for isolated systems and solar radiation were analyzed stochastically due to their random behavior. For the development of the methodology proposed stochastic analysis were studied including the Markov chain and beta probability density function. The obtained results were compared with those for sizing of stand-alone using from the Sandia method (deterministic), in which the stochastic model presented more reliable values. Both models present advantages and disadvantages; however, the stochastic one is more complex and provides more reliable and realistic results. (author)

14 SOLAR ENERGY↗