Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MARKOV PROCESS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Cosmic microwave background with Brans-Dicke gravity. II. Constraints with the WMAP and SDSS data

Using the covariant formalism developed in a companion paper [F.-Q. Wu, L. E. Qiang, X. Wang, and X. Chen, preceding Article, Phys. Rev. D 82, 083002 (2010)] (paper I), we derive observational constraints on the Brans-Dicke model in a flat Friedmann-Lemaitre-Robertson-Walker universe with a cosmological constant and cold dark matter. The CMB observations we use include the Wilkinson Microwave Anisotropy Probe 5 yr data, the Arcminute Cosmology Bolometer Array Receiver 2007 data, the Cosmic Background Imager polarization data, and the Balloon Observations of Millimetric Extragalactic Radiation and Geophysics 2003 flight data. For the large scale structure we use the matter power spectrum data measured with the luminous red galaxy survey of the Sloan Digital Sky Survey Data Release 4. We parametrize the Brans-Dicke parameter {omega} with a new parameter {zeta}=ln(1/{omega}+1), and use the Markov-Chain Monte Carlo method to explore the parameter space. We find that using CMB data alone, one could place some constraints on positive {zeta} or {omega}, but negative {zeta} or {omega} could not be constrained effectively. However, with additional large scale structure data, one could break the degeneracy at {zeta}<0. The 2{sigma} (95.5%) bound on {zeta} is -0.008 37<{zeta}<0.010 18 (corresponding to {omega}<-120.0 or {omega}>97.8). We also obtained constraints on G/G, the rate of change of G at present, as -1.75x10{sup -12} yr{sup -1}<G/G<1.05x10{sup -12} yr{sup -1}, and {delta}G/G, the total variation of G since the epoch of recombination, as -0.083<{delta}G/G<0.095 at the 2{sigma} confidence level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Separating gravitational wave signals from instrument artifacts

Central to the gravitational wave detection problem is the challenge of separating features in the data produced by astrophysical sources from features produced by the detector. Matched filtering provides an optimal solution for Gaussian noise, but in practice, transient noise excursions or ''glitches'' complicate the analysis. Detector diagnostics and coincidence tests can be used to veto many glitches which may otherwise be misinterpreted as gravitational wave signals. The glitches that remain can lead to long tails in the matched filter search statistics and drive up the detection threshold. Here we describe a Bayesian approach that incorporates a more realistic model for the instrument noise allowing for fluctuating noise levels that vary independently across frequency bands, and deterministic glitch fitting using wavelets as glitch templates, the number of which is determined by a transdimensional Markov chain Monte Carlo algorithm. We demonstrate the method's effectiveness on simulated data containing low amplitude gravitational wave signals from inspiraling binary black-hole systems, and simulated nonstationary and non-Gaussian noise comprised of a Gaussian component with the standard LIGO/Virgo spectrum, and injected glitches of various amplitude, prevalence, and variety. Glitch fitting allows us to detect significantly weaker signals than standard techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Properties and uncertainties of scalar field models of dark energy with barotropic equation of state

The dynamics of expansion and large scale structure formation in the multicomponent Universe with dark energy modeled by the minimally coupled scalar field with generalized linear barotropic equation of state are analyzed. It is shown that the past dynamics of expansion and future of the Universe - eternal accelerated expansion or turnaround and collapse - are completely defined by the current energy density of a scalar field and relation between its current and early equation of state parameters. The clustering properties of such models of dark energy and their imprints in the power spectrum of matter density perturbations depend on the same relation and, additionally, on the 'effective sound speed' of a scalar field, defined by its Lagrangian. It is concluded that such scalar fields with different values of these parameters are distinguishable in principle. This gives the possibility to constrain them by confronting the theoretical predictions with the corresponding observational data. For that we have used the 7-year Wilkinson Microwave Anisotropy Probe data on cosmic microwave background anisotropies, the Union2 data set on Supernovae Ia and the seventh data release of the Sloan Digital Sky Survey data on luminous red galaxies space distribution. Using the Markov Chain Monte Carlo technique the marginalized posterior and mean likelihood distributions are computed for the scalar fields with two different Lagrangians: Klein-Gordon and Dirac-Born-Infeld ones. The properties of such scalar field models of dark energy with best fitting parameters and uncertainties of their determination are also analyzed in the paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Confronting general relativity with further cosmological data

Deviations from general relativity in order to explain cosmic acceleration generically have both time and scale-dependent signatures in cosmological data. We extend our previous work by investigating model-independent gravitational deviations in bins of redshift and length scale, by incorporating further cosmological probes such as temperature-galaxy and galaxy-galaxy cross-correlations, and by examining correlations between deviations. Markov Chain Monte Carlo likelihood analysis of the model-independent parameters fitting current data indicates that at low redshift general relativity deviates from the best fit at the 99% confidence level. We trace this to two different properties of the CFHTLS weak lensing data set and demonstrate that COSMOS weak lensing data does not show such deviation. Upcoming galaxy survey data will greatly improve the ability to test time and scale-dependent extensions to gravity and we calculate the constraints that the BigBOSS galaxy redshift survey could enable.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

HyRec: A fast and highly accurate primordial hydrogen and helium recombination code

We present a state-of-the-art primordial recombination code, HYREC, including all the physical effects that have been shown to significantly affect recombination. The computation of helium recombination includes simple analytic treatments of hydrogen continuum opacity in the He I 2{sup 1}P{sup o}-1{sup 1}S line, the He I]2{sup 3}P{sup o}-1{sup 1}S line, and treats feedback between these lines within the on-the-spot approximation. Hydrogen recombination is computed using the effective multilevel atom method, virtually accounting for an infinite number of excited states. We account for two-photon transitions from 2s and higher levels as well as frequency diffusion in Lyman-{alpha} with a full radiative transfer calculation. We present a new method to evolve the radiation field simultaneously with the level populations and the free electron fraction. These computations are sped up by taking advantage of the particular sparseness pattern of the equations describing the radiative transfer. The computation time for a full recombination history is {approx}2 seconds. This makes our code well suited for inclusion in Monte Carlo Markov chains for cosmological parameter estimation from upcoming high-precision cosmic microwave background anisotropy measurements.

74 ATOMIC AND MOLECULAR PHYSICS↗

Hybrid inflation along waterfall trajectories

We identify a new inflationary regime for which more than 60 e-folds are generated classically during the waterfall phase occurring after the usual hybrid inflation. By performing a Bayesian Monte-Carlo-Markov-Chain analysis, this scenario is shown to take place in a large part of the parameter space of the model. When this occurs, the observable perturbation modes leave the Hubble radius during waterfall inflation. The power spectrum of adiabatic perturbations is red, possibly in agreement with CMB constraints. Particular attention has been given to study only the regions for which quantum backreactions do not affect the classical dynamics. Implications concerning the preheating and the absence of topological defects in our Universe are discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Markov chain Monte Carlo analysis to constrain dark matter properties with directional detection

Directional detection is a promising dark matter search strategy. Indeed, weakly interacting massive particle (WIMP)-induced recoils would present a direction dependence toward the Cygnus constellation, while background-induced recoils exhibit an isotropic distribution in the Galactic rest frame. Taking advantage of these characteristic features, and even in the presence of a sizeable background, it has recently been shown that data from forthcoming directional detectors could lead either to a competitive exclusion or to a conclusive discovery, depending on the value of the WIMP-nucleon cross section. However, it is possible to further exploit these upcoming data by using the strong dependence of the WIMP signal with: the WIMP mass and the local WIMP velocity distribution. Using a Markov chain Monte Carlo analysis of recoil events, we show for the first time the possibility to constrain the unknown WIMP parameters, both from particle physics (mass and cross section) and Galactic halo (velocity dispersion along the three axis), leading to an identification of non-baryonic dark matter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Excitation energy transfer: Study with non-Markovian dynamics

In this paper, we investigate the non-Markovian dynamics of a model to mimic the excitation energy transfer (EET) between chromophores in photosynthesis systems. The numerical path integral method is used. This method includes the non-Markovian effects of the environmental affects, and it does not need the perturbation approximation in solving the dynamics of systems of interest. It implies that the coherence helps the EET between chromophores through lasting the transfer time rather than enhancing the transfer rate of the EET. In particular, the non-Markovian environment greatly increases the efficiency of the EET in the photosynthesis systems.

74 ATOMIC AND MOLECULAR PHYSICS↗

Non-Markovian dynamics of an open quantum system with nonstationary coupling

The spectral, dissipative, and statistical properties of the damped quantum oscillator are studied in the case of non-Markovian and nonstationary system-heat bath coupling. The dissipation of collective energy is shown to be slowed down, and the decoherence rate and entropy grow with modulation frequency.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Matter-Wave Emission in Optical Lattices: Single Particle and Collective Effects

We introduce a simple setup corresponding to the matter-wave analogue of impurity atoms embedded in a photonic crystal and interacting with the radiation field. Atoms in a given internal level are trapped in an optical lattice, and play the role of the impurities. Atoms in an untrapped level play the role of the radiation field. The interaction is mediated by means of lasers that couple those levels. By tuning the lasers parameters, it is possible to drive the system through different regimes, and observe phenomena such as matter-wave superradiance, non-Markovian atom emission, and the appearance of bound atomic states.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Prediction of Spatiotemporal Patterns of Neural Activity from Pairwise Correlations

We designed a model-based analysis to predict the occurrence of population patterns in distributed spiking activity. Using a maximum entropy principle with a Markovian assumption, we obtain a model that accounts for both spatial and temporal pairwise correlations among neurons. This model is tested on data generated with a Glauber spin-glass system and is shown to correctly predict the occurrence probabilities of spatiotemporal patterns significantly better than Ising models only based on spatial correlations. This increase of predictability was also observed on experimental data recorded in parietal cortex during slow-wave sleep. This approach can also be used to generate surrogates that reproduce the spatial and temporal correlations of a given data set.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Solid-State Spin-Photon Quantum Interface without Spin-Orbit Coupling

We show that coherent optical manipulation of a single confined spin is possible even in the absence of spin-orbit coupling. To this end, we consider the non-Markovian dynamics of a single valence orbital hole spin that has optically induced spin-exchange coupling to a low-temperature partially polarized electron gas. We show that the fermionic nature of the reservoir induces a coherent component to the hole spin dynamics that does not generate entanglement with the reservoir modes. We analyze in detail the competition of this reservoir-assisted coherent contribution with dissipative components displaying markedly different behavior at different time scales and determine the fidelity of optically controlled spin rotations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Kinetic Theory for Distribution Functions of Wave-Particle Interactions in Plasmas

The evolution of a charged particle distribution function under the influence of coherent electromagnetic waves in a plasma is determined from kinetic theory. For coherent waves, the dynamical phase space of particles is an inhomogeneous mix of chaotic and regular orbits. The persistence of long time correlations between the particle motion and the phase of the waves invalidates any simplifying Markovian or statistical assumptions--the basis for usual quasilinear theories. The generalized formalism in this Letter leads to a hierarchy of evolution equations for the reduced distribution function. The evolution operators, in contrast to the quasilinear theories, are time dependent and nonsingular and include the rich phase space dynamics of particles interacting with coherent waves.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Autonomous Cyber Defense Against Dynamic Multi-strategy Infrastructural DDoS Attacks

Dynamic Infrastructural Distributed Denial of Service (I-DDoS) attacks constantly change attack vectors to congest core backhaul links and disrupt critical network availability while evading end-system defenses. To effectively counter these highly dynamic attacks, defense mechanisms need to exhibit adaptive decision strategies for real-time mitigation. This paper presents a novel Autonomous DDoS Defense framework that employs model-based reinforcement agents. The framework continuously learns attack strategies, predicts attack actions, and dynamically determines the optimal composition of defense tactics such as filtering, limiting, and rerouting for flow diversion. Our contributions include extending the underlying formulation of the Markov Decision Process (MDP) to address simultaneous DDoS attack and defense behavior, and accounting for environmental uncertainties. We also propose a fine-grained action mitigation approach robust to classification inaccuracies in Intrusion Detection Systems (IDS). Additionally, our reinforcement learning model demonstrates resilience against evasion and deceptive attacks. Evaluation experiments using real-world and simulated DDoS traces demonstrate that our autonomous defense framework ensures the delivery of approximately 96 - 98% of benign traffic despite the diverse range of attack strategies.

Dutta, Ashutosh↗

An Online Approach to Solve the Dynamic Vehicle Routing Problem with Stochastic Trip Requests for Paratransit Services

Many transit agencies operating paratransit and microtransit services have to respond to trip requests that arrive in real-time, which entails solving hard combinatorial and sequential decision-making problems under uncertainty. To avoid decisions that lead to significant inefficiency in the long term, vehicles should be allocated to requests by optimizing a non-myopic utility function or by batching requests together and optimizing a myopic utility function. While the former approach is typically offline, the latter can be performed online. We point out two major issues with such approaches when applied to paratransit services in practice. First, it is difficult to batch paratransit requests together as they are temporally sparse. Second, the environment in which transit agencies operate changes dynamically (e.g., traffic conditions can change over time), causing the estimates that are learned offline to become stale. To address these challenges, we propose a fully online approach to solve the dynamic vehicle routing problem (DVRP) with time windows and stochastic trip requests that is robust to changing environmental dynamics by construction. We focus on scenarios where requests are relatively sparse—our problem is motivated by applications to paratransit services. We formulate DVRP as a Markov decision process and use Monte Carlo tree search to evaluate actions for any given state. Accounting for stochastic requests while optimizing a non-myopic utility function is computationally challenging; indeed, the action space for such a problem is intractably large in practice. To tackle the large action space, we leverage the structure of the problem to design heuristics that can sample promising actions for the tree search. Our experiments using real-world data from our partner agency show that the proposed approach outperforms existing state-of-the-art approaches both in terms of performance and robustness.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗

A General Framework for Bounding Approximate Dynamic Programming Schemes

For years, there has been interest in approximation methods for solving dynamic programming problems, because of the inherent complexity in computing optimal solutions characterized by Bellman’s principle of optimality. A wide range of approximate dynamic programming (ADP) methods now exists. It is of great interest to guarantee that the performance of an ADP scheme be at least some known fraction, say ß , of optimal. This letter introduces a general approach to bounding the performance of ADP methods, in this sense, in the stochastic setting. The approach is based on new results for bounding greedy solutions in string optimization problems, where one has to choose a string (ordered set) of actions to maximize an objective function. This bounding technique is inspired by submodularity theory, but submodularity is not required for establishing bounds. Instead, the bounding is based on quantifying certain notions of curvature of string functions; the smaller the curvatures the better the bound. The key insight is that any ADP scheme is a greedy scheme for some surrogate string objective function that coincides in its optimal solution and value with those of the original optimal control problem. The ADP scheme then yields to the bounding technique mentioned above, and the curvatures of the surrogate objective determine the value ß of the bound. The surrogate objective and its curvatures depend on the specific ADP.

discrete event systems↗