Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

On the rate of convergence as t→+∞ of the distributions of solutions to the stationary measure for the stochastic system of the Lorenz model describing a baroclinic atmosphere

The paper is concerned with a nonlinear system of partial differential equations with parameters which describes the two-layer quasi- solenoidal Lorenz model for a baroclinic atmosphere on a rotating two- dimensional sphere. The right-hand side of the system is perturbed by white noise. A unique stationary measure for the Markov semigroup defined by the solutions of the Cauchy problem for this problem is considered. An estimate for the rate of convergence of the distributions of all solutions in a certain class of this system to the unique stationary measure as t→+∞ is proposed. A similar result is obtained for the equation of a barotropic atmosphere and the two-dimensional Navier-Stokes equation. A comparative analysis with some of the available related results is given for the latter. Bibliography: 39 titles. (paper)

97 MATHEMATICS AND COMPUTING↗

A two-level Markov random field for road network extraction and its application with optical, SAR, and multitemporal data

This article introduces a method for road network extraction from satellite images. The proposed approach covers a new fusion method (using data from multiple sources) and a new Markov random field (MRF) defined on connected components along with a multilevel application (two-level MRF). Our method allows the detection of roads with different characteristics and decreases by around 30% the size of the used graph model. Results for synthetic aperture radar (SAR) images and optical images obtained using the TerraSAR-X and Quickbird sensors, respectively, are presented demonstrating the improvement brought by the proposed approach. In a second part, an analysis of different types of data fusion combining optical/radar images, radar/radar images, and multitemporal SAR (TerraSAR-X and COSMO-SkyMed) images is described. Overall, the qualitative and quantitative results show that the fusion approach improves considerably the results of the road network extraction.

47 OTHER INSTRUMENTATION↗

THE PRECISION AND ACCURACY OF EARLY EPOCH OF REIONIZATION FOREGROUND MODELS: COMPARING MWA AND PAPER 32-ANTENNA SOURCE CATALOGS

As observations of the Epoch of Reionization (EoR) in redshifted 21 cm emission begin, we assess the accuracy of the early catalog results from the Precision Array for Probing the Epoch of Reionization (PAPER) and the Murchison Wide-field Array (MWA). The MWA EoR approach derives much of its sensitivity from subtracting foregrounds to <1% precision, while the PAPER approach relies on the stability and symmetry of the primary beam. Both require an accurate flux calibration to set the amplitude of the measured power spectrum. The two instruments are very similar in resolution, sensitivity, sky coverage, and spectral range and have produced catalogs from nearly contemporaneous data. We use a Bayesian Markov Chain Monte Carlo fitting method to estimate that the two instruments are on the same flux scale to within 20% and find that the images are mostly in good agreement. We then investigate the source of the errors by comparing two overlapping MWA facets where we find that the differences are primarily related to an inaccurate model of the primary beam but also correlated errors in bright sources due to CLEAN. We conclude with suggestions for mitigating and better characterizing these effects.

79 ASTRONOMY AND ASTROPHYSICS↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

Real-time characterization of partially observed epidemics using surrogate models.

We present a statistical method, predicated on the use of surrogate models, for the 'real-time' characterization of partially observed epidemics. Observations consist of counts of symptomatic patients, diagnosed with the disease, that may be available in the early epoch of an ongoing outbreak. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information on the dynamics of the etiologic agent in the affected population e.g., the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and epidemiological parameters are estimated as distributions using a Markov chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. In some cases, the inverse problem can be computationally expensive, primarily due to the epidemic simulator used inside the inversion algorithm. We present a method, based on replacing the epidemiological model with computationally inexpensive surrogates, that can reduce the computational time to minutes, without a significant loss of accuracy. The surrogates are created by projecting the output of an epidemiological model on a set of polynomial chaos bases; thereafter, computations involving the surrogate model reduce to evaluations of a polynomial. We find that the epidemic characterizations obtained with the surrogate models is very close to that obtained with the original model. We also find that the number of projections required to construct a surrogate model is O(10)-O(10{sup 2}) less than the number of samples required by the MCMC to construct a stationary posterior distribution; thus, depending upon the epidemiological models in question, it may be possible to omit the offline creation and caching of surrogate models, prior to their use in an inverse problem. The technique is demonstrated on synthetic data as well as observations from the 1918 influenza pandemic collected at Camp Custer, Michigan.

59 BASIC BIOLOGICAL SCIENCES↗

On the Reliability of Parameter Inferences in a Multiscale Model for Transport in Stream Corridors

Nonreacting tracer tests capture information about physical processes in transient storage zones including the hyporheic zone (HZ). However, reliably extracting this information from breakthrough curves (BTCs) and distinguishing the effects of in-channel dispersion and transient storage are well-known challenges. Using BTCs from a nonreacting tracer test monitored at multiple locations, we explore ways for reliable parameter estimations. The identifiability of parameters is greatly influenced by the choice of forward and inverse modeling frameworks in addition to the quality of the data. Our forward model is a recently proposed multiscale model that uses subgrid transport models written in the Lagrangian form to represent transport along a diverse set of HZ pathways with a shape-free distribution of travel times. Joint distributions of HZ and channel parameters are estimated using the Markov Chain Monte Carlo technique. Numerical experiments show ambiguity between channel dispersion and HZ transport when the reach length is too short to allow significant solute-HZ interaction, the observation period is too brief to observe the tailing behavior, or the solute source is spread in time. In contrast, we obtained reliable parameter estimates by simultaneously fitting BTCs observed at different locations in the test reach using a single set of HZ parameters and section-specific channel areas and dispersion coefficients. Furthermore, this study demonstrates the estimation of travel time distributions, HZ exchange rates, and channel parameters in a new multiscale approach and offers guidance for extracting reliable parameter estimates from multiple BTCs.

54 ENVIRONMENTAL SCIENCES↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

Large compilations of heterogeneous environmental observations are increasingly available as public databases, allowing researchers to test hypotheses across datasets. Statistical complexities arise when analyzing compiled data due to unbalanced spatial sampling, variable environmental context, mixed measurement techniques, and other reasons. Hierarchical Bayesian modeling is increasingly used in environmental science to describe these complexities, however few studies explicitly compare the utility of hierarchical Bayesian models to simpler and more commonly applied methods. Here we demonstrate the utility of the hierarchical Bayesian approach with application to a large compiled environmental dataset consisting of 5,741 marine vertical organic carbon flux observations from 407 sampling locations spanning eight biomes across the global ocean. We fit a global scale Bayesian hierarchical model that describes the vertical profile of organic carbon flux with depth. Profile parameters within a particular biome are assumed to share a common deviation from the global mean profile. Individual station-level parameters are then modeled as deviations from the common biome-level profile. The hierarchical approach is shown to have several benefits over simpler and more common data aggregation methods. First, the hierarchical approach avoids statistical complexities introduced due to unbalanced sampling and allows for flexible incorporation of spatial heterogeneitites in model parameters. Second, the hierarchical approach uses the whole dataset simultaneously to fit the model parameters which shares information across datasets and reduces the uncertainty up to 95% in individual profiles. Third, the Bayesian approach incorporates prior scientific information about model parameters; for example, the non-negativity of chemical concentrations or mass-balance, which we apply here. We explicitly quantify each of these properties in turn. We emphasize the generality of the hierarchical Bayesian approach for diverse environmental applications and its increasing feasibility for large datasets due to recent developments in Markov Chain Monte Carlo algorithms and easy-to-use high-level software implementations.

54 ENVIRONMENTAL SCIENCES↗

Measuring small absorptions by exploiting photothermal self-phase modulation

We present a method for the measurement of small optical absorption coefficients. The method exploits the deformation of cavity Airy peaks that occur if the cavity contains an absorbing material with a nonzero thermorefractive coefficient dn/dT or a nonzero expansion coefficient ath. Light absorption leads to a local temperature change and to an intensity-dependent phase shift, i.e., to a photothermal self-phase modulation. The absorption coefficient is derived from a comparison of time-resolved measurements with a numerical time-domain simulation applying a Markov-chain Monte Carlo algorithm. We apply our method to the absorption coefficient of lithium niobate doped with 7mol.% magnesium oxide and derive a value of {alpha}LN=(5.9{+-}0.9)x10{sup -4}/cm. Our method should also apply to materials with much lower absorption coefficients. Based on our modeling, we estimate that, with cavity finesse values of the order of 10{sup 4}, absorption coefficients of as low as 10{sup -8}/cm can be measured.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Single-Molecule Kinetics of Styrene Hydrogenation on Silica-Supported Vanadium: The Role of Disorder for Single-Atom Catalysts

We report a theoretical approach for the study of supported atom catalysis is developed based on recent advances in the study of single-molecule kinetics. This view is particularly useful in exhibiting the role of disorder in single-atom and single-site catalysts on amorphous supports. The distribution of passage times (or waiting times) through a complex catalytic network originating from a set of coupled active sites is described by a probability distribution function (PDF), f(t), that reflects the local environment of the reaction center. An efficient algorithm is developed based on the linear algebra of the Markov transition matrix that produces f(t) or its moments. The kinetics of the hydrogenation reaction of styrene on an organovanadium(III) catalyst supported on amorphous silica is studied. A kinetic model consisting of three intertwined catalytic cycles emanating from three chemically distinct active sites is proposed to describe the chemistry. Density functional theory (DFT) calculations are employed to determine the free energy barriers of the reactions, which are used to construct the rate coefficient matrix. The disorder induced by the amorphous support material is divided into a low-dimensional short-range component reflecting the covalent structures near the reaction center and a weaker long-range component modeling the bulk randomness. The results are computed and analyzed for a wide range of concentration values and disorder scenarios. The unusual structure in the f(t) PDF is found to occur for certain cases that reveal the contribution of multiple catalytic pathways acting in concert.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

WASP-8b: CHARACTERIZATION OF A COOL AND ECCENTRIC EXOPLANET WITH SPITZER

WASP-8b has 2.18 times Jupiter's mass and is on an eccentric (e = 0.31) 8.16 day orbit. With a time-averaged equilibrium temperature of 948 K, it is one of the least-irradiated hot Jupiters observed with the Spitzer Space Telescope. We have analyzed six photometric light curves of WASP-8b during secondary eclipse observed in the 3.6, 4.5, and 8.0 {mu}m Infrared Array Camera bands. The eclipse depths are 0.113% {+-} 0.018%, 0.069% {+-} 0.007%, and 0.093% {+-} 0.023%, respectively, giving respective brightness temperatures of 1552, 1131, and 938 K. We characterized the atmospheric thermal profile and composition of the planet using a line-by-line radiative transfer code and a Markov-chain Monte Carlo sampler. The data indicated no thermal inversion, independently of any assumption about chemical composition. We noted an anomalously high 3.6 {mu}m brightness temperature (1552 K); by modeling the eccentricity-caused thermal variation, we found that this temperature is plausible for radiative timescales less than {approx}10{sup 2} hr. However, as no model spectra fit all three data points well, the temperature discrepancy remains as an open question.

79 ASTRONOMY AND ASTROPHYSICS↗

A statistical rain attenuation prediction model with application to the advanced communication technology satellite project. Part 2: Theoretical development of a dynamic model and application to rain fade durations and tolerable control delays for fade countermeasures

A dynamic rain attenuation prediction model is developed for use in obtaining the temporal characteristics, on time scales of minutes or hours, of satellite communication link availability. Analagous to the associated static rain attenuation model, which yields yearly attenuation predictions, this dynamic model is applicable at any location in the world that is characterized by the static rain attenuation statistics peculiar to the geometry of the satellite link and the rain statistics of the location. Such statistics are calculated by employing the formalism of Part I of this report. In fact, the dynamic model presented here is an extension of the static model and reduces to the static model in the appropriate limit. By assuming that rain attenuation is dynamically described by a first-order stochastic differential equation in time and that this random attenuation process is a Markov process, an expression for the associated transition probability is obtained by solving the related forward Kolmogorov equation. This transition probability is then used to obtain such temporal rain attenuation statistics as attenuation durations and allowable attenuation margins versus control system delay.

Manning, Robert M.↗

SatNet: A Benchmark for Satellite Scheduling Optimization

Satellites provide essential services such as networking and weather tracking, and the number of near-earth and deep space satellites are expected to grow rapidly in the coming years. Communications with terrestrial ground stations is one of the critical functionalities of any space mission. Satellite scheduling is a problem that has been scientifically investigated since the 1970s. A central aspect of this problem is the need to consider resource contention and satellite visibility constraints as they require line of sight. Due to the combinatorial nature of the problem, prior solutions such as linear programs and evolutionary algorithms require extensive compute capabilities to output a feasible schedule for each scenario. Machine learning based scheduling can provide an alternative solution by training a model with historical data and generating a schedule quickly with model inference. We present SatNet, a benchmark for satellite scheduling optimization based on historical data from the NASA Deep Space Network. We propose formulation of the satellite scheduling problem as a Markov Decision Process and use reinforcement learning (RL) policies to generate schedules. The nature of constraints imposed by SatNet differ from other combinatorial optimization problems such as vehicle routing studied in prior literature. Our initial results indicate that RL is an alternative optimization approach that can generate candidate solutions of comparable quality to existing state-of-the-practice results. However, we also find that RL policies overfit to the training dataset and do not generalize well to new data, thereby necessitating continued research on reusable and generalizable agents.

Wilson, Brian↗

Fractal initial conditions and natural parameter values in hybrid inflation

We show that the initial field values required to produce inflation in the two fields original hybrid model, and its supergravity F-term extension, do not suffer from any fine-tuning problem, even when the fields are restricted to be sub-Planckian and for almost all potential parameter values. This is due to the existence of an initial slow-roll violating evolution which has been overlooked so far. Because of the attractor nature of the inflationary valley, these trajectories end up producing enough accelerated expansion of the Universe. By numerically solving the full nonlinear dynamics, we show that the set of such successful initial field values is connected, of dimension 2 and possesses a fractal boundary of infinite length exploring the whole field space. We then perform a Monte-Carlo-Markov-Chain analysis of the whole parameter space consisting of the initial field values, field velocities, and potential parameters. We give the marginalized posterior probability distributions for each of these quantities such that the Universe inflates long enough to solve the usual cosmological problems. Inflation in the original hybrid model and its supergravity version appears to be generic and more probable by starting outside of the inflationary valley. Finally, the implication of our findings in the context of the eternal inflationary scenario are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A retrodictive stochastic simulation algorithm

In this paper we describe a simple method for inferring the initial states of systems evolving stochastically according to master equations, given knowledge of the final states. This is achieved through the use of a retrodictive stochastic simulation algorithm which complements the usual predictive stochastic simulation approach. We demonstrate the utility of this new algorithm by applying it to example problems, including the derivation of likely ancestral states of a gene sequence given a Markovian model of genetic mutation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Observational constraints on holographic dark energy with varying gravitational constant

We use observational data from Type Ia Supernovae (SN), Baryon Acoustic Oscillations (BAO), Cosmic Microwave Background (CMB) and observational Hubble data (OHD), and the Markov Chain Monte Carlo (MCMC) method, to constrain the cosmological scenario of holographic dark energy with varying gravitational constant. We consider both flat and non-flat background geometry, and we present the corresponding constraints and contour-plots of the model parameters. We conclude that the scenario is compatible with observations. In 1σ we find Ω{sub Λ0} = 0.72{sup +0.03}{sub −0.03}, Ω{sub k0} = −0.0013{sup +0.0130}{sub −0.0040}, c = 0.80{sup +0.19}{sub −0.14} and Δ{sub G}≡G'/G = −0.0025{sup +0.0080}{sub −0.0050}, while for the present value of the dark energy equation-of-state parameter we obtain w{sub 0} = −1.04{sup +0.15}{sub −0.20}.

79 ASTRONOMY AND ASTROPHYSICS↗

Fossil Fuel Emission Verification Modeling at LLNL

We have an established project at LLNL to develop the tools needed to constrain fossil fuel carbon dioxide emissions using measurements of the carbon-14 isotope in atmospheric samples. In Figure 1 we show the fossil fuel plumes from Los Angeles and San Francisco for two different weather patterns. Obviously, a measurement made at any given location is going to depend on the weather leading up to the measurement. Thus, in order to determine the GHG emissions from some region using in situ measurements of those GHGs, we use state-of-the-art global and regional atmospheric chemistry-transport codes to simulate the plumes: the LLNL-IMPACT model (Rotman et al., 2004) and the WRFCHEM community code (http://www.wrf-model.org/index.php). Both codes can use observed (aka assimilated) meteorology in order to recreate the actual transport that occurred. The measured concentration of each tracer at a particular spatio-temporal location is a linear combination of the plumes from each region at that location (for non-reactive species). The challenge is to calculate the emission strengths for each region that fit the observed concentrations. In general this is difficult because there are errors in the measurements and modeling of the plumes. We solve this inversion problem using the strategy illustrated in Figure 2. The Bayesian Inference step combines the a priori estimates of the emissions, and their uncertainty, for each region with the results of the observations, and their uncertainty, and an ensemble of model predicted plumes for each region, and their uncertainty. The result is the mathematical best estimate of the emissions and their errors. In the case of non-linearities, or if we are using a statistical sampling technique such as a Markov Chain Monte Carlo technique, then the process is iterated until it converges (ie reaches stationarity). For the Bayesian inference we can use both a direct inversion capability, which is fast but requires assumptions of linearity and Gaussianity of errors, or one of several statistical sampling techniques, which are computationally slower but do not require either linearity or Gaussianity (Chow, et al., 2008; Delle Monache, et al., 2008). The emission regions we are using are based on the air-basins defined by the California Air Resources Board (CARB), see Figure 3. The only difference is that we have joined some of the smaller air basins together. The results of a test using 4 days of simulated observations using our ensemble retrieval system are shown in Figure 3 (right). The main source of the variation between the different model configurations arises from the uncertainty in the atmospheric boundary layer parameterization in the WRF model. We are currently developing a capability to constrain the boundary layer height in our carbon-14 work either by weighting the ensemble member results by the accuracy of their boundary layer height (using commercial aircraft observations), or as part of the retrieval process using an ensemble Kalman filter (EnKF) capability.

54 ENVIRONMENTAL SCIENCES↗

Markovian Search Games in Heterogeneous Spaces

We consider how to search for a mobile evader in a large heterogeneous region when sensors are used for detection. Sensors are modeled using probability of detection. Due to environmental effects, this probability will not be constant over the entire region. We map this problem to a graph search problem and, even though deterministic graph search is NP-complete, we derive a tractable, optimal, probabilistic search strategy. We do this by defining the problem as a differential game played on a Markov chain. We prove that this strategy is optimal in the sense of Nash. Simulations of an example problem illustrate our approach and verify our claims.

97 MATHEMATICS AND COMPUTING↗