SEARCH · Engineering Papers

Results for “Markov models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Error Bounds for Dynamical Spectral Estimation

Dynamical spectral estimation is a well-established numerical approach for estimating eigenvalues and eigenfunctions of the Markov transition operator from trajectory data. Although the approach has been widely applied in biomolecular simulations, its error properties remain poorly understood. Here we analyze the error of a dynamical spectral estimation method called “the variational approach to conformational dynamics" (VAC). We bound the approximation error and estimation error for VAC estimates. Our analysis establishes VAC's convergence properties and suggests new strategies for tuning VAC to improve accuracy.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

A Detailed Characterization of HR 8799's Debris Disk with ALMA in Band 7

The exoplanetary system of HR 8799 is one of the rare systems in which multiple planets have been directly imaged. Its architecture is strikingly similar to that of the solar system, with the four imaged giant planets surrounding a warm dust belt analogous to the Asteroid Belt, and themselves being surrounded by a cold dust belt analog to the Kuiper Belt. Previous observations of this cold belt with ALMA in Band 6 (1.3 mm) revealed its inner edge, but analyses of the data differ on its precise location. It was therefore unclear whether or not the outermost planet HR 8799 b was dynamically sculpting it. We present here new ALMA observations of this debris disk in Band 7 (340 GHz, 880 μm). These are the most detailed observations of this disk obtained so far, with a resolution of 1″ (40 au) and sensitivity of 9.8 μJy beam{sup −1}, which allowed us to recover the disk structure with high confidence. In order to constrain the disk morphology, we fit its emission using radiative transfer models combined with a Markov Chain Monte Carlo procedure. We find that this disk cannot be adequately represented by a single power law with sharp edges. It exhibits a smoothly rising inner edge and smoothly falling outer edge, with a peak in between, as expected from a disk that contains a high-eccentricity component, hence confirming previous findings. Whether this excited population and inner edge shape stem from the presence of an additional planet remains, however, an open question.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS1998

Making the Impossible Possible: Strategies for Fast POMDP Monitoring

Systems modeled as partially observable Markov decision processes (POMDPs) can be tracked quickly with three restrictions: all actions are grouped together, the out-degree of each system state is bounded by a constant, and the number of non-zero elements in the belief state is bounded by a (different) constant. With these restrictions, the tracking algorithm operates in constant time and linear space. The first restriction assumes that the action itself is unobservable. The second restriction defines a subclass of POMDPs that covers however a wide range of problems. The third restriction is an approximation technique that can lead to a potentially vexing problem: an observation may be received that has probability according to the restricted belief state. This problem of impossibility will cause the belief state to collapse. In this paper we discuss the tradeoffs between the constant bound on the belief state and the quality of the solution. We concentrate on strategies for overcoming the impossibility problem and demonstrate initial experimental results that indicate promising directions.

Washington, Richard↗

NASA NTRS2003

Hybrid Discrete-Continuous Markov Decision Processes

This paper proposes a Markov decision process (MDP) model that features both discrete and continuous state variables. We extend previous work by Boyan and Littman on the mono-dimensional time-dependent MDP to multiple dimensions. We present the principle of lazy discretization, and piecewise constant and linear approximations of the model. Having to deal with several continuous dimensions raises several new problems that require new solutions. In the (piecewise) linear case, we use techniques from partially- observable MDPs (POMDPS) to represent value functions as sets of linear functions attached to different partitions of the state space.

Feng, Zhengzhu↗

NASA NTRS2003

Modeling beta-adrenergic control of cardiac myocyte contractility in silico

The beta-adrenergic signaling pathway regulates cardiac myocyte contractility through a combination of feedforward and feedback mechanisms. We used systems analysis to investigate how the components and topology of this signaling network permit neurohormonal control of excitation-contraction coupling in the rat ventricular myocyte. A kinetic model integrating beta-adrenergic signaling with excitation-contraction coupling was formulated, and each subsystem was validated with independent biochemical and physiological measurements. Model analysis was used to investigate quantitatively the effects of specific molecular perturbations. 3-Fold overexpression of adenylyl cyclase in the model allowed an 85% higher rate of cyclic AMP synthesis than an equivalent overexpression of beta 1-adrenergic receptor, and manipulating the affinity of Gs alpha for adenylyl cyclase was a more potent regulator of cyclic AMP production. The model predicted that less than 40% of adenylyl cyclase molecules may be stimulated under maximal receptor activation, and an experimental protocol is suggested for validating this prediction. The model also predicted that the endogenous heat-stable protein kinase inhibitor may enhance basal cyclic AMP buffering by 68% and increasing the apparent Hill coefficient of protein kinase A activation from 1.0 to 2.0. Finally, phosphorylation of the L-type calcium channel and phospholamban were found sufficient to predict the dominant changes in myocyte contractility, including a 2.6x increase in systolic calcium (inotropy) and a 28% decrease in calcium half-relaxation time (lusitropy). By performing systems analysis, the consequences of molecular perturbations in the beta-adrenergic signaling network may be understood within the context of integrative cellular physiology.

Non-NASA Center↗

NASA NTRS2006

Markovian Statistical Data Analysis of Single-Event Upsets Triggered by High Intensity Neutrons

This paper analyzes data from a single-event upset experiment conducted at the Los Alamos National Laboratory. Statistical tools, based on well-known x(sup 2) hypothesis testing theory, are used to determine if sequences of upsets can be modeled as a homogeneous Markov chain of a specific order. The experiment consisted of radiating a new experimental flight control computer (FCC) with a high intensity neutron beam while the FCC controlled a simulation of a Boeing 737. The analyzed data is a sequence of states that indicates when the FCC is under an upset condition.

Lakdawala, Anushka V.↗

NASA NTRS2007

Particle Analysis Pitfalls

This viewgraph presentation reviews the use of particle analysis to assist in preparing for the 4th Hubble Space Telescope (HST) Servicing mission. During this mission the Space Telescope Imaging Spectrograph (STIS) will be repaired. The particle analysis consisted of Finite element mesh creation, Black-body viewfactors generated using I-DEAS TMG Thermal Analysis, Grey-body viewfactors calculated using Markov method, Particle distribution modeled using an iterative Monte Carlo process, (time-consuming); in house software called MASTRAM, Differential analysis performed in Excel, and Visualization provided by Tecplot and I-DEAS. Several tests were performed and are reviewed: Conformal Coat Particle Study, Card Extraction Study, Cover Fastener Removal Particle Generation Study, and E-Graf Vibration Particulate Study. The lessons learned during this analysis are also reviewed.

Hughes, David↗

NASA NTRS2016

Coupled Retrieval of Aerosol Properties and Surface Reflection Using the Airborne Multi-Angle SpectroPolarimetric Imager (AirMSPI)

The Airborne Multi-angle SpectroPolarimetric Imager (AirMSPI) has been flying aboard the NASA ER-2 high altitude aircraft since October 2010. In step-and-stare operation mode, AirMSPI acquires radiance and polarization data at 355, 380, 445, 470*, 555, 660*, 865*, and 935 nm (* denotes polarimetric bands). The imaged area covers about 10 km by 10 km and is observed from 9 view angles between ±67° off of nadir. We have developed an efficient and flexible code that uses the information content of AirMSPI data for a coupled retrieval of aerosol properties and surface reflection. The retrieval was built based on the multi-pixel optimization concept, with the use of a hybrid radiative transfer model that combines the Markov Chain and adding/doubling methods. The convergence and robustness of our algorithm is ensured by applying constraints on (a) the spectral variation of the Bidirectional Polarization Distribution Function (BPDF) and angular shape of the Bidirectional Reflectance Distribution Function (BRDF); (b) the spectral variation of aerosol optical properties; and (c) the spatial variation of aerosol parameters across neighboring image pixels. Our retrieval approach has been tested using over 20 AirMSPI datasets having low to moderately high aerosol loadings (~0.02<AOD550-nm<~0.45) and acquired during several field campaigns. Results are compared with AERONET aerosol reference data. We also explore the benefits of AirMSPI’s ultraviolet and polarimetric bands as well as the use of multiple view angles.

Xu, Feng↗

DOE OSTI2020

Automated Adversary Emulation for Cyber-Physical Systems via Reinforcement Learning

Adversary emulation is an offensive exercise that provides a comprehensive assessment of a system’s resilience against cyber attacks. However, adversary emulation is typically a manual process, making it costly and hard to deploy in cyber-physical systems (CPS) with complex dynamics, vulnerabilities, and operational uncertainties. In this paper, we develop an automated, domain-aware approach to adversary emulation for CPS. We formulate a Markov Decision Process (MDP) model to determine an optimal attack sequence over a hybrid attack graph with cyber (discrete) and physical (continuous) components and related physical dynamics. We apply model-based and model-free reinforcement learning (RL) methods to solve the discrete-continuous MDP in a tractable fashion. As a baseline, we also develop a greedy attack algorithm and compare it with the RL procedures. We summarize our findings through a numerical study on sensor deception attacks in buildings to compare the performance and solution quality of the proposed algorithms.

Bhattacharya, Arnab↗

DOE OSTI2022

Quantum Markov chain Monte Carlo with digital dissipative dynamics on quantum computers

Modeling the dynamics of a quantum system connected to the environment is critical for advancing our understanding of complex quantum processes, as most quantum processes in nature are affected by an environment. Modeling a macroscopic environment on a quantum simulator may be achieved by coupling independent ancilla qubits that facilitate energy exchange in an appropriate manner with the system and mimic an environment. This approach requires a large, and possibly exponential number of ancillary degrees of freedom which is impractical. In contrast, we develop a digital quantum algorithm that simulates interaction with an environment using a small number of ancilla qubits. By combining periodic modulation of the ancilla energies, or spectral combing, with periodic reset operations, we are able to mimic interaction with a large environment and generate thermal states of interacting many-body systems. We evaluate the algorithm by simulating preparation of thermal states of the transverse Ising model. Our algorithm can also be viewed as a quantum Markov chain Monte Carlo process that allows sampling of the Gibbs distribution of a multivariate model. To illustrate this we evaluate the accuracy of sampling Gibbs distributions of simple probabilistic graphical models using the algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Joint estimation of biogeochemical model parameters from multiple experiments: A bayesian approach applied to mercury methylation

Here, to characterize complex biogeochemical systems, results from multiple experiments, where each targets a specific subprocess, are commonly combined. The resulting datasets are interpreted through the calibration of biogeochemical models for process inference and predictions. Commonly used calibration approaches of fitting datasets from individual experiments to subprocess models one at a time is prone to missing information shared between datasets and incomplete uncertainty propagation. We propose a Bayesian joint-fitting scheme addressing the above-mentioned concerns by jointly fitting all the available datasets, thus calibrating the entire biogeochemical model in one go using Markov Chain Monte Carlo (MCMC). The identification of null spaces in the parameter distributions from MCMC guided the simplification of certain subprocess models. For example, fast kinetic sorption was replaced by equilibrium sorption, and Monod demethylation was replaced by first-order demethylation. Joint fitting of datasets resulted in complete uncertainty propagation with parameter estimates informed by all available data.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2003

Transition-Independent Decentralized Markov Decision Processes

There has been substantial progress with formal models for sequential decision making by individual agents using the Markov decision process (MDP). However, similar treatment of multi-agent systems is lacking. A recent complexity result, showing that solving decentralized MDPs is NEXP-hard, provides a partial explanation. To overcome this complexity barrier, we identify a general class of transition-independent decentralized MDPs that is widely applicable. The class consists of independent collaborating agents that are tied up by a global reward function that depends on both of their histories. We present a novel algorithm for solving this class of problems and examine its properties. The result is the first effective technique to solve optimally a class of decentralized MDPs. This lays the foundation for further work in this area on both exact and approximate solutions.

Becker, Raphen↗

DOE OSTI2023

Deep Neural Network Informed Markov Chain Monte Carlo Methods

In subsurface flow modeling, quantifying the uncertainty of model parameters and the corresponding uncertainly on output quantities is a crucial task for groundwater management. Markov chain Monte Carlo (MCMC) methods can take advantage of observed data to estimate parameters in a Bayesian setting. However, MCMC can be slow to converge and produce highly correlated samples when the dimensions of the parameters is high. Using gradients for the posterior distribution can help samplers explore the parameter space more efficiently, but obtaining gradients can be computationally challenging.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1987

Optimal service allocation among two heterogeneous traffic types with no queueing

Two communication traffic streams with Poisson statistics arrive at a network node. These are to be transmitted across a channel with a total bandwidth capacity of C slots. Messages not accepted at the node are assumed to be lost. Under the assumptions of exponential service time distributions, the problem of dynamic allocation of available channel bandwidth among the two traffic types is studied in order to minimize a weighted sum of blocking probabilities. Modeling the system as a two-dimensional Markov chain is studied to minimize a weighted sum of blocking probabilities. Modeling the system as a two-dimensional Markov chain, it is shown by an application of dynamic programming principles that the optimal policy has the form of a 'switching curve'.

Lambadaris, I.↗

DOE OSTI2020

Moderate-resolution K-band Spectroscopy of Substellar Companion κ Andromedae b

We present moderate-resolution (R ∼ 4000) K-band spectra of the “super-Jupiter,” κ Andromedae b. The data were taken with the OSIRIS integral field spectrograph at Keck Observatory. The spectra reveal resolved molecular lines from H{sub 2}O and CO, and are compared to a custom PHOENIX atmosphere model grid appropriate for young planetary-mass objects. We fit the data using a Markov chain Monte Carlo forward-modeling method. Using a combination of our moderate-resolution spectrum and low-resolution, broadband data from the literature, we derive an effective temperature of T {sub eff} = 1950–2150 K, a surface gravity of logg=3.5--4.5, and a metallicity of [M/H] = −0.2–0.0. These values are consistent with previous estimates from atmospheric modeling and the currently favored young age of the system (<50 Myr). We derive a C/O ratio of 0.70{sub −0.24}{sup +0.09} for the source, broadly consistent with the solar C/O ratio. This, coupled with the slightly subsolar metallicity, implies a composition consistent with that of the host star, and is suggestive of formation by a rapid process. The subsolar metallicity of κ Andromedae b is also consistent with predictions of formation via gravitational instability. Further constraints on formation of the companion will require measurement of the C/O ratio of κ Andromedae A. We also measure the radial velocity of κ Andromedae b for the first time, with a value of −1.4 ± 0.9 km s{sup −1} relative to the host star. We find that the derived radial velocity is consistent with the estimated high eccentricity of κ Andromedae b.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1994

A new stochastic systems approach to structural integrity

This paper develops improved stochastic models for the description of a large variety of fatigue crack growth phenomena that occur in components of considerable importance to the functionality and reliability of complex engineering structures. In essence, the models are based on the McGill-Markov and Closure-Lognormal stochastic processes. Not only do these models have the capability of predicting the statistical dispersion of crack growth rates, they also, by incorporating the concept of crack closure, have the capability of transferring stochastic crack growth properties measured under ideal laboratory conditions to situations of industrial significance, such as those occurring under adverse loading and/or environmental conditions. The primary data required in order to be in a position to estimate the pertinent parameters of these stochastic models are obtained from a statistically significant number of replicate tests. In this paper, both the theory and the experimental technique are illustrated using a Ti-6Al-4V alloy. Finally, important structural integrity, reliability, availability and maintainability concepts are developed and illustrated.

Provan, James W.↗

NASA NTRS1975

Time-controlled descent guidance in uncertain winds

A procedure has been developed for constructing a statistical model of the altitude-dependent mean wind profile from the historical record of wind measurements at particular locations. The model is constructed by fitting a Markov process, with altitude as the stage variable, to the historical wind data. The wind model, together with the aircraft dynamics and the error characteristics of the navigation system, are incorporated in the design of a state estimator, which gives the minimum variance estimate of the aircraft state and the wind vector. The state and wind estimates are used as inputs to a linear feedback law for guiding the aircraft along the nominal trajectory. An example design of a time-constrained (4D RNAV) descent guidance system is presented, showing tracking accuracy, control activity, and probability of arrival time with and without the wind estimator.

Menga, G.↗

NASA NTRS2016

Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties

Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.

spectroscopy↗