Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Identification of system, observer, and controller from closed-loop experimental data

This paper considers the identification problem of a system operating in closed-loop with an existing feedback controller. The closed-loop system is excited by a known excitation signal, and the resulting time histories of the closed-loop system response and the feedback signal are measured. From the time history data, the algorithm computes the Markov parameters of a closed-loop observer, from which the Markov parameters of the individual open-loop plant, observer, and controller are recovered. A state space model of the open-loop plant and the gain matrices for the controller and the observer are then realized. The results of the paper are demonstrated by an example using actual aircraft flutter test data.

Juang, Jer-Nan↗

A Space-Based Observational Strategy for Characterizing the First Stars and Galaxies Using the Redshifted 21cm Global Spectrum

The redshifted 21 cm monopole is expected to be a powerful probe of the epoch of the first stars and galaxies(10 less than z less than 35). The global 21 cm signal is sensitive to the thermal and ionization state of hydrogen gas and thusprovides a tracer of sources of energetic photonsprimarily hot stars and accreting black holeswhich ionize andheat the high redshift intergalactic medium (IGM). This paper presents a strategy for observations of the globalspectrum with a realizable instrument placed in a low-altitude lunar orbit, performing night-time 40120 MHzspectral observations, while on the farside to avoid terrestrial radio frequency interference, ionospheric corruption,and solar radio emissions. The frequency structure, uniformity over large scales, and unpolarized state of theredshifted 21 cm spectrum are distinct from the spectrally featureless, spatially varying, and polarized emissionfrom the bright foregrounds. This allows a clean separation between the primordial signal and foregrounds. Forsignal extraction, we model the foreground, instrument, and 21 cm spectrum with eigenmodes calculated viaSingular Value Decomposition analyses. Using a Markov Chain Monte Carlo algorithm to explore the parameterspace defined by the coefficients associated with these modes, we illustrate how the spectrum can be measured andhow astrophysical parameters (e.g., IGM properties, first star characteristics) can be constrained in the presence offoregrounds using the Dark Ages Radio Explorer (DARE).

Burns, Jack O.↗

A new paradigm for the molecular basis of rubber elasticity

The molecular basis for rubber elasticity is arguably the oldest and one of the most important questions in the field of polymer physics. The theoretical investigation of rubber elasticity began in earnest almost a century ago with the development of analytic thermodynamic models, based on simple, highly-symmetric configurations of so-called Gaussian chains, i.e. polymer chains that obey Markov statistics. Numerous theories have been proposed over the past 90 years based on the ansatz that the elastic force for individual network chains arises from the entropy change associated with the distribution of end-to-end distances of a free polymer chain. There are serious philosophical objections to this assumption and others, such as the assumption that all network nodes undergo affine motion and that all of the network chains have the same length. Recently, a new paradigm for elasticity in rubber networks has been proposed that is based on mechanisms that originate at the molecular level. Using conventional statistical mechanics analyses, quantum chemistry, and molecular dynamics simulations, the fundamental entropic and enthalpic chain extension forces for polyisoprene (natural rubber) have been determined, along with estimates for the basic force constants. Concurrently, the complex morphology of natural rubber networks (the joint probability density distributions that relate the chain end-to-end distance to its contour length) has also been captured in a numerical model. When molecular chain forces are merged with the network structure in this model, it is possible to study the mechanical response to tensile and compressive strains of a representative volume element of a polymer network. As strain is imposed on a network, pathways of connected taut chains, that completely span the network along strain axis, emerge. Although these chains represent only a few percent of the total, they account for nearly all of the elastic stress at high strain. Here we provide a brief review of previous elasticity theories and their deficiencies, and present a new paradigm with an emphasis on experimental comparisons.

36 MATERIALS SCIENCE↗

Almost sure convergence in quantum spin glasses

Recently, Keating, Linden, and Wells [Markov Processes Relat. Fields 21(3), 537-555 (2015)] showed that the density of states measure of a nearest-neighbor quantum spin glass model is approximately Gaussian when the number of particles is large. The density of states measure is the ensemble average of the empirical spectral measure of a random matrix; in this paper, we use concentration of measure and entropy techniques together with the result of Keating, Linden, and Wells to show that in fact the empirical spectral measure of such a random matrix is almost surely approximately Gaussian itself with no ensemble averaging. We also extend this result to a spherical quantum spin glass model and to the more general coupling geometries investigated by Erdős and Schröder [Math. Phys., Anal. Geom. 17(3-4), 441–464 (2014)].

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantification of early nonpharmaceutical interventions aimed at slowing transmission of Coronavirus Disease 2019 in the Navajo Nation and surrounding states (Arizona, Colorado, New Mexico, and Utah)

During an early period of the Coronavirus Disease 2019 (COVID-19) pandemic, the Navajo Nation, much like New York City, experienced a relatively high rate of disease transmission. Yet, between January and October 2020, it experienced only a single period of growth in new COVID-19 cases, which ended when cases peaked in May 2020. The daily number of new cases slowly decayed in the summer of 2020 until late September 2020. In contrast, the surrounding states of Arizona, Colorado, New Mexico, and Utah all experienced at least two periods of growth in the same time frame, with second surges beginning in late May to early June. Here, we investigated these differences in disease transmission dynamics with the objective of quantifying the contributions of non-pharmaceutical interventions (NPIs) (e.g., behaviors that limit disease transmission). We considered a compartmental model accounting for distinct periods of NPIs to analyze the epidemic in each of the five regions. We used Bayesian inference to estimate region-specific model parameters from regional surveillance data (daily reports of new COVID-19 cases) and to quantify uncertainty in parameter estimates and model predictions. Our results suggest that NPIs in the Navajo Nation were sustained over the period of interest, whereas in the surrounding states, NPIs were relaxed, which allowed for subsequent surges in cases. Our region-specific model parameterizations allow us to quantify the impacts of NPIs on disease incidence in the regions of interest.

60 APPLIED LIFE SCIENCES↗

Differential evolution Markov chain with snooker updater and fewer chains

Differential Evolution Markov Chain (DE-MC) is an adaptive MCMC algorithm, in which multiple chains are run in parallel. Standard DE-MC requires at least N=2d chains to be run in parallel, where d is the dimensionality of the posterior. This paper extends DE-MC with a snooker updater and shows by simulation and real examples that DE-MC can work for d up to 50--100 with fewer parallel chains (e.g. N=3) by exploiting information from their past by generating jumps from differences of pairs of past states. This approach extends the practical applicability of DE-MC and is shown to be about 5--26 times more efficient than the optimal Normal random walk Metropolis sampler for the 97.5% point of a variable from a 25--50 dimensional Student T{sub 3} distribution. In a nonlinear mixed effects model example the approach outperformed a block-updater geared to the specific features of the model.

97 MATHEMATICS AND COMPUTING↗

Fast matrix algebra for Bayesian model calibration

In Bayesian model calibration, evaluation of the likelihood function usually involves finding the inverse and determinant of a covariance matrix. When Markov Chain Monte Carlo (MCMC) methods are used to sample from the posterior, hundreds of thousands of likelihood evaluations may be required. In this paper, we demonstrate that the structure of the covariance matrix can be exploited, leading to substantial time savings in practice. Here, we also derive two simple equations for approximating the inverse of the covariance matrix in this setting, which can be computed in near-quadratic time. The practical implications of these strategies are demonstrated using a simple numerical case study and the "quack" R package. For a covariance matrix with 1000 rows, application of these strategies for a million likelihood evaluations leads to a speedup of roughly 4000 compared to the naive implementation

97 MATHEMATICS AND COMPUTING↗

Impact of cosmic variance on the galaxy-halo connection for Lyα emitters

In this paper we study the impact of cosmic variance and observational uncertainties in constraining the mass and occupation fraction, f{sub occ}, of dark matter (DM) halos hosting Lyα-emitting galaxies (LAEs) at high redshift. To this end, we construct mock catalogs from an N-body simulation to match the typical size of observed fields at z = 3.1 (∼1 deg{sup 2}). In our model a DM halo with mass in the range M{sub min}<M{sub h}<M{sub max} can only host one detectable LAE at most. We proceed to explore the parameter space determined by M{sub min}, M{sub max}, and f{sub occ} with a Markov Chain Monte Carlo algorithm using the angular correlation function and the LAEs’ number density as observational constraints. We find that the preferred minimum and maximum masses in our model span a wide range 10{sup 10.0}h{sup −1}M{sub ⊙}⩽M{sub min}⩽10{sup 11.1}h{sup −1}M{sub ⊙}, 10{sup 11.0}h{sup −1}M{sub ⊙}⩽M{sub max}⩽10{sup 13.0}h{sup −1}M{sub ⊙}, followed by a wide range in the occupation fraction 0.02⩽f{sub occ}⩽0.30. As a consequence, the median mass, M {sub 50}, of all the consistent models has a large uncertainty M{sub 50}=3.16{sub −2.37}{sup +9.34}×10{sup 10} h{sup −1}M{sub ⊙}. However, we find that the same individual models have a relatively tight 1σ scatter around the median mass ΔM{sub 1σ}=0.55{sub −0.31}{sup +0.11} dex. We are also able to show that f{sub occ} is uniquely determined by M{sub min}, regardless of M{sub max}. We argue that upcoming large surveys covering at least 25 deg{sup 2} should be able to put tighter constraints on M{sub min} and f{sub occ} through the LAE number density distribution width constructed over several fields of ∼1 deg{sup 2}.

79 ASTRONOMY AND ASTROPHYSICS↗

Incorporation of probabilistic seismic phase labels into a Bayesian multiple-event seismic locator

We add probabilistic phase labels to the multiple-event joint probability function of Myers et al., 2007 that formerly included event locations, travel-time corrections, and arrival-time measurement precision. Prior information on any of the multiple-event parameters may be used. The phase-label model includes a null label that captures phases not belonging to the collection of phases under consideration. Using the Markov-Chain Monte Carlo method, samples are drawn from the multiple-event joint probability function to infer the posteriori distribution that is consistent with priors and the arrival-time data set. Using this approach phase-label error can be accessed and phase-label error is propagated to all other multiple-event parameters. We test the method using a ground-truth data set of nuclear explosions at the Nevada Test Site. We find that posteriori phase labels agree with the meticulously analyzed data set in more than 97% of instances and the results are robust even when the input phase-label information is discarded. Only when a large percentage of the arrival-time data are corrupted does prior phase label information improve resolution of multiple-event parameters. Simultaneous modeling of the entire multiple-event system results in accurate posteriori probability regions for each multiple-event parameter.

58 GEOSCIENCES↗

Distributional Deep Reinforcement Learning-Based Emergency Frequency Control

Emergency frequency control is one of the most critical approaches to maintain power system stability after major disturbances. With the increasing number of grid-connected renewable energy sources, existing model-based methods of frequency control are facing up with challenges of computational speed and scalability for large-scale systems. In this paper, the emergency frequency control problem is formulated as a Markov Decision Process (MDP) and solved through a novel Distributional Deep Reinforcement Learning (DDRL) method, namely the distributional soft actor critic (DSAC) method. Compared with other RL methods that only estimate the mean value, the proposed DSAC model estimates the distribution of value function over returns. This advancement can lead to more insights and knowledge for the agent, with the benefit of a much faster and more stable learning process, and the improved frequency control performance. Here, the simulation results on IEEE 39-bus and IEEE 118-bus systems demonstrate the effectiveness and robustness of proposed models, as well as the advantage compared to other state-of-the-art DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A ground-based optical transmission spectrum of WASP-6b

We present a ground-based optical transmission spectrum of the inflated sub-Jupiter-mass planet WASP-6b. The spectrum was measured in 20 spectral channels from 480 nm to 860 nm using a series of 91 spectra over a complete transit event. The observations were carried out using multi-object differential spectrophotometry with the Inamori-Magellan Areal Camera and Spectrograph on the Baade Telescope at Las Campanas Observatory. We model systematic effects on the observed light curves using principal component analysis on the comparison stars and allow for the presence of short and long memory correlation structure in our Monte Carlo Markov Chain analysis of the transit light curves for WASP-6. The measured transmission spectrum presents a general trend of decreasing apparent planetary size with wavelength and lacks evidence for broad spectral features of Na and K predicted by clear atmosphere models. The spectrum is consistent with that expected for scattering that is more efficient in the blue, as could be caused by hazes or condensates in the atmosphere of WASP-6b. WASP-6b therefore appears to be yet another massive exoplanet with evidence for a mostly featureless transmission spectrum, underscoring the importance that hazes and condensates can have in determining the transmission spectra of exoplanets.

79 ASTRONOMY AND ASTROPHYSICS↗

Kriging-Based Inverse Uncertainty Quantification of BISON Fission Gas Release Model

Nuclear reactor fuel performance analysis studies the thermo-mechanical behavior of fuel rods and verify their compliance with safety criteria under both normal operation and accidental conditions. One of the major concerns in fuel performance analysis is the behavior of the fission gases xenon and krypton in uranium dioxide fuel, which significantly affect the thermo-mechanical performance of the nuclear fuel rods employed in current LWRs. Previously, the modeling of fission gas release (FGR) in nuclear fuel performance codes have been relying on empirical models which are not applicable beyond their range of calibration. Recently a more efficient and flexible physics-based FGR and swelling model that can describe a wider range of reactor operation conditions have been implemented in fuel performance code BISON. In this work, we performed Bayesian calibration to inversely quantify the uncertainties associated with the 5 tuning parameters in BISON FGR model, based on the time-dependent FGR measurement data from Riso-AN3 benchmark. It takes around 1 hour and 40 minutes for BISON to simulate the Riso-AN3 benchmark with a moderate mesh size using 32 processors. As hundreds of thousands of BISON simulations are needed during Markov Chain Monte Carlo (MCMC) sampling, running BISON directly is not a viable solution. Therefore we propose to use Kriging-based metamodels to replace BISON during MCMC sampling. Surrogate model is an approximation of the input/output relation of a computer code/model. It is also called metamodel, response surface, emulator. Surrogate models usually take much less computational time than the original model (like BISON) while maintaining the input/output relation of the original model to a desirable accuracy. Constructing the metamodels normally requires small number of executions of the original model. Once validated, metamodels can be used to perform uncertainty and sensitivity analysis, Bayesian calibration, optimization, etc.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Operation Optimization Using Reinforcement Learning with Integrated Artificial Reasoning Framework

In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.

Kim, Junyung↗

Bayesian approach to the detection problem in gravitational wave astronomy

The analysis of data from gravitational wave detectors can be divided into three phases: search, characterization, and evaluation. The evaluation of the detection--determining whether a candidate event is astrophysical in origin or some artifact created by instrument noise--is a crucial step in the analysis. The ongoing analyses of data from ground-based detectors employ a frequentist approach to the detection problem. A detection statistic is chosen, for which background levels and detection efficiencies are estimated from Monte Carlo studies. This approach frames the detection problem in terms of an infinite collection of trials, with the actual measurement corresponding to some realization of this hypothetical set. Here we explore an alternative, Bayesian approach to the detection problem, that considers prior information and the actual data in hand. Our particular focus is on the computational techniques used to implement the Bayesian analysis. We find that the parallel tempered Markov chain Monte Carlo (PTMCMC) algorithm is able to address all three phases of the analysis in a coherent framework. The signals are found by locating the posterior modes, the model parameters are characterized by mapping out the joint posterior distribution, and finally, the model evidence is computed by thermodynamic integration. As a demonstration, we consider the detection problem of selecting between models describing the data as instrument noise, or instrument noise plus the signal from a single compact galactic binary. The evidence ratios, or Bayes factors, computed by the PTMCMC algorithm are found to be in close agreement with those computed using a reversible jump Markov chain Monte Carlo algorithm.

79 ASTRONOMY AND ASTROPHYSICS↗

Multiscale models and stochastic simulation methods for computing rare but key binding events in cell biology

The main difficulty in simulating diffusion processes at a molecular level in cell microdomains is due to the multiple scales involving nano- to micrometers. Few to many particles have to be simulated and simultaneously tracked while there are exploring a large portion of the space for binding small targets, such as buffers or active sites. Bridging the small and large spatial scales is achieved by rare events representing Brownian particles finding small targets and characterized by long-time distribution. These rare events are the bottleneck of numerical simulations. A naive stochastic simulation requires running many Brownian particles together, which is computationally greedy and inefficient. Solving the associated partial differential equations is also difficult due to the time dependent boundary conditions, narrow passages and mixed boundary conditions at small windows. We present here two reduced modeling approaches for a fast computation of diffusing fluxes in microdomains. The first approach is based on a Markov mass-action law equations coupled to a Markov chain. The second is a Gillespie's method based on the narrow escape theory for coarse-graining the geometry of the domain into Poissonian rates. The main application concerns diffusion in cellular biology, where we compute as an example the distribution of arrival times of calcium ions to small hidden targets to trigger vesicular release.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Tensors, non-Gaussianities, and the future of potential reconstruction

We present projections for reconstruction of the inflationary potential expected from ESA's upcoming Planck Surveyor CMB mission. We focus on the effects that tensor perturbations and the presence of non-Gaussianities have on reconstruction efforts in the context of non-canonical inflation models. We consider potential constraints for different combinations of detection/null-detection of tensors and non-Gaussianities. We perform Markov Chain Monte Carlo and flow analyses on a simulated Planck-precision data set to obtain constraints. We find that a failure to detect non-Gaussianities precludes a successful inversion of the primordial power spectrum, greatly affecting uncertainties, even in the presence of a tensor detection. In the absence of a detection of tensors, we will be unable to determine the energy scale of inflation. However, a detection of non-Gaussianity will allow us to place tight constraints on suitably chosen combinations of the potential and its derivatives. Constraints are optimized for a positive detection of both tensors and non-Gaussianities.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Cloud Property Retrievals from ARM Active and Passive Measurements

The optimum use of the continuous measurements of thermodynamics, radiation, aerosols, clouds and precipitation from the DOE Atmospheric Radiation Measurement (ARM) program is key to achieve the DOE Atmospheric System Research (ASR)’s objectives. One of the key mission requirements is to retrieve cloud and precipitation properties, as well as vertical motion parameters, along the vertical cross- section defined by the profiling active sensors. Such retrievals are challenging to perform continuously in the entire spectrum of cloud and precipitation conditions due to the large natural microphysical and dynamical variability, the often-limited information content in the measurements, and the lack of proper characterization of measurement quality and uncertainty. Today, the acquisition of new remote and in-situ sensors by the ARM program creates opportunities to address the microphysical retrieval problem by exploiting new, more robust retrieval techniques and integrating various scattered advancements in both sensor techniques and retrieval algorithms. During this project, we constructed a robust Bayesian Markov chain Monte Carlo (MCMC) cloud property retrieval algorithm that includes a state of the art radar forward model. Our MCMC-based retrieval produces both the best estimate of height-resolved cloud and precipitation properties in the radar profile, as well as an estimate of the in-cloud vertical motion and turbulence. In addition, the MCMC algorithm automatically produces robust and flexible estimates of retrieval uncertainty. We tested the algorithm on several synthetic cloud profiles obtained from large eddy simulation (LES) models with bin-resolved microphysics.

54 ENVIRONMENTAL SCIENCES↗

A Space-based Observational Strategy for Characterizing the First Stars and Galaxies Using the Redshifted 21 cm Global Spectrum

The redshifted 21 cm monopole is expected to be a powerful probe of the epoch of the first stars and galaxies (10<z<35). The global 21 cm signal is sensitive to the thermal and ionization state of hydrogen gas and thus provides a tracer of sources of energetic photons—primarily hot stars and accreting black holes—which ionize and heat the high redshift intergalactic medium (IGM). This paper presents a strategy for observations of the global spectrum with a realizable instrument placed in a low-altitude lunar orbit, performing night-time 40–120 MHz spectral observations, while on the farside to avoid terrestrial radio frequency interference, ionospheric corruption, and solar radio emissions. The frequency structure, uniformity over large scales, and unpolarized state of the redshifted 21 cm spectrum are distinct from the spectrally featureless, spatially varying, and polarized emission from the bright foregrounds. This allows a clean separation between the primordial signal and foregrounds. For signal extraction, we model the foreground, instrument, and 21 cm spectrum with eigenmodes calculated via Singular Value Decomposition analyses. Using a Markov Chain Monte Carlo algorithm to explore the parameter space defined by the coefficients associated with these modes, we illustrate how the spectrum can be measured and how astrophysical parameters (e.g., IGM properties, first star characteristics) can be constrained in the presence of foregrounds using the Dark Ages Radio Explorer (DARE).

79 ASTRONOMY AND ASTROPHYSICS↗