Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Monte Carlo Markov chains analysis of WMAP3 and SDSS data points to broken symmetry inflaton potentials and provides a lower bound on the tensor to scalar ratio

We perform a Monte Carlo Markov chains (MCMC) analysis of the available cosmic microwave background (CMB) and large scale structure (LSS) data (including the three years WMAP data) with single field slow-roll new inflation and chaotic inflation models. We do this within our approach to inflation as an effective field theory in the Ginsburg-Landau spirit with fourth degree trinomial potentials in the inflaton field {phi}. We derive explicit formulae and study in detail the spectral index n{sub s} of the adiabatic fluctuations, the ratio r of tensor to scalar fluctuations, and the running index dn{sub s}/dlnk. We use these analytic formulas as hard constraints on n{sub s} and r in the MCMC analysis. Our analysis differs in this crucial aspect from previous MCMC studies in the literature involving the WMAP3 data. Our results are as follows: (i) The data strongly indicate the breaking (whether spontaneous or explicit) of the {phi}{yields}-{phi} symmetry of the inflaton potentials both for new and for chaotic inflation. (ii) Trinomial new inflation naturally satisfies this requirement and provides an excellent fit to the data. (iii) Trinomial chaotic inflation produces the best fit in a very narrow corner of the parameter space. (iv) The chaotic symmetric trinomial potential is almost certainly ruled out (at 95% C.L.). In trinomial chaotic inflation the MCMC runs go towards a potential in the boundary of the parameter space and which resembles a spontaneously symmetry broken potential of new inflation. (v) The above results and further physical analysis here lead us to conclude that new inflation gives the best description of the data. (vi) We find a lower bound for r within trinomial new inflation potentials: r>0.016(95%CL) and r>0.049(68%CL). (vii) The preferred new inflation trinomial potential is a double well, even function of the field with a moderate quartic coupling yielding as most probable values: n{sub s}{approx_equal}0.958, r{approx_equal}0.055. This value for r is within reach of forthcoming CMB observations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Modeling energy balance while correcting for measurement error via free knot splines

Measurements of energy balance components (energy intake, energy expenditure, changes in energy stores) are often plagued with measurement error. Doubly-labeled water can measure energy intake (EI) with negligible error, but is expensive and cumbersome. An alternative approach that is gaining popularity is to use the energy balance principle, by measuring energy expenditure (EE) and change in energy stores (ES) and then back-calculate EI. Gold standard methods for EE and ES exist and are known to give accurate measurements, albeit at a high cost. We propose a joint statistical model to assess the measurement error in cheaper, non-intrusive measures of EE and ES. We let the unknown true EE and ES for individuals be latent variables, and model them using a bivariate distribution. We try both a bivariate Normal as well as a Dirichlet Process Mixture Model, and compare the results via simulation. Our approach, is the first to account for the dependencies that exist in individuals’ daily EE and ES. We employ semiparametric regression with free knot splines for measurements with error, and linear components for error free covariates. We adopt a Bayesian approach to estimation and inference and use Reversible Jump Markov Chain Monte Carlo to generate draws from the posterior distribution. Based on the semiparameteric regression, we develop a calibration equation that adjusts a cheaper, less reliable estimate, closer to the true value. Along with this calibrated value, our method also gives credible intervals to assess uncertainty. A simulation study shows our calibration helps produce a more accurate estimate. Furthermore, our approach compares favorably in terms of prediction to other commonly used models.

60 APPLIED LIFE SCIENCES↗

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗

astroABC : An Approximate Bayesian Computation Sequential Monte Carlo sampler for cosmological parameter estimation

Given the complexity of modern cosmological parameter inference where we arefaced with non-Gaussian data and noise, correlated systematics and multi-probecorrelated data sets, the Approximate Bayesian Computation (ABC) method is apromising alternative to traditional Markov Chain Monte Carlo approaches in thecase where the Likelihood is intractable or unknown. The ABC method is called"Likelihood free" as it avoids explicit evaluation of the Likelihood by using aforward model simulation of the data which can include systematics. Weintroduce astroABC, an open source ABC Sequential Monte Carlo (SMC) sampler forparameter estimation. A key challenge in astrophysics is the efficient use oflarge multi-probe datasets to constrain high dimensional, possibly correlatedparameter spaces. With this in mind astroABC allows for massive parallelizationusing MPI, a framework that handles spawning of jobs across multiple nodes. Akey new feature of astroABC is the ability to create MPI groups with differentcommunicators, one for the sampler and several others for the forward modelsimulation, which speeds up sampling time considerably. For smaller jobs thePython multiprocessing option is also available. Other key features include: aSequential Monte Carlo sampler, a method for iteratively adapting tolerancelevels, local covariance estimate using scikit-learn's KDTree, modules forspecifying optimal covariance matrix for a component-wise or multivariatenormal perturbation kernel, output and restart files are backed up everyiteration, user defined metric and simulation methods, a module for specifyingheterogeneous parameter priors including non-standard prior PDFs, a module forspecifying a constant, linear, log or exponential tolerance level,well-documented examples and sample scripts. This code is hosted online athttps://github.com/EliseJ/astroABC

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Random field optimization

Herein we present a new modeling paradigm for optimization that we call random field optimization. Random fields are a powerful modeling abstraction that aims to capture the behavior of random variables that live on infinite-dimensional spaces (e.g., space and time) such as stochastic processes (e.g., time series, Gaussian processes, and Markov processes), random matrices, and random spatial fields. This paradigm involves sophisticated mathematical objects (e.g., stochastic differential equations and space-time kernel functions) and has been widely used in neuroscience, geoscience, physics, civil engineering, and computer graphics. Despite of this, however, random fields have seen limited use in optimization; specifically, existing optimization paradigms that involve uncertainty (e.g., stochastic programming and robust optimization) mostly focus on the use of finite random variables. This trend is rapidly changing with the advent of statistical optimization (e.g., Bayesian optimization) and multi-scale optimization (e.g., integration of molecular sciences and process engineering). Our work extends a recently-proposed abstraction for infinite-dimensional optimization problems by capturing more general uncertainty representations. Moreover, we discuss solution paradigms for this new class of problems based on finite transformations and sampling, and identify open questions and challenges.

97 MATHEMATICS AND COMPUTING↗

Diffusion approximation of stochastic master equations with jumps

In the presence of quantum measurements with direct photon detection, the evolution of open quantum systems is usually described by stochastic master equations with jumps. Heuristically, diffusion models can be obtained from these equations as an approximation. A condition for a general diffusion approximation for jump master equations is presented. This approximation is rigorously proved by using techniques for Markov processes, which are based on the convergence of Markov generators and martingale problems. This result is illustrated by rigorously obtaining the diffusion approximation for homodyne and heterodyne detection.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The incidence of low-metallicity Lyman-limit systems at z ∼ 3.5: Implications for the cold-flow hypothesis of baryonic accretion

Cold accretion is a primary growth mechanism of simulated galaxies, yet observational evidence of “cold flows” at redshifts where they should be most efficient (z = 2–4) is scarce. In simulations, cold streams manifest as Lyman-limit absorption systems (LLSs) with low heavy-element abundances similar to those of the diffuse intergalactic medium (IGM). Here we report on an abundance survey of 17 H i-selected LLSs at z = 3.2–4.4 which exhibits no metal absorption in Sloan Digital Sky Survey spectra. Using medium-resolution spectra obtained at Magellan, we derive ionization-corrected metallicities (or limits) with a Markov-chain Monte Carlo sampling that accounts for the large uncertainty in N{sub H i} measurements typical of LLSs. The metal-poor LLS sample overlaps with the IGM in metallicity and can be described by a model where 71{sub −11}{sup +13}% are drawn from the IGM chemical abundance distribution. These represent roughly half of all LLSs at these redshifts, suggesting that 28%–40% of the general LLS population at z ∼ 3.7 could trace accreting gas. An ancillary sample of ten LLSs without any a priori metal-line selection is fit by a model having 48{sub −12}{sup +14}% of metallicities drawn from the IGM. We compare these results with regions of a moving-mesh simulation. The observed and simulated LLS metallicity distributions are in good agreement, after accounting for known uncertainties in both, with the fraction of simulated baryons in IGM-metallicity LLSs within a factor of two of the observed value. A statistically significant fraction of all LLSs have low metallicity and therefore represent candidates for accreting gas; large-volume simulations can establish what fraction of these candidates actually lie near galaxies and the observational prospects for detecting the presumed hosts in emission.

79 ASTRONOMY AND ASTROPHYSICS↗

PARAMETERIZING AND MEASURING DARK ENERGY TRAJECTORIES FROM LATE INFLATONS

Bulk dark energy (DE) properties are determined by the redshift evolution of its pressure-to-density ratio, w{sub de}(z). An experimental goal is to decide if the DE is dynamical, as in the quintessence (and phantom) models treated here. We show that a three-parameter approximation w{sub de}(z; {epsilon}{sub s}, {epsilon}{sub {phi}{sup {infinity}}}, {zeta}{sub s}) fits well the ensemble of trajectories for a wide class of late-inflaton potentials V({phi}). Markov Chain Monte Carlo probability calculations are used to confront our w{sub de}(z) trajectories with current observational information on Type Ia supernova, cosmic microwave background, galaxy power spectra, weak lensing, and the Ly{alpha} forest. We find that the best-constrained parameter is a low-redshift slope parameter, {epsilon}{sub s} {proportional_to} ({partial_derivative}ln V/{partial_derivative}{phi}){sup 2} when the DE and matter have equal energy densities. A tracking parameter {epsilon}{sub {phi}{sup {infinity}}} defining the high-redshift attractor of 1 + w{sub de} is marginally constrained. {zeta}{sub s} is poorly determined, which characterizes the evolution of {epsilon}{sub s}, and is a measure of {partial_derivative}{sup 2}ln V/{partial_derivative}{phi}{sup 2}. The constraints we find already rule out some popular quintessence and phantom models, or restrict their potential parameters. We also forecast how the next generation of cosmological observations improve the constraints: by a factor of about five on {epsilon}{sub s} and {epsilon}{sub {phi}{sup {infinity}}}, but with {zeta}{sub s} remaining unconstrained (unless the true model significantly deviates from {Lambda}CDM). Thus, potential reconstruction beyond an overall height and a gradient is not feasible for the large space of late-inflaton models considered here.

79 ASTRONOMY AND ASTROPHYSICS↗

Likelihood-informed dimension reduction for nonlinear inverse problems

The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the posterior may, in many problems, be confined to a relatively low-dimensional subspace of the parameter space. We present a dimension reduction approach that defines and identifies such a subspace, called the 'likelihood-informed subspace' (LIS), by characterizing the relative influences of the prior and the likelihood over the support of the posterior distribution. This identification enables new and more efficient computational methods for Bayesian inference with nonlinear forward models and Gaussian priors. In particular, we approximate the posterior distribution as the product of a lower-dimensional posterior defined on the LIS and the prior distribution marginalized onto the complementary subspace. Markov chain Monte Carlo sampling can then proceed in lower dimensions, with significant gains in computational efficiency. We also introduce a Rao–Blackwellization strategy that de-randomizes Monte Carlo estimates of posterior expectations for additional variance reduction. We demonstrate the efficiency of our methods using two numerical examples: inference of permeability in a groundwater system governed by an elliptic PDE, and an atmospheric remote sensing problem based on Global Ozone Monitoring System (GOMOS) observations.

42 ENGINEERING↗

Quantification of LEU Holdup using gamma ray imaging and inverse transport solver

Holdup is the residual amount of special nuclear material (SNM) remaining in a processing facility after the bulk materials have been cleaned out. In commercial uranium processing facilities, quantification of holdup is a major challenge because of the highly variable shapes and sizes of the deposits. Any method that attempts to generalize and calibrate deposit shapes in order to quantify holdup will be prone to high uncertainties. Uncertainties on the order of ±50% are typical in holdup results. In international safeguards applications, a ±50% uncertainty can result in a large amount of material unaccounted for (MUF) thereby increasing the difficulty of detecting material diversion and facility misuse. An imaging-based methodology has been developed with the objective of significantly reducing this uncertainty by using the true deposit shape, instead of relying on oversimplified geometric assumptions. The project is a collaboration between ORNL, Y-12, and the University of Tennessee, Knoxville, TN. Uranium sources of known masses were measured using the Germanium Gamma-ray Imager (GeGI), a high-resolution imaging spectrometer, creating a pixelated map for each spectral bin. Two different gamma imaging methods are employed in this work: coded aperture imaging and Compton imaging. A validated MonteCarlo model of the detector has been developed using the GEANT4 code for determining the intrinsic response of the detector, its enclosure, and the coded aperture mask. An inverse transport solver based on the Markov Chain Monte-Carlo approach known as Differential Evolution Adaptive Metropolis (DREAM) is employed to use the measurement data from the image pixels (coded aperture or Compton) to solve for the mass of 235 U in the deposit. A reliable method based on the DREAM solver has been developed to flag the infinite thickness condition of a uranium deposit. The project team is working towards improving the image reconstruction for Compton imaging so that a better localization of the source can be achieved. Besides treating the coded aperture and Compton imaging methods independently, the project is also evaluating a combined method that uses the Compton scatter data from a coded aperture measurement. GEANT4 simulations are being performed to evaluate the combined approach. The impact on the DREAM optimization as the source thickness progressively approaches infinite thickness is being evaluated. A number of uranium sources available at ORNL have been measured, and the DREAM results have been tested and validated for the coded aperture imaging. A similar effort will be carried out to validate the Compton based method once the development of algorithms for better localization are complete. The imaging based quantification is very amenable to unattended monitoring of holdup accumulation at key measurement points. A proof of concept measurement has been completed to demonstrate this capability The current work used the high energy resolution imager GeGI. However, the approach and methodologies are applicable to other imagers such as the cadmium zin telluride (CZT) based imager manufactured by H3D, Inc.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation using First-Order Logic

Topic models have been used successfully for a variety of problems, often in the form of application-specific extensions of the basic Latent Dirichlet Allocation (LDA) model. Because deriving these new models in order to encode domain knowledge can be difficult and time-consuming, we propose the Fold-all model, which allows the user to specify general domain knowledge in First-Order Logic (FOL). However, combining topic modeling with FOL can result in inference problems beyond the capabilities of existing techniques. We have therefore developed a scalable inference technique using stochastic gradient descent which may also be useful to the Markov Logic Network (MLN) research community. Experiments demonstrate the expressive power of Fold-all, as well as the scalability of our proposed inference method.

97 MATHEMATICS AND COMPUTING↗

Exclusive pi0 electroproduction in the resonance region

We report the analysis of single ?0 electroproduction in the resonance region to study the electromagnetic excitation of the nucleon resonances. The study is aimed at understanding the internal structure and dynamics of the nucleon. The experiment was performed using an unpolarized cryogenic hydrogen target and polarized electron beam with the CLAS detector at Jefferson Lab. The new measurements produce a data base with high statistics and large kinematic coverage for the hadronic invariant mass W up to 1.8 GeV and in the momentum transfer Q2 range of 0.4 - 1.0 (GeV/c)2 with full angular coverage in the Center of Mass system. This data set is currently being analyzed using a Unitary Isobar Model to determine the Q2 dependence of resonance transition amplitudes for several excited states of the nucleon. Preliminary results will be presented.

Markov, Nikolay↗

Measuring the cosmological bulk flow using the peculiar velocities of supernovae

We study large-scale coherent motion in our universe using the existing Type IA supernovae data. If the recently observed bulk flow is real, then some imprint must be left on supernovae motion. We perform a Bayesian Monte Carlo Markov Chain analysis in various redshift bins and find a sharp contrast between the z < 0.05 and z > 0.05 data. The z < 0.05 data are consistent with the bulk flow in the direction (l,b) = (290{sup +39}{sub −31}°,20{sup +32}{sub −32}°) with a magnitude of v{sub bulk} = 188{sup +119}{sub −103}km/s at 68% confidence. The significance of detection (compared to the null hypothesis) is 95%. In contrast, z > 0.05 data (which contains 425 of the 557 supernovae in the Union2 data set) show no evidence for the bulk flow. While the direction of the bulk flow agrees very well with previous studies, the magnitude is significantly smaller. For example, the Kashlinsky, et al.'s original bulk flow result of v{sub bulk} > 600km/s is inconsistent with our analysis at greater than 99.7% confidence level. Furthermore, our best-fit bulk flow velocity is consistent with the expectation for the ΛCDM model, which lies inside the 68% confidence limit.

79 ASTRONOMY AND ASTROPHYSICS↗

Distance‐based reconstruction of protein quaternary structures from inter‐chain contacts

Abstract Predicting the quaternary structure of protein complex is an important problem. Inter‐chain residue‐residue contact prediction can provide useful information to guide the ab initio reconstruction of quaternary structures. However, few methods have been developed to build quaternary structures from predicted inter‐chain contacts. Here, we develop the first method based on gradient descent optimization (GD) to build quaternary structures of protein dimers utilizing inter‐chain contacts as distance restraints. We evaluate GD on several datasets of homodimers and heterodimers using true/predicted contacts and monomer structures as input. GD consistently performs better than both simulated annealing and Markov Chain Monte Carlo simulation. Starting from an arbitrarily quaternary structure randomly initialized from the tertiary structures of protein chains and using true inter‐chain contacts as input, GD can reconstruct high‐quality structural models for homodimers and heterodimers with average TM‐score ranging from 0.92 to 0.99 and average interface root mean square distance from 0.72 Å to 1.64 Å. On a dataset of 115 homodimers, using predicted inter‐chain contacts as restraints, the average TM‐score of the structural models built by GD is 0.76. For 46% of the homodimers, high‐quality structural models with TM‐score ≥ 0.9 are reconstructed from predicted contacts. There is a strong correlation between the quality of the reconstructed models and the precision and recall of predicted contacts. Only a moderate precision or recall of inter‐chain contact prediction is needed to build good structural models for most homodimers. Moreover, GD improves the quality of quaternary structures predicted by AlphaFold2 on a Critical Assessment of Techniques for Protein Structure Prediction–Critical Assessments of Predictions of Interactions dataset.

59 BASIC BIOLOGICAL SCIENCES↗

Reconstruction of elongated bubbles fusing the information from multiple optical probes through a Bayesian inference technique

In this communication, a novel optical technique has been proposed for the reconstruction of the shape of a Taylor bubble using measurements from multiple arrays of optical sensors. The deviation of an optical beam passing through the bubble depends on the contour of bubble surface. A theoretical model of the deviation of a beam during the traverse of a Taylor bubble through it has been developed. Using this model and the time history of the deviation captured by the sensor array, the bubble shape has been reconstructed. The reconstruction has been performed using an inverse algorithm based on Bayesian inference technique and Markov chain Monte Carlo sampling algorithm. The reconstructed nose shape has been compared with the true shape, extracted through image processing of high speed images. Finally, an error analysis has been performed to pinpoint the sources of the errors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Separating gravitational wave signals from instrument artifacts

Central to the gravitational wave detection problem is the challenge of separating features in the data produced by astrophysical sources from features produced by the detector. Matched filtering provides an optimal solution for Gaussian noise, but in practice, transient noise excursions or ''glitches'' complicate the analysis. Detector diagnostics and coincidence tests can be used to veto many glitches which may otherwise be misinterpreted as gravitational wave signals. The glitches that remain can lead to long tails in the matched filter search statistics and drive up the detection threshold. Here we describe a Bayesian approach that incorporates a more realistic model for the instrument noise allowing for fluctuating noise levels that vary independently across frequency bands, and deterministic glitch fitting using wavelets as glitch templates, the number of which is determined by a transdimensional Markov chain Monte Carlo algorithm. We demonstrate the method's effectiveness on simulated data containing low amplitude gravitational wave signals from inspiraling binary black-hole systems, and simulated nonstationary and non-Gaussian noise comprised of a Gaussian component with the standard LIGO/Virgo spectrum, and injected glitches of various amplitude, prevalence, and variety. Glitch fitting allows us to detect significantly weaker signals than standard techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Impulsive Control for Continuous-Time Markov Decision Processes: A Linear Programming Approach

In this paper, we investigate an optimization problem for continuous-time Markov decision processes with both impulsive and continuous controls. We consider the so-called constrained problem where the objective of the controller is to minimize a total expected discounted optimality criterion associated with a cost rate function while keeping other performance criteria of the same form, but associated with different cost rate functions, below some given bounds. Our model allows multiple impulses at the same time moment. The main objective of this work is to study the associated linear program defined on a space of measures including the occupation measures of the controlled process and to provide sufficient conditions to ensure the existence of an optimal control.

97 MATHEMATICS AND COMPUTING↗