Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Chain Monte Carlo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Tests of General Relativity with Stellar-Mass Black Hole Binaries Observed by LISA

We consider the observation of stellar-mass black holes binaries with the Laser Interferometer Space Antenna(LISA). Preliminary results based on Fisher information matrix analyses have suggested that gravitational waves from those sources could be very sensitive to possible deviations from the theory of general relativity (GR) andfrom the strong equivalence principle during the low-frequency binary inspiral. We perform a full Markov Chain Monte Carlo Bayesian analysis to quantify the sensitivity of these signals to two phenomenological modifications of GR, namely a putative gravitational dipole emission and a non-zero mass for the graviton, properly accounting for the detector’s response. Moreover, we consider a scenario where those sources could be observed also with Earth-based detectors, which should measure the coalescence time with precision better than 1 ms. This constraint on the coalescence time further improves the bounds that we can set on those phenomenological deviations from GR. We show that tests of dipole radiation and the graviton’s mass should improve respectively by seven and half an order(s) of magnitude over current bounds. Finally, we discuss under which conditions one may claim the detection of a modification to General Relativity.

Alexandre Toubiana↗
NASA NTRS2020

Detection of Interstellar HC4NC and an Investigation of Isocyanopolyyne Chemistry under TMC-1 Conditions

Abstract We report an astronomical detection of HC4NC for the first time in the interstellar medium with the Green Bank Telescope toward the TMC-1 molecular cloud with a minimum significance of 10.5σ. The total column density and excitation temperature of HC4NC are determined to be 3.29+8.60 ´ 1011 cm−2 and 6.7+0.3 K, respectively, using -1.20 -0.3 Markov chain Monte Carlo analysis. In addition to HC4NC, HCCNC is distinctly detected whereas no clear detection of HC6NC is made. We propose that the dissociative recombination of the protonated cyanopolyyne, HC5NH+, and the protonated isocyanopolyyne, HC4NCH+, are the main formation mechanisms for HC4NC while its destruction is dominated by reactions with simple ions and atomic carbon. With the proposed chemical networks, the observed abundances of HC4NC and HCCNC are reproduced satisfactorily.

Astrochemistry↗
NASA NTRS2021

Fitting strategies of accretion column models and application to the broadband spectrum of Cen X-3

Due to the complexity of modeling the radiative transfer inside the accretion columns of neutron star binaries, their X-ray spectra are still commonly described with phenomenological models, e.g., a cut off power law. While the behavior of these models is well understood and they allow for a comparison of different sources and studying source behavior, the extent to which the underlying physics can be derived from the model parameters is very limited. During recent years, several physically motivated spectral models have been developed to overcome these limitations. Their application, however, is generally computationally much more expensive and they require a high number of parameters which are difficult to constrain. In particular, Becker & Wolff(2007) presented an analytical solution to the radiative transfer equation inside the accretion column assuming a velocity profile that is linear in the optical depth. An implementation of this model that is both fast and accurate enough to be fitted to observed spectra is available in XSPEC. The main difficulty of this implementation is that some solutions violate energy conservation and therefore have to be rejected by the user. We propose a novel fitting strategy that ensures energy conservation during theχ2-minimization which simplifies the application of the model considerably. We demonstrate this approach as well as a study of possible parameter degeneracies with a comprehensive Markov-Chain Monte Carlo analysis of the complete parameter space for a combined NuSTAR and Swift/XRT dataset of Cen X-3.The derived accretion-flow structure features a small column radius of∼63 m and a spectrum dominated by bulk-Comptonization of bremsstrahlung seed photons, in agreement with previous studies.

X-rays: binaries↗
NASA NTRS2019

FIGS: spectral fitting constraints on the star formation history of massive galaxies since the cosmic noon

We constrain the stellar population properties of a sample of 52 massive galaxies – with stellar mass log (M(s)/M(⊙)) ≳ 10.5 – over the redshift range 0.5 < z < 2 by use of observer-frame optical and near-infrared slitless spectra from Hubble Space Telescope’s ACS and WFC3 grisms. The deep exposures (∼100 ks) allow us to target individual spectra of massive galaxies to F160W = 22.5 AB. Our spectral fitting approach uses a set of six base models adapted to the redshift and spectral resolution of each observation, and fits the weights of the base models, including potential dust attenuation, via a Markov Chain Monte Carlo method. Our sample comprises a mixed distribution of quiescent (19) and star-forming galaxies (33). We quantify the width of the age distribution (Δt) that is found to dominate the variance of the retrieved parameters according to principal component analysis. The population parameters follow the expected trend towards older ages with increasing mass, and Δt appears to weakly anticorrelate with stellar mass, suggesting a more efficient star formation at the massive end. As expected, the redshift dependence of the relative stellar age (measured in units of the age of the Universe at the source) in the quiescent sample rejects the hypothesis of a single burst (aka monolithic collapse). Radial colour gradients within each galaxy are also explored, finding a wider scatter in the star-forming subsample, but no conclusive trend with respect to the population parameters.

Ignacio Ferreras↗
NASA NTRS2021

TIC 168789840: A Sextuply Eclipsing Sextuple Star System

We report the discovery of a sextuply eclipsing sextuple star system from TESS data, TIC 168789840, also known as TYC 7037-89-1, the first known sextuple system consisting of three eclipsing binaries. The target was observed in Sectors 4 and 5 during Cycle 1, with light curves extracted from TESS Full Frame Image data. It was also previously observed by the WASP survey and ASAS-SN. The system consists of three gravitationally bound eclipsing binaries in a hierarchical structure of an inner quadruple system with an outer binary subsystem. Follow up observations from several different observatories were conducted as a means of determining additional parameters. The system was resolved by speckle interferometry with a 0 42 separation between the inner quadruple and outer binary, inferring an estimated outer period of ∼2 kyr. It was determined that the fainter of the two resolved components is an 8.217 day eclipsing binary, which orbits the inner quadruple that contains two eclipsing binaries with periods of 1.570 days and 1.306 days. Markov Chain Monte Carlo (MCMC) analysis of the stellar parameters has shown that the three binaries of TIC 168789840 are “triplets,” as each binary is quite similar to the others in terms of mass, radius, and Teff. As a consequence of its rare composition, structure, and orientation, this object can provide important new insight into the formation, dynamics, and evolution of multiple star systems. Future observations could reveal if the intermediate and outer orbital planes are all aligned with the planes of the three inner eclipsing binaries.

Brian P. Powell↗
NASA NTRS2021

Fitting Strategies of Accretion Column Models and Application to the Broadband Spectrum of Cen X-3

Due to the complexity of modeling the radiative transfer inside the accretion columns of neutron star binaries, their X-ray spectra are still commonly described with phenomenological models, e.g., a cut off power law. While the behavior of these models is well understood and they allow for a comparison of different sources and studying source behavior, the extent to which the underlying physics can be derived from the model parameters is very limited. During recent years, several physically motivated spectral models have been developed to overcome these limitations. Their application, however, is generally computationally much more expensive and they require a high number of parameters which are difficult to constrain. In particular, Becker & Wolff(2007) presented an analytical solution to the radiative transfer equation inside the accretion column assuming a velocity profile that is linear in the optical depth. An implementation of this model that is both fast and accurate enough to be fitted to observed spectra is available in XSPEC. The main difficulty of this implementation is that some solutions violate energy conservation and therefore have to be rejected by the user. We propose a novel fitting strategy that ensures energy conservation during theχ2-minimization which simplifies the application of the model considerably. We demonstrate this approach as well as a study of possible parameter degeneracies with a comprehensive Markov-Chain Monte Carlo analysis of the complete parameter space for a combined NuSTAR and Swift/XRT data-set of Cen X-3.The derived accretion-flow structure features a small column radius of∼63 m and a spectrum dominated by bulk-Comptonization of bremsstrahlung seed photons, in agreement with previous studies

Philipp Thalhammer↗
NASA NTRS2021

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. The combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

Robert S. Schrom↗
NASA NTRS2019

Bayesian Estimation of Earth’s Undiscovered Mineralogical Diversity Using Noninformative Priors

Recently, statistical distributions have been explored to provide estimates of the mineralogical diversity of Earth, and Earth-like planets. In this paper, a Bayesian approach is introduced to estimate Earth’s undiscovered mineralogical diversity. Samples are generated from a posterior distribution of the model parameters using Markov chain Monte Carlo simulations such that estimates and inference are directly obtained. It was previously shown that the mineral species frequency distribution conforms to a generalized inverse Gauss–Poisson (GIGP) large number of rare events model. Even though the model fit was good, the population size estimate obtained by using this model was found to be unreasonably low by mineralogists. In this paper, several zero-truncated, mixed Poisson distributions are fitted and compared, where the Poisson-lognormal distribution is found to provide the best fit. Subsequently, the population size estimates obtained by Bayesian methods are compared to the empirical Bayes estimates. Species accumulation curves are constructed and employed to estimate the population size as a function of sampling size. Finally, the relative abundances, and hence the occurrence probabilities of species in a random sample, are calculated numerically for all mineral species in Earth’s crust using the Poisson-lognormal distribution. These calculations are connected and compared to the calculations obtained in a previous paper using the GIGP model for which mineralogical criteria of an Earth-like planet were given.

Bayesian statistics↗
NASA NTRS2022

Alma Images the Eccentric HD 53143 Debris Disk

We present ALMA 1.3 mm observations of the HD 53143 debris disk—the first infrared or millimeter image produced of this ∼1 Gyr old solar analog. Previous HST STIS coronagraphic imaging did not detect flux along the minor axis of the disk, which could suggest a face-on geometry with two clumps of dust. These ALMA observations reveal a disk with a strikingly different structure. In order to fit models to the millimeter visibilities and constrain the uncertainties on the disk parameters, we adopt a Markov Chain Monte Carlo approach. This is the most eccentric debris disk observed to date with a forced eccentricity of 0.21 ± 0.02, nearly twice that of the Fomalhaut debris disk, and also displays an apocenter glow. Although this eccentric model fits the outer debris disk well, significant interior residuals remain, which may suggest a possible edge-on inner disk, which remains unresolved in these observations. Combined with the observed structure difference between HST and ALMA, these results suggest a potential previous scattering event or dynamical instability in this system. We also note that the stellar flux changes considerably over the course of our observations, suggesting flaring at millimeter wavelengths. Using simultaneous TESS observations, we determine the stellar rotation period to be 9.6 ± 0.1 days.

Radio astronomy↗
NASA NTRSDate not supplied

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗
NASA NTRS2025

Efficient GPU-Accelerated MultiSource Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational-wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analyzing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains massive black hole binaries, compact galactic binaries, and a parametrized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble Markov Chain Monte Carlo (MCMC) sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or transdimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data.We recover posterior distributions for all 15 (6) of the injected massive black hole binaries (MBHB) in the LDC2A training (hidden) dataset. We catalog ∼12000 galactic binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA↗
DOE OSTI2020

Studying the effects of overlapping objects in dark energy

Observing the clustering of galaxies allows us to calculate cosmological parameters necessary for understanding dark energy. However, as the density of observed objects increases, the probability of these objects blending likewise increases, causing multiple galaxies to be observed as one. This affects the inferred values of parameters such as the galaxy bias (b) and the matter energy density (ΩM). To see whether the bias from incorrectly inferring the galaxy count is significant, we compare the correlation functions in simulated data for “true” and “observed” data sets with one-to-one and multiple-to-one correspondences, respectively. For each data set, we create two correlation functions: one “measured” function directly relying on the galaxies’ positions using the TreeCorr python library, and one “model” derived mathematically from the galaxies’ power spectrum using the Cosmological Core Library (CCL). By minimizing the residual between these two functions, we compute the ideal values for b and ΩM across the various possible redshifts that position the galaxies in three dimensional space. This minimization is done with an Markov chain Monte Carlo (MCMC) estimate that finds one value of ΩM and ten values for b corresponding to the ten redshift bins ranging from z = 0.2 to z = 1.2. We find that neither b nor ΩM is particularly affected by inclusion of blended galaxies. Though there is room for improvement, the data suggests that the fluctuations we found are a result of noise or limitations on the modeling rather than blending explicitly.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Bayesian Spatially Varying Multi-Regularization Image Deblurring

Many scientific experiments such as those found in astronomy, geology, microbiology, and X-ray radiography require the use of high-energy instruments to capture images. Since blur and noise are inevitably present in any imaging system, the images must be \deblurred" to extract the full information content. Mathematically, image deblurring is an ill-posed inverse problem that requires regularization. The regularization, in turn, has a large effect on the deblurred image: different regularization strengths, and types, lead to drastically different reconstructions. Moreover, many images contain a mixture of smooth and sharp features which suggests the use of multi-regularization, i.e., varying the type of regularization (e.g. Tikhonov or total variation) across the image. We address these issues by formulating the image deblurring problem within a hierarchical Bayesian framework in which we spatially adapt the strength of the regularization and also vary the regularization type across the image. In this way, the image itself, along with corresponding regularization strength at each pixel, are described jointly by a posterior distribution which we can sample by Markov chain Monte Carlo (MCMC) methods. We illustrate our techniques on simplified test problems and apply them to high-energy X-ray images taken at the Nevada National Security Site. Numerical tests show that our new method is robustly applicable and increases the quality of the image reconstruction when compared to other (Bayesian) methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Invertible neural networks for E3SM land model calibration and simulation

We apply an invertible neural network (INN) for E3SM land model calibration and simulation with eight parameters at the Missouri Ozark AmeriFlux forest site. INN provides bijective (two-way) mappings between inputs and outputs, thus it can solve probabilistic inverse problems and forward approximations simultaneously. We demonstrate INN's inverse and forward capability in both synthetic and real-data applications. Results indicate that INN produces accurate parameter posterior distributions similar to Markov Chain Monte Carlo sampling and it generates model outputs close to the forward model simulations. Additionally, both the inverse and forward evaluations in INN are computationally efficient which allows for rapid integration of observations for parameter estimation and fast model predictions.

Lu, Dan↗
DOE OSTI2022

Estimating Cosmological Constraints from Galaxy Cluster Abundance using Simulation-Based Inference

Inferring the values and uncertainties of cosmological parameters in a cosmology model is of paramount importance for modern cosmic observations. In this paper, we use the simulation-based inference (SBI) approach to estimate cosmological constraints from a simplified galaxy cluster observation analysis. Using data generated from the Quijote simulation suite and analytical models, we train a machine learning algorithm to learn the probability function between cosmological parameters and the possible galaxy cluster observables. The posterior distribution of the cosmological parameters at a given observation is then obtained by sampling the predictions from the trained algorithm. Our results show that the SBI method can successfully recover the truth values of the cosmological parameters within the 2σ limit for this simplified galaxy cluster analysis, and acquires similar posterior constraints obtained with a likelihood-based Markov Chain Monte Carlo method, the current state-of the-art method used in similar cosmological studies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in reference two. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized* data are perfect; 2. Normality: The prior and posterior PDF are normal; and 3. Linearity: The model is linear. In this work we outline how the framework in 1 could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in 1 to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implement- ing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS, and the stochastic method, respectively.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗
DOE OSTI2023

Analysis of Unpolarised p+p¿ Photoproduction with the GlueX Experiment

This thesis presents measurements of spin-density matrix elements in unpolarised p+p? photoproduction on a proton target. The dominant resonance contribution to the dipion system is the r(770) meson. Due to the large production cross section for this resonance, a valid comparison can be made between the obtained final results and r(770) spin-density matrix elements measured previously with other experiments. The measurement was performed over the 3:0 ? 11:6 GeV beam energy regime, which is a more extensive energy range than has ever been studied previously for the r(770). Results were obtained by analysing data from the GlueX experiment based at Jefferson Lab. Extended maximum likelihood fits were applied to extract three spin-density matrix elements using Markov chain Monte Carlo based parameter estimations. This was performed using various binning configurations to probe the energy, mass, and four-momentum transfer dependence of the determined physics observables. Spin-density matrix elements are shown to be consistent with the model of s-channel helicity conservation at low ?t. The effects of pomeron and f2 exchanges are clearly visible in the energy dependence of the measured observables. These observations provide valuable insights into the relative strengths of both processes as a function of the photon energy, and may enable theorists to disentangle the f2=P coupling ratio. Spin-density matrix elements are seen to be highly dependent on the reconstructed resonance mass. This observation is likely to be a result of non-resonant S-wave background processes, and emphasises the need for a more detailed model of the p+p? angular distribution that considers all of the competing angular momentum components that contribute to the measured final state. The statistical precision of measurements performed for this thesis surpass what was achievable in previous studies of the r(770) by several orders of magnitude. Studies of the energy and four-momentum transfer dependence, and insights into the effects of non r(770) background contributions provide valuable input for production models. This will help inform the choice of wave-sets used for partial wave analyses, supporting GlueX in its search for exotic hybrid meson states.

Fitches, James↗