Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Chain Monte Carlo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

mvBayes

SAND2026-16980O mvBayes implements multivariate Bayesian regression using MATLAB and decomposes a multivariate or functional response into components based on a user-specified orthogonal basis. This allows for independent modeling of each component with any chosen univariate Bayesian regression model. This tool includes methods for prediction and visualization, facilitating the evaluation of Bayesian surrogate models through the application of Bayesian theory and Markov Chain Monte Carlo (MCMC) sampling techniques. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Tucker, J. Derek [Sandia National Lab. (SNL-CA), L↗

A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description

A novel framework is proposed for the bulk parameterization of rain microphysics: the Bayesian Observationally Constrained Statistical–Physical Scheme (BOSS). It is designed to facilitate direct constraint by observations using Bayesian inference. BOSS combines existing process-level microphysical knowledge with flexible process rate formulations and parameters constrained by observations within a Bayesian framework. Furthermore, using a raindrop size distribution (DSD) normalization method that relates DSD moments to one another via generalized power series, generalized multivariate power expressions are derived for the microphysical process rates as functions of a set of prognostic DSD moments. The scheme is flexible and can utilize any number and combination of prognostic moments and any number of terms in the process rate formulations. This means that both uncertainty in parameter values and structural uncertainty associated with the process rate formulations can be investigated systematically, which is not possible using traditional schemes. In this paper, BOSS is compared to two- and three-moment versions of a traditional bulk rain microphysics scheme (denoted as MORR). It is demonstrated that some process formulations in MORR are analytically equivalent to the generalized power expressions in BOSS using one or two terms, while others are not. BOSS is able to replicate the behavior of MORR in idealized one-dimensional rainshaft tests, but with a much more flexible and systematic design. Part II of this study describes the application of BOSS to derive rain microphysical process rates and posterior parameter distributions in Bayesian experiments using Markov chain Monte Carlo sampling constrained by synthetic observations.

58 GEOSCIENCES↗

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. Furthermore, the combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

54 ENVIRONMENTAL SCIENCES↗

Which Combinations of Environmental Conditions and Microphysical Parameter Values Produce a Given Orographic Precipitation Distribution?

This study applies an idealized modeling framework, alongside a Bayesian Markov chain Monte Carlo (MCMC) algorithm, to explore which combinations of upstream environmental conditions and cloud microphysical parameter values can produce a particular precipitation distribution over an idealized two-dimensional, bell-shaped mountain. Simulations focus on orographic precipitation produced when an atmospheric river interacts with topography. MCMC-based analysis reveals that different combinations of parameter values produce a similar precipitation distribution, with the most influential parameters being relative humidity (RH), horizontal wind speed (U), surface potential temperature (θ sfc ), and the snow fall speed coefficient (A s ). RH, U, and A s exhibit interdependence: changes in one or more of these factors can be mitigated by compensating changes in the other(s) to produce similar orographic precipitation rates. The results also indicate that the parameter sensitivities and relationships can vary for spatial subregions and given different environmental conditions. In particular, high θ sfc values are more likely to produce the target precipitation rate and spatial distribution, and thus the ensemble of simulations shows a preference for liquid precipitation at the surface. The results presented here highlight the complexity of orographic precipitation controls, and have implications for flood and water management, observational efforts, and climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiclass Classification Using Bayesian Multivariate Adaptive Regression Splines

We present a new Bayesian model for the problem of multiclass classification. In this model, the probabilities of class membership of a given observation are determined by the mean of a latent Gaussian distribution. The mean functions of this latent distribution consist of combinations of highly flexible basis functions of the inputs: multivariate adaptive regression splines (MARS), first developed for multiple regression. We use reversible jump Markov chain Monte Carlo to make inference on the classification model, including the number of basis functions. We compare the probabilistic classification performance of our proposed approach to existing methods on simulated and benchmark data, and compare uncertainty estimates on simulated data. Our proposed method compares favorably with existing Bayesian and frequentist multiclass classification methods in out-of-sample probabilistic classification, and uncertainty estimation of these probabilistic classifications. We examine the fit of the proposed method to a data set of hurricane storm surge levels near Delaware Bay, US, and conclude that sea level rise is a key contributor to damage delivered by storm surge.

97 MATHEMATICS AND COMPUTING↗

Model-Data for Joint Estimation of Biogeochemical Model Parameters from Multiple Experiments: A Bayesian Approach Applied to Mercury Methylation

This modeling archive supports the manuscript submitted for publication in the Environmental Modeling and Software. This study is supported by ORNL-SFA and IDEAS-Watershed. This study aims to improve calibration of complex biogeochemical models using datasets from multiple experiments targeting specific subprocesses. The proposed Bayesian joint-fitting scheme calibrates the entire biogeochemical model in one go using all the available datasets and estimate parameter uncertainties using Markov Chain Monte Carlo (MCMC). This allows for complete propagation of uncertainties and utilization of the information shared between different datasets. Mapping joint distribution of parameters guides model improvement by identifying null spaces in the parameter space. This archive contains files used to perform MCMC, post-process outputs and visualize results.

East Fork Poplar Creek↗

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in Ref. [2]. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized data are perfect. 2. Normality: The prior and posterior PDF are normal. 3. Linearity: The model is linear. In this work we outline how the framework in [1] could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in [1] to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implementing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS and the stochastic method, respectively. The graphic in Figure 1 categorizes the methods discussed in terms of the assumptions that they employ to determine posterior PDFs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Combining biomarker and virus phylogenetic models improves HIV-1 epidemiological source identification

To identify and stop active HIV transmission chains new epidemiological techniques are needed. Here, we describe the development of a multi-biomarker augmentation to phylogenetic inference of the underlying transmission history in a local population. HIV biomarkers are measurable biological quantities that have some relationship to the amount of time someone has been infected with HIV. To train our model, we used five biomarkers based on real data from serological assays, HIV sequence data, and target cell counts in longitudinally followed, untreated patients with known infection times. The biomarkers were modeled with a mixed effects framework to allow for patient specific variation and general trends, and fit to patient data using Markov Chain Monte Carlo (MCMC) methods. Subsequently, the density of the unobserved infection time conditional on observed biomarkers were obtained by integrating out the random effects from the model fit. This probabilistic information about infection times was incorporated into the likelihood function for the transmission history and phylogenetic tree reconstruction, informed by the HIV sequence data. To critically test our methodology, we developed a coalescent-based simulation framework that generates phylogenies and biomarkers given a specific or general transmission history. Testing on many epidemiological scenarios showed that biomarker augmented phylogenetics can reach 90% accuracy under idealized situations. Under realistic within-host HIV-1 evolution, involving substantial within-host diversification and frequent transmission of multiple lineages, the average accuracy was at about 50% in transmission clusters involving 5–50 hosts. Realistic biomarker data added on average 16 percentage points over using the phylogeny alone. Using more biomarkers improved the performance. Shorter temporal spacing between transmission events and increased transmission heterogeneity reduced reconstruction accuracy, but larger clusters were not harder to get right. More sequence data per infected host also improved accuracy. We show that the method is robust to incomplete sampling and that adding biomarkers improves reconstructions of real HIV-1 transmission histories. The technology presented here could allow for better prevention programs by providing data for locally informed and tailored strategies.

60 APPLIED LIFE SCIENCES↗

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluation of residue management practices on barley residue decomposition

Optimizing barley (hordeum vulgare L.) production in Idaho and other parts of the Pacific Northwest (PNW) should focus on farm resource management. The effect of post-harvest residue management on barley residue decomposition has not been adequately studied. Thus, the objective of this study was to determine the effect of residue placement (surface vs. incorporated), residue size (chopped vs. ground-sieved) and soil type (sand and sandy loam) on barley residue decomposition. A 50-day(d) laboratory incubation experiment was conducted at a temperature of 25°C at the Aberdeen Research and Extension Center, Aberdeen, Idaho, USA. Following the study, a Markov-Chain Monte Carlo (MCMC) modeling approach was applied to investigate the first-order decay kinetics of barley residue. An accelerated initial flush of residue carbon(C)-mineralization was measured for the sieved (Day 1) compared to chopped (Day 3 to 5) residues for both surface incorporated applications. The highest evolution of carbon dioxide (CO 2 )-C of 8.3 g kg -1 dry residue was observed on Day 1 from the incorporated-sieved application for both soils. The highest and lowest amount of cumulative CO 2 -C released and percentage residue decomposed over 50-d was observed for surface-chopped (107 g kg -1 dry residue and 27%, respectively) and incorporated-sieved (69 g kg -1 dry residue and 18%, respectively) residues, respectively. There were no significant differences in C-mineralization from barley residue based on soil type or its interactions with residue placement and size (p >0.05). The largest decay constant k of 0.0083 d -1 was calculated for surface-chopped residue where the predicted half-life was 80 d, which did not differ from surface sieved or incorporated chopped. In contrast, incorporated-sieved treatments only resulted in a k of 0.0054 d -1 and would need an additional 48 d to decompose 50% of the residue. Future residue decomposition studies under field conditions are warranted to verify the residue C-mineralization and its impact on residue management.

59 BASIC BIOLOGICAL SCIENCES↗

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗

Detecting outbreaks using a spatial latent field

In this paper, we present a method for estimating the infection-rate of a disease as a spatial-temporal field. Our data comprises time-series case-counts of symptomatic patients in various areal units of a region. We extend an epidemiological model, originally designed for a single areal unit, to accommodate multiple units. The field estimation is framed within a Bayesian context, utilizing a parameterized Gaussian random field as a spatial prior. We apply an adaptive Markov chain Monte Carlo method to sample the posterior distribution of the model parameters condition on COVID-19 case-count data from three adjacent counties in New Mexico, USA. Our results suggest that the correlation between epidemiological dynamics in neighboring regions helps regularize estimations in areas with high variance (i.e., poor quality) data. Using the calibrated epidemic model, we forecast the infection-rate over each areal unit and develop a simple anomaly detector to signal new epidemic waves. Our findings show that anomaly detector based on estimated infection-rates outperforms a conventional algorithm that relies solely on case-counts.

Safta, Cosmin [Sandia National Laboratories (SNL-C↗

Official data release for Bayes 2022 paper, arXiv:2311.07835

Official data release to accompany the first NOvA Bayesian results paper, https://arxiv.org/abs/2311.07835. The included `README.md` below describes the contents more fully, but in short, included here are: * A `README.md` describing the files * Four `.root` files containing marginal posterior densities in neutrino oscillation parameters, and associated 1D and 2D credible regions derived from them * One `.root` file containing a `TTree` with Markov Chain Monte Carlo samples, which can be used to recreate the posteriors above. **Please use the URL below to download this large (2GB) file** https://mod.fnal.gov/cwsmod/n/nova_docdb_ext/arxiv-2311.07835.data-release.mcmcsamples.root * One Jupyter notebook giving extensive examples how the MCMC samples above can be used

Collaboration, NOvA↗

Constraining Bedrock Groundwater Residence Times in a Mountain System with Environmental Tracer Observations and Bayesian Uncertainty Quantification: Modeling and Data Package

Groundwater residence times provide fundamental descriptions of hydrologic dynamics and mixing processes in mountainous watersheds. Yet, few observational datasets that can constrain groundwater residence times over broad timescales are available in high elevation mountain systems. Here we present field observations from May 2021 of dissolved noble gases (He, Ne, Ar, Kr, and Xe), Chloroflourcarbons (CFCs), Sulfurhexaflouride (SF6), and tritium (3H) sampled from the Pumphouse Lower Montane study site (wells PLM1, PLM6, and PLM7) within the East River Watershed, Colorado. The presented noble gas (PLM_noblegas_2021.csv) and environmental tracer (PLM_tracers_2021.csv) observation datasets, along with the associated modeling scripts, aide in quantifying groundwater residence times and recharge conditions in a high elevation mountain system. Furthermore, the modeling scripts quantify groundwater residence time and noble gas recharge condition uncertainties using a novel Markov-chain Monte Carlo approach. All data modeling scripts are written in the Python code.

54 ENVIRONMENTAL SCIENCES↗

Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model: Modeling Archive

This archive contains the data and Python scripts required to reproduce the analyses and figures in the study: Gomez-Velez, J. D., Rathore, S. S., Cohen, M. J., & Painter, S. L. (2025). Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model. Submitted to Water Resources Research. The analysis utilizes the subgrid model Advection Dispersion Equation with Lagrangian Subgrids (ADELS) implemented in the Advanced Terrestrial Simulator (ATS; https://amanzi.github.io/ats/stable/). In this case, the ATS and Amanzi versions are (1) ATS version 1.5.1_f5ba18f8 and (2) Amanzi version 1.6-dev_53444cca4. The repository includes a Jupyter Notebook and the necessary data (Pandas DataFrames stored as pickle files) to generate the figures for the manuscript. Additionally, it contains Python scripts to create ATS input files, run the ATS simulations, and post-process the results. Finally, it provides routines for parameter estimation using the Single-Station Metabolism (SSM) model with the Differential Evolution Adaptive Metropolis (DREAM) Markov Chain Monte Carlo (MCMC) algorithm with ZS enhancements (DREAM-ZS).

54 ENVIRONMENTAL SCIENCES↗

Robust Importance Sampling for Bayesian Model Calibration with Spatio-Temporal Data

This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.

97 MATHEMATICS AND COMPUTING↗

A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics

We study the utility and performance of a Bayesian model error embedding construction in the context of molecular dynamics modeling of metallic alloys, where we embed model error terms in existing interatomic potential model parameters. To alleviate the computational burden of this approach, we propose a framework combining likelihood approximation and Gaussian process surrogates. Here we leverage sparse Gaussian process techniques to construct a hierarchy of increasingly accurate but more expensive surrogate models. This hierarchy is then exploited by multilevel Markov chain Monte Carlo methods to efficiently sample from the target posterior distribution. We illustrate the utility of this approach by calibrating an interatomic potential model for a family of gold-copper alloys. In particular, this case study highlights effective means for dealing with computational challenges with Bayesian model error embedding in large-scale physical models, and the utility of embedded model error for model diagnostics.

Bayesian inference↗

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗