Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MCMC”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model: Modeling Archive

This archive contains the data and Python scripts required to reproduce the analyses and figures in the study: Gomez-Velez, J. D., Rathore, S. S., Cohen, M. J., & Painter, S. L. (2025). Hyporheic-zone Processes and Stream Oxygen Dynamics: Insights from a Multiscale Reactive Transport Model. Submitted to Water Resources Research. The analysis utilizes the subgrid model Advection Dispersion Equation with Lagrangian Subgrids (ADELS) implemented in the Advanced Terrestrial Simulator (ATS; https://amanzi.github.io/ats/stable/). In this case, the ATS and Amanzi versions are (1) ATS version 1.5.1_f5ba18f8 and (2) Amanzi version 1.6-dev_53444cca4. The repository includes a Jupyter Notebook and the necessary data (Pandas DataFrames stored as pickle files) to generate the figures for the manuscript. Additionally, it contains Python scripts to create ATS input files, run the ATS simulations, and post-process the results. Finally, it provides routines for parameter estimation using the Single-Station Metabolism (SSM) model with the Differential Evolution Adaptive Metropolis (DREAM) Markov Chain Monte Carlo (MCMC) algorithm with ZS enhancements (DREAM-ZS).

54 ENVIRONMENTAL SCIENCES↗

Robust Importance Sampling for Bayesian Model Calibration with Spatio-Temporal Data

This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.

97 MATHEMATICS AND COMPUTING↗

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗

Fast Emulation of Expensive Simulations using Approximate Gaussian Processes [Slides]

Nuclear Computational Low-Energy Initiative (NUCLEI) collaboration uses Density Functional Theory (DFT) simulations to predict the structure and binding energies of nuclei over a wide range of proton (Z) and neutron (N) numbers. The DFT simulations utilize a particular parameterization of a Skyrme energy density functional called UNEDF1 which depends on 12 free parameters that must be fit to data (M Kortelainen et al 2014). Fitting involves comparing (e.g.) predicted binding energies of nuclei to experimentally measured values. We use only binding energies as observables, but DFT with UNEDF1 will predict structure (shape) observables as well. In this work, assessing the capability of approximate GP emulators to balance emulator accuracy with computational speed to facilitate improved UNEDF1 calibration. Sparse GPs are straightforward to train and accurate. Calibration is not straightforward with MCMC (using MH or HMC/NUTS). We produced reusable software for continuing and building on this work as well as accessing and using Darwin cluster compute resources

97 MATHEMATICS AND COMPUTING↗

Weak Gravitational Lensing of Low Surface Brightness Galaxies in the Dark Energy Year 3 Catalog

We present galaxy-galaxy lensing measurements of a sample of low surface brightness galaxies (LSBGs) drawn from the Dark Energy Survey Year 3 (Y3) data. LSBGs are diffuse galaxies with a surface brightness dimmer than the ambient night sky. Given their faintness, the use of standard observational techniques proves challenging. Weak gravitational lensing probes both the baryonic and dark matter content of galaxies, rendering it a powerful technique to estimate LSBG masses. The LSBG lens sample consists of 23, 790 total extended galaxies separated into red and blue color types at \(g-i\ge 0.60\) and \(g-i\le 0.60\), respectively. We use the Y3 \sc{metacalibration} shape catalog as the source sample, with a number density of \(5.59 \mathrm{gal}/\mathrm{arcmin}^2\). We measure the tangential shear around the lens galaxies across angular scales of \(0.25-400\) arcmin and find a signal-to-noise of 6.67 for red galaxies, 2.17 for blue galaxies, and 5.30 for the total sample. We fit a model built from two NFW profiles corresponding to the LSBG dark matter subhalo and host halo to the red LSBG shear measurements with an MCMC. We estimate the host halo mass at \(7.3 ^{+2.0}_{-1.6}\times 10^{12} M_\mathrm{\odot}\). We place a 95\% upper bound on the subhalo mass at \(3\times 10^{11} M_\mathrm{\odot}\). We utilize the lens sample photometry to obtain an estimate of the red LSBG stellar mass distribution. We compare the ratio between the stellar mass and the subhalo mass to the parameterized, satellite-specific SHMR. This work represents the first example of an attempted constraint on the masses of LSBGs using weak gravitational lensing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Trustworthy Physics-Informed Deep Learning for Predictive Scientific Computing

This project has developed powerful trustworthy physics-informed deep learning (TPiDL) models and methods to fundamentally enhance the scale and power of computational modeling in the scientific and engineering domains. Deep learning (DL) has radically advanced the state-of-the-art in machine learning, computer vision, natural language processing, and also scientific computing. Nevertheless, progress has been driven almost entirely by empirical observations, hacks, and tricks. Under the support of this project, the graph operator learning tools and advanced trustworthy physical informed neural networks have been developed. In addition, stochastic gradient replica-exchange Markov Chain Monte Carlo (MCMC) sampling algorithms have been designed to quantify the uncertainties and speed up the training of large-scale neural networks.

97 MATHEMATICS AND COMPUTING↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Yttrium solid phase equation of state with uncertainty quantification

We discuss the development of an equation of state (EOS) for solid yttrium up to roughly 80 GPa. The EOS makes use of different experimental datasets, including measurements of the isobaric density, isobaric specific heat, room temperature isotherm, and principal shock Hugoniot. The fitting procedure is carried out using Markov Chain Monte Carlo (MCMC), where we fit model parameters for both the cold curve and ion thermal models simultaneously. The results show close agreement with experimental data and provide meaningful uncertainty estimates on the model parameters. This work serves as a first step towards a multiphase EOS for yttrium, which will include higher pressure solid phases (> 80 GPa), as well as modeling of the liquid phase.

36 MATERIALS SCIENCE↗

Analyzing rotational bands in odd-mass nuclei using effective field theory and Bayesian methods

We recently developed an Effective Field Theory (EFT) for rotational bands in odd-mass nuclei. Here we use EFT expressions to perform a Bayesian analysis of data on the rotational energy levels of 99 Tc, 155,157 Gd, 159 Dy, 167,169 Er, 167,169 Tm, 183 W, 235 U and 239 Pu. The error model in our Bayesian analysis includes both experimental and EFT truncation uncertainties. It also accounts for the fact that low-energy constants (LECs) at even and odd orders are expected to have different sizes. We use Markov Chain Monte Carlo (MCMC) sampling to explore the joint posterior of the EFT and error-model parameters and show both the LECs and the breakdown scale can be reliably determined. We extract the LECs up to fourth order in the EFT and find that, provided we correctly account for EFT truncation errors in our likelihood, results for lower-order LECs are stable as we go to higher orders. LEC results are also stable with respect to the addition of higher-energy data. We extract the expansion parameter for all the nuclei listed above and find a clear correlation between the extracted and the expected value of the inverse breakdown scale, W, based on the single-particle and vibrational energy scales. However, the W that actually determines the convergence of the EFT expansion is markedly smaller than would be naively expected based on those scales.

EFT↗

TIC 168789840: A Sextuply Eclipsing Sextuple Star System

We report the discovery of a sextuply eclipsing sextuple star system from TESS data, TIC 168789840, also known as TYC 7037-89-1, the first known sextuple system consisting of three eclipsing binaries. The target was observed in Sectors 4 and 5 during Cycle 1, with lightcurves extracted from TESS Full Frame Image data. It was also previously observed by the WASP survey and ASAS-SN. The system consists of three gravitationally bound eclipsing binaries in a hierarchical structure of an inner quadruple system with an outer binary subsystem. Follow-up observations from several different observatories were conducted as a means of determining additional parameters. The system was resolved by speckle interferometry with a 0.″42 separation between the inner quadruple and outer binary, inferring an estimated outer period of ∼2 kyr. It was determined that the fainter of the two resolved components is an 8.217 day eclipsing binary, which orbits the inner quadruple that contains two eclipsing binaries with periods of 1.570 days and 1.306 days. Markov Chain Monte Carlo (MCMC) analysis of the stellar parameters has shown that the three binaries of TIC 168789840 are “triplets,” as each binary is quite similar to the others in terms of mass, radius, and T {sub eff}. As a consequence of its rare composition, structure, and orientation, this object can provide important new insight into the formation, dynamics, and evolution of multiple star systems. Future observations could reveal if the intermediate and outer orbital planes are all aligned with the planes of the three inner eclipsing binaries.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Probing Physics beyond the Standard Model through Combined Analyses of Next-generation Type Ia Supernova, Cosmic Microwave Background, and Baryon Acoustic Oscillation Surveys

Observations of Type Ia supernovae (SNe Ia), which probe the late Universe, together with baryon acoustic oscillations (BAO) and the cosmic microwave background (CMB), which probe the intermediate and early epochs, provide complementary constraints on the expansion history of the Universe. In this work, we forecast constraints on dark energy and other extensions to the standard cosmological model by combining the SN Ia sample expected from the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), data from current and forthcoming CMB surveys, and BAO measurements from the Dark Energy Spectroscopic Instrument (DESI). For the CMB, we use temperature, polarization, and lensing power spectra (TT/EE/TE/ϕϕ) from the South Pole Telescope, the planned Advanced Simons Observatory, and a CMB-S4–like experiment. We derive constraints on ΛCDM and its extensions involving the dark energy equation-of-state parameters (w 0 , w a ) and the sum of neutrino masses ∑m ν using a Markov Chain Monte Carlo (MCMC) sampling framework. We find that the LSST Year 3 SN Ia sample can improve upon the DES Year 5 dark energy constraints by a factor of 2−2.5×, with the gains driven primarily by the significantly higher SN Ia density in the LSST sample. Similarly, DESI-DR3 shows up to a 1.8× improvement on dark energy parameters over DR2, driven largely by the substantial increase in the low-redshift sample. Combining CMB with LSST-Y3-SN Ia and DESI-DR3-BAO yields σ(w 0 ) = 0.028 and σ(w a ) = 0.11 for w 0 w a CDM cosmology with the results being largely independent of the CMB dataset. The constraints weaken by 10%–30% when freeing ∑m ν and spatial curvature. Moreover, the joint analysis of the three datasets can enable a 2σ–3σ detection of ∑m ν .

Raghunathan, Srinivasan [University of California;↗

Model Calibration with Markov Chain Monte Carlo Tutorial

The purpose of this tutorial is to demonstrate how to use Markov chain Monte Carlo (MCMC) to calibrate a model. By calibration, we mean the selection of model parameters (and, when relevant, structures). A common goal in model development and diagnostics is calibration, or the identification of model structures and parameters which are consistent with data. While models can be calibrated through hand-tuning parameters or minimizing simple error metrics such as root-mean-square-error (RMSE), these approaches can underrepresent the probabilistic nature of the data-generating process, as well as the potential for multiple model configurations to be consistent with the data. Probabilistic uncertainty quantification, which is the topic of this notebook, can address these concerns. This tutorial is presented as an appendix to the e-book: Addressing Uncertainty in MultiSector Dynamics Research.

Markov chain Monte Carlo↗

Five-Year Wilkinson Microwave Anisotropy Probe (WMAP1) Observations: Galactic Foreground Emission

We present a new estimate of foreground emission in the WMAP data, using a Markov chain Monte Carlo (MCMC) method. The new technique delivers maps of each foreground component for a variety of foreground models, error estimates of the uncertainty of each foreground component, and provides an overall goodness-of-fit measurement. The resulting foreground maps are in broad agreement with those from previous techniques used both within the collaboration and by other authors. We find that for WMAP data, a simple model with power-law synchrotron, free-free, and thermal dust components fits 90% of the sky with a reduced X(sup 2) (sub v) of 1.14. However, the model does not work well inside the Galactic plane. The addition of either synchrotron steepening or a modified spinning dust model improves the fit. This component may account for up to 14% of the total flux at Ka-band (33 GHz). We find no evidence for foreground contamination of the CMB temperature map in the 85% of the sky used for cosmological analysis.

Gold, B.↗

Black Hole Mergers as Probes of Structure Formation

Observations of gravitational waves from massive black hole (MBH) mergers can provide us with important clues about the era of structure formation in the early universe. Previous research in this field has been limited to calculating merger rates of MBHs using different models where many assumptions are made about the specific values of physical parameters of the mergers, resulting in merger rate estimates that span 5 to 6 orders of magnitude. We develop a semi-analytical, phenomenological model that includes plausible combinations of several physical parameters involved in the mergers. which we then turn around to determine how well LISA observations will be able to enhance our understanding of the universe during the critical z approximately equal to 5-30 structure formation era. We do this by generating synthetic LISA observable data (masses, redshifts, merger rates), which are then analyzed using a Markov Chain Monte Carlo (MCMC) method. This allows us to constrain the physical parameters of the mergers.

Alicea-Munoz, Emily↗

Estimating the Properties of Hard X-Ray Solar Flares by Constraining Model Parameters

We wish to better constrain the properties of solar flares by exploring how parameterized models of solar flares interact with uncertainty estimation methods. We compare four different methods of calculating uncertainty estimates in fitting parameterized models to Ramaty High Energy Solar Spectroscopic Imager X-ray spectra, considering only statistical sources of error. Three of the four methods are based on estimating the scale-size of the minimum in a hypersurface formed by the weighted sum of the squares of the differences between the model fit and the data as a function of the fit parameters, and are implemented as commonly practiced. The fourth method is also based on the difference between the data and the model, but instead uses Bayesian data analysis and Markov chain Monte Carlo (MCMC) techniques to calculate an uncertainty estimate. Two flare spectra are modeled: one from the Geostationary Operational Environmental Satellite X1.3 class flare of 2005 January 19, and the other from the X4.8 flare of 2002 July 23.We find that the four methods give approximately the same uncertainty estimates for the 2005 January 19 spectral fit parameters, but lead to very different uncertainty estimates for the 2002 July 23 spectral fit. This is because each method implements different analyses of the hypersurface, yielding method-dependent results that can differ greatly depending on the shape of the hypersurface. The hypersurface arising from the 2005 January 19 analysis is consistent with a normal distribution; therefore, the assumptions behind the three non- Bayesian uncertainty estimation methods are satisfied and similar estimates are found. The 2002 July 23 analysis shows that the hypersurface is not consistent with a normal distribution, indicating that the assumptions behind the three non-Bayesian uncertainty estimation methods are not satisfied, leading to differing estimates of the uncertainty. We find that the shape of the hypersurface is crucial in understanding the output from each uncertainty estimation technique, and that a crucial factor determining the shape of hypersurface is the location of the low-energy cutoff relative to energies where the thermal emission dominates. The Bayesian/MCMC approach also allows us to provide detailed information on probable values of the low-energy cutoff, Ec, a crucial parameter in defining the energy content of the flare-accelerated electrons. We show that for the 2002 July 23 flare data, there is a 95% probability that Ec lies below approximately 40 keV, and a 68% probability that it lies in the range 7-36 keV. Further, the low-energy cutoff is more likely to be in the range 25-35 keV than in any other 10 keV wide energy range. The low-energy cutoff for the 2005 January 19 flare is more tightly constrained to 107 +/- 4 keV with 68% probability.

X-rays↗

Integrating Chlorophyll fapar and Nadir Photochemical Reflectance Index from EO-1/Hyperion to Predict Cornfield Daily Gross Primary Production

The concept of light use efficiency (Epsilon) and the concept of fraction of photosynthetically active ration (PAR) absorbed for vegetation photosynthesis (PSN), i.e., fAPAR (sub PSN), have been widely utilized to estimate vegetation gross primary productivity (GPP). It has been demonstrated that the photochemical reflectance index (PRI) is empirically related to ε. An experimental US Department of Agriculture (USDA) cornfield in Maryland was selected as our study field. We explored the potential of integrating fAPAR(sub chl) (defined as the fraction of PAR absorbed by chlorophyll) and nadir PRI (PRI(sub nadir)) to predict cornfield daily GPP. We acquired nadir or near-nadir EO-1/Hyperion satellite images that covered the cornfield and took nadir in-situ field spectral measurements. Those data were used to derive the PRI(sub nadir) and fAPAR (sub chl). The fAPAR (sub chl) is retrieved with the advanced radiative transfer model PROSAIL2 and the Metropolis approach, a type of Markov Chain Monte Carlo (MCMC) estimation procedure. We define chlorophyll light use efficiency Epsilon (sub chl) as the ratio of vegetation GPP as measured by eddy covariance techniques to PAR absorbed by chlorophyll (Epsilon(sub chl) = GPP/APAR (sub chl). Daily Epsilon (sub chl) retrieved with the EO-1 Hyperion images was regressed with a linear equation of PRI (sub nadir) Epsilon (sub chl) = Alpha × PRI (sub nadir) + Beta). The satellite Epsilon(sub chl- PRI (sub nadir) linear relationship for the cornfield was implemented to develop an integrated daily GPP model [GPP = (Alpha × PRI(sub nadir) + Beta) × fAPAR (sub chl) × PAR], which was evaluated with fAPAR (sub chl) and PRI (sub nadir) retrieved from field measurements. Daily GPP estimated with this fAPAR (sub chl-) PRI (nadir) integration model was strongly correlated with the observed tower in-situ daily GPP (R(sup 2) = 0.93); with a root mean square error (RMSE) of 1.71 g C mol−(sup -1) PPFD and coefficient of variation (CV) of 16.57%. Both seasonal Epsilon (sub chl) and PRI (sub nadir) were strongly correlated with fAPAR (sub chl ) retrieved from field measurements, which indicates that chlorophyll content strongly affects seasonal epsilon (sub chl) and PRI (sub nadir). We demonstrate the potential capacity to monitor GPP with space-based visible through shortwave infrared (VSWIR) imaging spectrometers such as NASA's soon to be decommissioned EO- 1/Hyperion and the future Hyperspectral Infrared Imager (HyspIRI).

HyspIRI↗

A Computationally-Efficient Inverse Approach to Probabilistic Strain-Based Damage Diagnosis

This work presents a computationally-efficient inverse approach to probabilistic damage diagnosis. Given strain data at a limited number of measurement locations, Bayesian inference and Markov Chain Monte Carlo (MCMC) sampling are used to estimate probability distributions of the unknown location, size, and orientation of damage. Substantial computational speedup is obtained by replacing a three-dimensional finite element (FE) model with an efficient surrogate model. The approach is experimentally validated on cracked test specimens where full field strains are determined using digital image correlation (DIC). Access to full field DIC data allows for testing of different hypothetical sensor arrangements, facilitating the study of strain-based diagnosis effectiveness as the distance between damage and measurement locations increases. The ability of the framework to effectively perform both probabilistic damage localization and characterization in cracked plates is demonstrated and the impact of measurement location on uncertainty in the predictions is shown. Furthermore, the analysis time to produce these predictions is orders of magnitude less than a baseline Bayesian approach with the FE method by utilizing surrogate modeling and effective numerical sampling approaches.

Warner, James E.↗

Extratropical Large-Scale Traveling Weather Systems in the Southern Hemisphere on Mars

From late-autumn through early-spring, the middle- and high-latitudes of both hemispheres of Mars and its predominantly carbon-dioxide atmosphere support mean equator-to-pole thermal contrasts, and then, support a strong mean westerly polar vortex. Observations from orbiting spacecraft indicate that this intense mean baroclinicity-barotropicity supports large-scale eastward traveling weather systems (i.e., transient, traveling synoptic-period waves, on the order of the Rossby deformation scale). On Earth, extratropical weather disturbances arise from wind-shear instabilities, and these are critical components of the terrestrial global circulation. So it is the case for Mars. Large-scale traveling weather systems on Mars serve as agents in the transport of heat, momentum and scalar and tracer quantities (e.g., atmospheric dust, watervapor, ice clouds, chemical species, etc). Such weather systems interact with other large-scale atmospheric circulation components, namely, quasi-stationary (i.e., forced Rossby) modes; global thermal tidal modes; and then, upon large-/continental- geographical scales, upslope/ down-slope flows amongst high relief, low relief, impact basins, and volcanic rises, and more. The character of Mars' traveling extratropical weather disturbances in its southern hemisphere during late winter through early spring is investigated using a high-resolution Mars global climate model (i.e., Mars GCM), and one from the Agency's Mars Climate Modeling Center (MCMC) based at the NASA Ames Research Center. The climate model includes several complex atmospheric physical packages. With such physics modules, our global climate simulations present comparatively well with observations of the planet's current water cycle (Haberle et al.,2019). The climate model is "forced" with an annual dust cycle (i.e., nudged based on MGS/TES observations). Compared to the northern-hemisphere counterparts, the southern synoptic-period weather disturbances and accompanying frontal waves have smaller meridional and zonal scales, and are less intense. Influences of the zonally asymmetric (i.e., east-west varying) topography on southern large-scale weather are investigated, in addition to large-scale up-slope/down-slope flows and the diurnal cycle. A southern storm zone in late winter and early spring presents in the western hemisphere via orographic influences from the Tharsis highlands, and the Argyre and Hellas impact basins. Geographically localized transient-wave activity diagnostics are constructed that illuminate dynamical differences amongst the simulations and these are presented.

Hollingsworth, Jeffery L.↗