Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

SDSS-IV MaStar: theoretical atmospheric parameters for the MaNGA stellar library

ABSTRACT We calculate the fundamental stellar parameters effective temperature, surface gravity, and iron abundance – Teff, log g, [Fe/H] – for the final release of the Mapping Nearby Galaxies at APO (MaNGA) Stellar Library (MaStar), containing 59 266 per-visit-spectra for 24 290 unique stars at intermediate resolution (R ∼ 1800) and high S/N (median = 96). We fit theoretical spectra from model atmospheres by both MARCS and BOSZ-ATLAS9 to the observed MaStar spectra, using the full spectral fitting code pPXF. We further employ a Bayesian approach, using a Markov Chain Monte Carlo (MCMC) technique to map the parameter space and obtain uncertainties. Originally in this paper, we cross match MaStar observations with Gaia photometry, which enable us to set reliable priors and identify outliers according to stellar evolution. In parallel to the parameter determination, we calculate corresponding stellar population models to test the reliability of the parameters for each stellar evolutionary phase. We further assess our procedure by determining parameters for standard stars such as the Sun and Vega and by comparing our parameters with those determined in the literature from high-resolution spectroscopy (APOGEE and SEGUE) and from lower resolution matching template (LAMOST). The comparisons, considering the different methodologies and S/N of the literature surveys, are favourable in all cases. Our final parameter catalogue for MaStar cover the following ranges: 2592 ≤ Teff ≤ 32 983 K; −0.7 ≤ log g ≤ 5.4 dex; −2.9 ≤ [Fe/H] ≤ 1.0 dex and will be available with the last SDSS-IV Data Release, in 2021 December.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Calibration of Stochastic Agent Based Model via Random Forest

Agent-based models (ABM) provide an excellent framework for modeling outbreaks and interventions in epidemiology by explicitly accounting for diverse individual interactions and environments. However, these models are usually stochastic and highly parametrized, requiring precise calibration for predictive performance. When considering realistic numbers of agents and properly accounting for stochasticity, this high-dimensional calibration can be computationally prohibitive. This paper presents a random forest-based surrogate modeling technique to accelerate the evaluation of ABMs and demonstrates its use to calibrate an epidemiological ABM named CityCOVID via Markov chain Monte Carlo (MCMC). The technique is first outlined in the context of CityCOVID's quantities of interest, namely hospitalizations and deaths, by exploring dimensionality reduction via temporal decomposition with principal component analysis (PCA) and via sensitivity analysis. The calibration problem is then presented, and samples are generated to best match COVID-19 hospitalization and death numbers in Chicago from March to June in 2020. Further, these results are compared with previous approximate Bayesian calibration (IMABC) results, and their predictive performance is analyzed, showing improved performance with a reduction in computation.

60 APPLIED LIFE SCIENCES↗

Confronting interacting dark radiation scenarios with cosmological data

Dark radiation (DR) is generally predicted in new physics scenarios that address fundamental puzzles of the Standard Model or tensions in the cosmological data. Cosmological data have the sensitivity to constrain not only the energy density of DR but also whether it is interacting. In this paper, we present a systematic study of five types of interacting DR (free-streaming, fluid, decoupling, instantaneous decoupling, and recoupling DR) and their impact on cosmological observables. We modify the Boltzmann hierarchy to describe all these types of interacting DR under the relaxation time approximation. We, for the first time, robustly calculate the collision terms for recoupling scalar DR and provide a better estimation of the recoupling transition redshift. We demonstrate the distinct features of each type of DR on the cosmic microwave background and matter power spectra. We perform Markov-chain Monte Carlo scans using the Planck 2018 data and baryon acoustic oscillation data. Assuming no new physics in the standard model neutrino sector, we find no statistically significant constraints on the couplings of DR, although there is a slight preference for the fluidlike limit of all the cases. In the case of instantaneous decoupling DR, this limit corresponds to a late transition redshift around recombination. Furthermore, the ΔN eff constraint varies marginally depending on the type of DR.

79 ASTRONOMY AND ASTROPHYSICS↗

Diffusion growth mechanism of penta-twinned Ag nanocrystals from decahedral seeds

Crystals with penta-twinned structures can be produced from diverse fcc metals, but the mechanisms that control the final product shapes are still not well understood. By using the theory of absorbing Markov chains to account for the growth of penta-twinned decahedral seeds via atom deposition and surface diffusion, we predicted the formation of various types of products: decahedra, nanorods, and nanowires. We showed that the type of product depends on the morphology of the seed and that small differences between various seed morphologies can lead to significantly different products. For the case of uncapped decahedra seeds, we compared predictions from our model to nanowire morphologies obtained in two different experiments and obtained favorable agreement. Finally, possible extensions of our model are indicated.

36 MATERIALS SCIENCE↗

Network Modeling of Complex Data Sets

We demonstrate a selection of network and machine learning techniques useful in the analysis of complex datasets, including 2-way similarity networks, Markov clustering, enrichment statistical networks, FCROS differential analysis, and random forests. We demonstrate each of these techniques on the Populus trichocarpa gene expression atlas.

Jones, Piet C.↗

Discrepancy quantification between experimental and simulated data of CO 2 adsorption isotherm using hierarchical Bayesian estimation

Here, to quantitatively analyze the inconsistencies commonly observed between experimental and simulated adsorption isotherms, parameter estimation of adsorption isotherm models was conducted by hierarchical Bayesian estimation with parameter uncertainties being quantified as probability distributions. The estimation method was implemented using Markov Chain Monte Carlo (MCMC) to analyze multiple data sets obtained from different sources, including a publicly available database. To describe the discrepancies of experimental and simulated adsorption data, the simulation data was set as the reference to which experimental measurements were compared. We applied the proposed approach to analyze CO 2 adsorption isotherms that are measured and simulated on zeolite 13X and MIL-101(Cr). In these case studies, the discrepancy of CO 2 adsorption isotherm was successfully quantified between experimental measurements and predictions given by molecular simulations using Grand Canonical Monte Carlo (GCMC), where uncertainties were quantified as probability distributions. Furthermore, experimental data sets that agree well with the GCMC simulation have been identified, providing insights into experimental and measurement methods as well as choosing the right assumptions in the molecular simulation.

42 ENGINEERING↗

Covariance-Free Bifidelity Control Variates Importance Sampling for Rare Event Reliability Analysis

Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world problems, particularly when failure is a rare event. To implement multifidelity modeling, estimators that efficiently combine information from multiple models/sources are necessary. In past works, the variance reduction techniques of control variates (CV) and importance sampling (IS) have been leveraged for this task. In this paper, we present the CVIS framework—a creative take on a coupled CV and IS estimator for bifidelity reliability analysis. The framework addresses some of the practical challenges of the CV method by using an estimator for the control variate mean and sidestepping the need to estimate the covariance between the original estimator and the control variate through a clever choice for the tuning constant. Furthermore, the task of selecting an efficient IS distribution is also considered, with a view towards maximally leveraging the bifidelity structure and maintaining expressivity. Additionally, a diagnostic is provided that indicates both the efficiency of the algorithm as well as the relative predictive quality of the models utilized. Finally, the behavior and performance of the framework is explored through analytical and numerical examples.

Markov chain Monte Carlo↗

Autonomous Cyber Defense Against Dynamic Multi-strategy Infrastructural DDoS Attacks

Dynamic Infrastructural Distributed Denial of Service (I-DDoS) attacks constantly change attack vectors to congest core backhaul links and disrupt critical network availability while evading end-system defenses. To effectively counter these highly dynamic attacks, defense mechanisms need to exhibit adaptive decision strategies for real-time mitigation. This paper presents a novel Autonomous DDoS Defense framework that employs model-based reinforcement agents. The framework continuously learns attack strategies, predicts attack actions, and dynamically determines the optimal composition of defense tactics such as filtering, limiting, and rerouting for flow diversion. Our contributions include extending the underlying formulation of the Markov Decision Process (MDP) to address simultaneous DDoS attack and defense behavior, and accounting for environmental uncertainties. We also propose a fine-grained action mitigation approach robust to classification inaccuracies in Intrusion Detection Systems (IDS). Additionally, our reinforcement learning model demonstrates resilience against evasion and deceptive attacks. Evaluation experiments using real-world and simulated DDoS traces demonstrate that our autonomous defense framework ensures the delivery of approximately 96 - 98% of benign traffic despite the diverse range of attack strategies.

Dutta, Ashutosh↗

Using Machine Learning to Generate a GISS ModelE Calibrated Physics Ensemble (CPE)

A neural network (NN) surrogate of the NASA GISS ModelE atmosphere (version E3) is trained on a perturbed parameter ensemble (PPE) spanning 45 physics parameters and 36 outputs. The NN is leveraged in a Markov Chain Monte Carlo (MCMC) Bayesian parameter inference framework to generate a second posterior constrained ensemble coined a “calibrated physics ensemble,” or CPE. The CPE members are characterized by diverse parameter combinations and are, by definition, close to top-of-atmosphere radiative balance, and must broadly agree with numerous hydrologic, energy cycle and radiative forcing metrics simultaneously. Global observations of numerous cloud, environment, and radiation properties (provided by global satellite products) are crucial for CPE generation. The inference framework explicitly accounts for discrepancies (or biases) in satellite products during CPE generation. We demonstrate that product discrepancies strongly impact calibration of important model parameter settings (e.g., convective plume entrainment rates; fall speed for cloud ice). Structural improvements new to E3 are retained across CPE members (e.g., stratocumulus simulation). Notably, the framework improved the simulation of shallow cumulus and Amazon rainfall while not degrading radiation fields, an upgrade that neither default parameters nor Latin Hypercube parameter searching achieved. Analyses of the initial PPE suggested several parameters were unimportant for output variation. However, many “unimportant” parameters were needed for CPE generation, a result that brings to the forefront how parameter importance should be determined in PPEs. From the CPE, two diverse 45-dimensional parameter configurations are retained to generate radiatively-balanced, auto-tuned atmospheres that were used in two E3 submissions to CMIP6.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Poroelastic Aquifer Characterization From InSAR Surface Deformation Data. 2. Quantifying the Uncertainty

Uncertainty quantification of groundwater (GW) aquifer parameters is critical for efficient management and sustainable extraction of GW resources. These uncertainties are introduced by the data, model, and prior information on the parameters. We develop a Bayesian inversion framework that uses Interferometric Synthetic Aperture Radar (InSAR) surface deformation data to infer the laterally heterogeneous permeability of a transient linear poroelastic model of a confined GW aquifer. The Bayesian solution of this inverse problem takes the form of a posterior probability density of the permeability. Exploring this posterior using classical Markov chain Monte Carlo (MCMC) methods is computationally prohibitive due to the large dimension of the discretized permeability field and the expense of solving the poroelastic forward problem. However, in many partial differential equation (PDE)-based Bayesian inversion problems, the data are only informative in a few directions in parameter space. For the poroelasticity problem, we prove this property theoretically for a one-dimensional problem and demonstrate it numerically for a three-dimensional aquifer model. Here we design a generalized preconditioned Crank-Nicolson (gpCN) MCMC method that exploits this intrinsic low dimensionality by using a low-rank-based Laplace approximation of the posterior as a proposal, which we build scalably. The feasibility of our approach is demonstrated through a real GW aquifer test in Nevada. The inherently two-dimensional nature of InSAR surface deformation data informs a sufficient number of modes of the permeability field to allow detection of major structures within the aquifer, significantly reducing the uncertainty in the pressure and the displacement quantities of interest.

54 ENVIRONMENTAL SCIENCES↗

Pervaporative Dehydration of 2,3-Butanediol by Dense Poly(vinylidene fluoride) Hollow Fiber Membranes: Parameter Estimation, Process Design, and Technoeconomic Evaluation under Uncertainty

Pervaporation, combined with other separation processes, can effectively remove water from fermentation product streams, making it highly suitable for purifying alcohols like 2,3-butanediol (BDO). In this study, a dense poly(vinylidene fluoride) (PVDF) hollow fiber membrane module prototype was fabricated for BDO dehydration, achieving >0.2 LMH total flux and >95% BDO rejection. With a Markov chain Monte Carlo (MCMC) approach, Bayesian inference was used to quantify the uncertainty of the permeance parameters. A membrane cascade model was developed to scale up a process that purifies a preconcentrated BDO feed (70 wt %) to high purity (90 wt %). Through propagation of the uncertainty of the parameters and sensitivity analyses of the process variables, a cascade design was recommended. Despite data and model limitations, the framework enabled a reliable system analysis and economic evaluation, validated through tight confidence intervals in key process metrics, establishing the foundation for future applications of Bayesian methods in membrane-based processes.

Animal feed↗

Parameter estimation for X-ray scattering analysis with Hamiltonian Markov Chain Monte Carlo

Bayesian-inference-based approaches, in particular the random-walk Markov Chain Monte Carlo (MCMC) method, have received much attention recently for X-ray scattering analysis. Hamiltonian MCMC, a state-of-the-art development in the field of MCMC, has become popular in recent years. It utilizes Hamiltonian dynamics for indirect but much more efficient drawings of the model parameters. We described the principle of the Hamiltonian MCMC for inversion problems in X-ray scattering analysis by estimating high-dimensional models for several motivating scenarios in small-angle X-ray scattering, reflectivity, and X-ray fluorescence holography. Hamiltonian MCMC with appropriate preconditioning can deliver superior performance over the random-walk MCMC, and thus can be used as an efficient tool for the statistical analysis of the parameter distributions, as well as model predictions and confidence analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties

Here we introduce a denoising diffusion algorithm to discover microstructures with nonlinear fine-tuned properties. Denoising diffusion probabilistic models are generative models that use diffusion-based dynamics to gradually denoise images and generate realistic synthetic samples. By learning the reverse of a Markov diffusion process, we design an artificial intelligence to efficiently manipulate the topology of microstructures to generate a massive number of prototypes that exhibit constitutive responses sufficiently close to designated nonlinear constitutive behaviors. To identify the subset of microcstructures with sufficiently precise fine-tuned properties, a convolutional neural network surrogate is trained to replace high-fidelity finite element simulations to filter out prototypes outside the admissible range. Results of this study indicate that the denoising diffusion process is capable of creating microstructures of fine-tuned nonlinear material properties within the latent space of the training data. More importantly, this denoising diffusion algorithm can be easily extended to incorporate additional topological and geometric modifications by introducing high-dimensional structures embedded in the latent space. Numerical experiments are conducted on the open-source mechanical MNIST data set (Lejeune, 2020). Consequently, this algorithm is not only capable of performing inverse design of nonlinear effective media, but also learns the nonlinear structure–property map to quantitatively understand the multiscale interplay among the geometry, topology, and their effective macroscopic properties.

42 ENGINEERING↗

TBASS: A Robust Adaptation of Bayesian Adaptive Spline Surfaces

The R package TBASS is an extension of the BASS package created by Francom and Sansó (2019). The package is used to fit a Bayesian multivariate adaptive spline to a dataset that either follows a Student’s t-distribution or has outliers. Much of the framework for TBASS is adapted from the concepts of Bayesian Multivariate Adaptive Regression Splines (BMARS), specifically the work done by Denison, Mallick, and Smith (1998). The spline function is fit using a Reversible-Jump Markov Chain Monte Carlo algorithm,. By including this more robust generalization, a dataset with outliers can be accurately fit using the BMARS model, without the possibility of overfitting or variance inflation.

97 MATHEMATICS AND COMPUTING↗

Electrical Conductivities and Association Constants in Dilute Aqueous NdCl 3 Solutions from 298 to 523 K along an Isobar of 25 MPa

Here, electrical measurements were performed in dilute aqueous NdCl 3 solutions from 298 to 523 K along the 25 MPa isobar to obtain limiting conductivities and association constants. The specific conductivity data were estimated using a continuous flow cell and a Markov Chain Monte Carlo (MCMC) correction algorithm. The limiting conductivities for the salts in water were derived by regressing the mean spherical approximation model and speciation analyses based on the MCMC algorithm and the deep earth water model. The limiting conductivities derived from the experimental data were correlated using the Zimmerman-Arcis-Tremaine correlation and agreed well with a predictive correlation proposed by Smolyakov, Anderko, and Lencka. Only the first association constant between neodymium and chloride could be derived at low temperatures (<373 K) due to the apparent large statistical uncertainty of the second association constant. Above 373 K, both association constants could be derived and show a reasonable agreement with Migdisov and Williams-Jones and Gammons et al.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Process‐Oriented Calibration of a Turbulence Scheme in the DOE's Global Storm‐Resolving Model Using Machine Learning

A process‐oriented calibration framework is developed for the Simplified Higher‐Order Closure (SHOC) turbulence scheme in DOE's Simple Cloud Resolving E3SM Atmospheric Model (SCREAM). This framework leverages machine learning surrogates and observational constraints to efficiently calibrate SHOC adjustable parameters across two convective regimes: clear‐sky dry convective boundary layer and fair‐weather shallow cumulus clouds from ARM observations. We use perturbed‐parameter ensembles of a doubly periodic version of SCREAM to train surrogates and apply Markov Chain Monte Carlo sampling guided by cost functions based on benchmarking large‐eddy simulations and observations to identify optimized parameter sets that perform well in both regimes. The calibrated SHOC parameters substantially improve boundary‐layer turbulence and cloud boundaries, and modeled cloud fraction and radiative effects align better with observations than the default. These results demonstrate that combining multiple process‐specific convective regimes with machine‐learning surrogates can reduce parametric uncertainties and yield a model more faithful to cloud–turbulence interactions.

58 GEOSCIENCES↗