Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Probabilistic Discrete‐Time Models for Spreading Processes in Complex Networks: A Review

Abstract Research into network dynamics of spreading processes typically employs both discrete and continuous time methodologies. Although each approach offers distinct insights, integrating them can be challenging, particularly when maintaining coherence across different time scales. This review focuses on the Microscopic Markov Chain Approach (MMCA), a probabilistic f ramework originally designed for epidemic modeling. MMCA uses discrete dynamics to compute the probabilities of individuals transitioning between epidemiological states. By treating each time step—usually a day—as a discrete event, the approach captures multiple concurrent changes within this time frame. The approach allows to estimate the likelihood of individuals or populations being in specific states, which correspond to distinct epidemiological compartments. This review synthesizes key findings from the application of this approach, providing a comprehensive overview of its utility in understanding epidemic spread.

Granell, Clara↗
DOE OSTI2025

Detecting outbreaks using a spatial latent field

In this paper, we present a method for estimating the infection-rate of a disease as a spatial-temporal field. Our data comprises time-series case-counts of symptomatic patients in various areal units of a region. We extend an epidemiological model, originally designed for a single areal unit, to accommodate multiple units. The field estimation is framed within a Bayesian context, utilizing a parameterized Gaussian random field as a spatial prior. We apply an adaptive Markov chain Monte Carlo method to sample the posterior distribution of the model parameters condition on COVID-19 case-count data from three adjacent counties in New Mexico, USA. Our results suggest that the correlation between epidemiological dynamics in neighboring regions helps regularize estimations in areas with high variance (i.e., poor quality) data. Using the calibrated epidemic model, we forecast the infection-rate over each areal unit and develop a simple anomaly detector to signal new epidemic waves. Our findings show that anomaly detector based on estimated infection-rates outperforms a conventional algorithm that relies solely on case-counts.

Safta, Cosmin [Sandia National Laboratories (SNL-C↗
DOE OSTI2020

Kensor: Coordinated Intelligence from Co-Located Sensors

Internet of Things (IoT) is becoming more pervasive in many installations, including homes, manufacturing plants, and industrial facilities of all kinds. The data that IoT produces is a reflection of usual behavior such as daily routines and scheduled tasks, but also from unexpected behavior due to unintentional or undesirable abnormalities. Here, we focus on achieving coordinated intelligence about normal and abnormal phenomena from multiple sensors that are geographically colocated in close proximity, monitoring and controlling a set of co-located devices. Given a set of co-located sensors, we seek an intelligent approach that would automatically determine the “normal” patterns of behaviors among the correlated sensors. After normal behavior is extracted, later monitoring should detect any deviant variations over time. An example application is an entry monitoring and alert system for facilities such as nuclear reactors, where badge readers, door locks, lights, weight trackers and other co-located sensors at the entry point are collectively tracked. To address this problem, we identify the possible solution approach that can be used to solve its different variants. The implemented model is developed as a combination of rules and Markov Chain methods.

Kotevska, Olivera↗
DOE OSTI2020

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.

42 ENGINEERING↗
DOE OSTI2024

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Model-Data for Joint Estimation of Biogeochemical Model Parameters from Multiple Experiments: A Bayesian Approach Applied to Mercury Methylation

This modeling archive supports the manuscript submitted for publication in the Environmental Modeling and Software. This study is supported by ORNL-SFA and IDEAS-Watershed. This study aims to improve calibration of complex biogeochemical models using datasets from multiple experiments targeting specific subprocesses. The proposed Bayesian joint-fitting scheme calibrates the entire biogeochemical model in one go using all the available datasets and estimate parameter uncertainties using Markov Chain Monte Carlo (MCMC). This allows for complete propagation of uncertainties and utilization of the information shared between different datasets. Mapping joint distribution of parameters guides model improvement by identifying null spaces in the parameter space. This archive contains files used to perform MCMC, post-process outputs and visualize results.

East Fork Poplar Creek↗
DOE OSTI2025

Missing components in ΛCDM from DESI Y1 baryonic acoustic oscillation measurements: Insights from redshift remapping

We explore transformations of the Friedman-Lemaître-Robertson-Walker (FLRW) metric and cosmological parameters that align with observational data while aiming to gain insights into potential extensions of standard cosmological models. We modified the FLRW metric by introducing a scaling factor, e 2Θ(a) –the cosmological scaling function (CSF), which alters the standard relationship between cosmological redshift and the cosmic scale factor without affecting angular measurements or cosmic microwave background (CMB) anisotropies. Using data from DESI Year 1, Pantheon+ supernovae, and the Planck CMB temperature power spectrum, we constrained both the CSF and cosmological parameters through a Markov chain Monte Carlo approach. Our results indicate that the CSF model fits observational data with a lower Hubble constant (although it is compatible with the value given by Planck 2018 within 1σ) and is predominantly dark matter dominated. Additionally, the CSF model produces temperature and lensing power spectra similar to those predicted by the standard model, though with lower values in the CSF model at large scales. We also checked that when fitting a CSF model without dark energy to the data, we obtain a more negative conformal function. This suggests that the CSF model may offer hints about missing elements and opens up a new avenue for exploring physical interpretations of cosmic acceleration.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

A data-driven multiscale model for reactive wetting simulations

Here, we describe a data-driven, multiscale technique to model reactive wetting of a silver–aluminum alloy on a Kovar™ (Fe-Ni-Co alloy) surface. We employ molecular dynamics simulations to elucidate the dependence of surface tension and wetting angle on the drop’s composition and temperature. A design of computational experiments is used to efficiently generate training data of surface tension and wetting angle from a limited number of molecular dynamics simulations. The simulation results are used to parameterize models of the material’s wetting properties and compute the uncertainty in the models due to limited data. The data-driven models are incorporated into an engineering-scale (continuum) model of a silver–aluminum sessile drop on a Kovar™ substrate. Model predictions of the wetting angle are compared with experiments of pure silver spreading on Kovar™ to quantify the model-form errors introduced by the limited training data versus the simplifications inherent in the molecular dynamics simulations. The paper presents innovations in the determination of “convergence” of noisy MD simulations before they are used to extract the wetting angle and surface tension, and the construction of their models which approximate physio-chemical processes that are left unresolved by the engineering-scale model. Together, these constitute a multiscale approach that integrates molecular-scale information into continuum scale models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Capabilities of multivariate Bayesian inference toward seismic hazard assessment

Multivariate Bayesian analysis can bring significant benefits to seismic hazard analysis: Its multivariate feature enables computing scalar and vector hazard without making any approximations; Correlations between intensity measures are implicitly modeled, permitting direct simulation of ground motion selection tools such as the conditional mean spectrum and the generalized conditioning intensity measure; and Its updating feature enables a seamless integration of new ground motion data into the hazard results. Here, we first develop a multivariate Bayesian ground motion model through the NGA-West2 database. The model functional form considers fault-type, magnitude, and distance dependencies, and also the linear and the rock intensity dependent site response. We use a hybrid Markov Chain Monte Carlo sampling to perform Bayesian inference consisting of Gibbs step and a multilevel Metropolis-Hastings step. We then perform several checks on the model and note that its performance is satisfactory. Finally, we illustrate the merits of this multivariate Bayesian analysis, which include: ground motion model updating with ground motion data recorded in the last four years not part of the NGA-West2 database; computation of scalar and vector seismic hazard using the un-updated and updated ground motion models for Los Angeles, CA; and simulation of the conditional mean spectrum under scalar and vector IM conditioning while accounting for different sources of aleatoric and epistemic uncertainties.

58 GEOSCIENCES↗
DOE OSTI2024

Federated Deep Reinforcement Learning for Decentralized VVO of BTM DERs

The future of grid control requires a hybrid approach combining centralized and decentralized methods to fully utilize the potential of smart edge devices with artificial intelligence (AI) capabilities. This paper aims to develop and evaluate a federated deep reinforcement learning (FDRL) framework for decentralized adaptive volt-var optimization (VVO) of behind-the-meter (BTM) distributed energy resources (DERs). First, this paper models a single deep reinforcement learning (DRL) agent using the Markov Decision Process (MDP) framework for decentralized adaptive VVO of BTM DERs. Two DRL algorithms, soft actor-critic (SAC) and twin-delayed deep deterministic policy gradient (TD3), are compared for their effectiveness in optimizing VVO. Results show that TD3 outperforms SAC, achieving a 71.3% improvement in mean reward. Finally, the DRL agent is deployed within the FDRL framework, using the Flower platform, to enhance learning, provide adaptive control, and ensure data privacy for BTM DERs.

Ravi, Abhijith↗
DOE OSTI2022

Particle transport in Markov stochastic mixtures with spatial gradients

Markov geometries are a prototype class of stochastic media that are widely used to model complex disordered systems. In a series of recent works, we have shown that spatially homogeneous (but possibly non-isotropic) Poisson tessellations can be conveniently used in order to generate three-dimensional realizations of Markov media and thus characterize the features of particle transport e.g. in fragmented fuel elements following severe nuclear accidents or Rayleigh-Taylor turbulent mixing for inertial confinement fusion. In this paper we show that Poisson tessellations can be extended to take into account the presence of spatial gradients, which commonly occur in real-world applications due to material stratification. For this purpose, we will provide an explicit construction of spatially-non-homogeneous Poisson tessellations, fully characterize their statistical properties, and finally illustrate the behaviour of particle transport in such random media. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

First measurement in a magnetic confinement fusion experiment of the H 3 + H 3 → He 5 + n intermediate two-body resonant reaction

We report on the first experimental measurements made at a magnetic confinement fusion device of the tritium(T)-tritium(T) reaction T + T → He 4 + 2 n indicating the presence of the intermediate two-body resonant reaction T + T → He 5 + n . During the second deuterium-tritium campaign (DTE2) at the Joint European Torus, measurements of fusion plasmas with high tritium concentrations, n T / ( n T + n D ) ≈ 0.99 , heated with tritium neutral beam injection, were performed using the neutron time-of-flight (TOF) spectrometer TOFOR. We detect a peak in the neutron emission TOF spectrum consistent with the two-body resonant reaction. The TT neutron emission energy spectrum is modeled using an R -matrix framework where the distributions of the most likely model parameters given our experimental TOF data are determined utilizing a Markov chain Monte Carlo approach. We compare our best estimate of the T + T neutron emission energy spectrum with results obtained at inertial confinement fusion experiments at the OMEGA facility and find a spectral shape that is consistent with the energy dependency in the neutron spectrum observed at OMEGA. Published by the American Physical Society 2024

Physics↗
DOE OSTI2023

EvoProtGrad (Directed Evolution for Proteins with Gradients) [SWR-23-48]

A Python package for directed evolution on a protein sequence with gradient-based discrete Markov chain monte carlo (MCMC). Users are able to compose custom models that map sequence to function with pretrained models, including protein language models (PLMs), to guide and constrain search. Our package natively integrates with the HuggingFace platform and supports PLMs from transformers. Our MCMC sampler identifies promising amino acids to mutate via model gradients taken with respect to the input (i.e., sensitivity analysis). We allow users to compose their own custom target function for MCMC by leveraging the Product of Experts MCMC paradigm. Each model is an "expert" that contributes its own knowledge about the protein's fitness landscape to the overall target function. The sampler is designed to be more efficient and effective than brute force and random search while maintaining most of the generality and flexibility. Additional information can be found in the related publication: https://iopscience.iop.org/article/10.1088/2632-2153/accacd

Emami, Patrick↗
DOE OSTI2024

Advancing earth system model calibration: a diffusion-based method

Understanding of climate impact on ecosystems globally requires site-specific model calibration. Here we introduce a novel diffusion-based uncertainty quantification (DBUQ) method for efficient model calibration. DBUQ is a score-based diffusion model that leverages Monte Carlo simulation to estimate the score function and evaluates a simple neural network to quickly generate samples for approximating parameter posterior distributions. DBUQ is stable, efficient, and can effectively calibrate the model given diverse observations, thereby enabling rapid and site-specific model calibration on a global scale. This capability significantly advances Earth system modeling and our understanding of climate impacts on Earth systems. We demonstrate DBUQ's capability in E3SM land model calibration at the Missouri Ozark AmeriFlux forest site. Both synthetic and real-data applications indicate that DBUQ produces accurate parameter posterior distributions similar to those generated by Markov Chain Monte Carlo sampling but with 30X less computing time. This efficiency marks a significant stride in model calibration, paving the way for more effective and timely climate impact analyses.

Liu, Yanfang↗
DOE OSTI2021

Impact of a midband gravitational wave experiment on detectability of cosmological stochastic gravitational wave backgrounds

In this report we make forecasts for the impact a future “midband” space-based gravitational wave experiment, most sensitive to 10 -2 - 10Hz,could have on potential detections of cosmological stochastic gravitational wave backgrounds (SGWBs). Specific proposed midband experiments considered are TianGo, B-DECIGO, and AEDGE. We propose a combined power-law integrated sensitivity (CPLS) curve combining GW experiments over different frequency bands, which shows the midband improves sensitivity to SGWBs by up to two orders of magnitude at 10 -2 - 10 Hz . We consider GW emission from cosmic strings and phase transitions as benchmark examples of cosmological SGWBs. We explicitly model various astrophysical SGWB sources, most importantly from unresolved black hole mergers. Using Markov Chain Monte Carlo, we demonstrated that midband experiments can, when combined with LIGO A+ and LISA, significantly improve sensitivities to cosmological SGWBs and better separate them from astrophysical SGWBs. In particular, we forecast that a midband experiment improves sensitivity to cosmic string tension G μ by up to a factor of 10, driven by improved component separation from astrophysical sources. For phase transitions, a midband experiment can detect signals peaking at 0.1–1 Hz, which for our fiducial model corresponds to early Universe temperatures of T * ~10 4 – 10 6 GeV , generally beyond the reach of LIGO and LISA. The midband closes an energy gap and better captures characteristic spectral shape information. It thus substantially improves measurement of the properties of phase transitions at lower energies of T * ~ O(10 3 ) GeV , potentially relevant to new physics at the electroweak scale, whereas in this energy range LISA alone will detect an excess but not effectively measure the phase transition parameters. Our modeling code and chains are publicly available.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

A Diffusion‐Based Uncertainty Quantification Method to Advance E3SM Land Model Calibration

Abstract Calibrating land surface models and accurately quantifying their uncertainty are crucial for improving the reliability of simulations of complex environmental processes. This, in turn, advances our predictive understanding of ecosystems and supports climate‐resilient decision‐making. Traditional calibration methods, however, face challenges of high computational costs and difficulties in accurately quantifying parameter uncertainties. To address these issues, we develop a diffusion‐based uncertainty quantification (DBUQ) method. Unlike conventional generative diffusion methods, which are computationally expensive and memory‐intensive, DBUQ innovates by formulating a parameterized generative model and approximates this model through supervised learning, which enables quick generation of parameter posterior samples to quantify its uncertainty. DBUQ is effective, efficient, and general‐purpose, making it suitable for site‐specific ecosystem model calibration and broadly applicable for parameter uncertainty quantification across various earth system models. In this study, we applied DBUQ to calibrate the Energy Exascale Earth System Model land model at the Missouri Ozark AmeriFlux forest site. Results indicated that DBUQ produced accurate parameter posterior distributions similar to those from Markov Chain Monte Carlo sampling but with 30 times less computing time. This significant improvement in efficiency suggests that DBUQ can enable rapid, site‐level model calibration at a global scale, enhancing our predictive understanding of climate impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Bayesian Exploration of Phenomenological EoS of Neutron/Hybrid Stars with Recent Observations

The description of the stellar interior of compact stars remains as a big challenge for the nuclear astrophysics community. The consolidated knowledge is restricted to density regions around the saturation of hadronic matter ρ 0 =2.8 × 10 14 g cm -3 , regimes where our nuclear models are successfully applied. As one moves towards higher densities and extreme conditions up to the quark/gluons deconfinement, little can be said about the microphysics of the equation of state (EoS). Here, we employ a Markov Chain Monte Carlo (MCMC) strategy to access the variability at high density regions of polytropic piecewise models for neutron star (NS) EoS or possible hybrid stars, i.e., a NS with a small quark-matter core. With a fixed description of the hadronic matter for low density, below the nuclear saturation density, we explore a variety of models for the high density regimes leading to stellar masses near to 2.5 M ⊙ , in accordance with the observations of massive pulsars. The models are constrained, including the observation of the merger of neutrons stars from VIRGO-LIGO and with the pulsar observed by NICER. In addition, we also discuss the possibility of the use of a Bayesian power regression model with heteroscedastic error. The set of EoS from the Laser Interferometer Gravitational-Wave Observatory (LIGO) was used as input and treated as the data set for the testing case.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A hybrid full-wave Markov chain approach to calculating radio-frequency wave scattering from scrape-off layer filaments

The interaction of radio-frequency (RF) waves with edge turbulence modifies the incident wave spectrum, and can significantly affect RF heating and current drive in tokamaks. Previous lower hybrid (LH) scattering models have either used the weak-turbulence approximation, or treated more realistic, filamentary turbulence in the ray tracing limit. In this study, a new model is introduced which retains full-wave effects of RF scattering in filamentary turbulence. First, a Mie-scattering technique models the interaction of an incident wave with a single Gaussian filament. Next, an effective differential scattering width is derived for a statistical ensemble of filaments. Lastly, a Markov chain solves for the transmitted wave spectrum in slab geometry. This model is applied to LH launching for current drive. The resulting wave spectrum is asymmetrically broadened in angular wavenumber space. This asymmetry is not accounted for in previous LH scattering models. The modified wave spectrum is coupled to a ray tracing/Fokker–Planck solver (GENRAY/CQL3D) to study its impact on current drive. The resulting current profile is greatly altered, and there is significant increase in the on-axis current and decrease in the off-axis peaks. This is attributed to a portion of the modified wave spectrum that is strongly dampened on-axis during the first pass.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗