Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Automated Adversary Emulation for Cyber-Physical Systems via Reinforcement Learning

Adversary emulation is an offensive exercise that provides a comprehensive assessment of a system’s resilience against cyber attacks. However, adversary emulation is typically a manual process, making it costly and hard to deploy in cyber-physical systems (CPS) with complex dynamics, vulnerabilities, and operational uncertainties. In this paper, we develop an automated, domain-aware approach to adversary emulation for CPS. We formulate a Markov Decision Process (MDP) model to determine an optimal attack sequence over a hybrid attack graph with cyber (discrete) and physical (continuous) components and related physical dynamics. We apply model-based and model-free reinforcement learning (RL) methods to solve the discrete-continuous MDP in a tractable fashion. As a baseline, we also develop a greedy attack algorithm and compare it with the RL procedures. We summarize our findings through a numerical study on sensor deception attacks in buildings to compare the performance and solution quality of the proposed algorithms.

Bhattacharya, Arnab↗
DOE OSTI2022

Quantum Markov chain Monte Carlo with digital dissipative dynamics on quantum computers

Modeling the dynamics of a quantum system connected to the environment is critical for advancing our understanding of complex quantum processes, as most quantum processes in nature are affected by an environment. Modeling a macroscopic environment on a quantum simulator may be achieved by coupling independent ancilla qubits that facilitate energy exchange in an appropriate manner with the system and mimic an environment. This approach requires a large, and possibly exponential number of ancillary degrees of freedom which is impractical. In contrast, we develop a digital quantum algorithm that simulates interaction with an environment using a small number of ancilla qubits. By combining periodic modulation of the ancilla energies, or spectral combing, with periodic reset operations, we are able to mimic interaction with a large environment and generate thermal states of interacting many-body systems. We evaluate the algorithm by simulating preparation of thermal states of the transverse Ising model. Our algorithm can also be viewed as a quantum Markov chain Monte Carlo process that allows sampling of the Gibbs distribution of a multivariate model. To illustrate this we evaluate the accuracy of sampling Gibbs distributions of simple probabilistic graphical models using the algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Joint estimation of biogeochemical model parameters from multiple experiments: A bayesian approach applied to mercury methylation

Here, to characterize complex biogeochemical systems, results from multiple experiments, where each targets a specific subprocess, are commonly combined. The resulting datasets are interpreted through the calibration of biogeochemical models for process inference and predictions. Commonly used calibration approaches of fitting datasets from individual experiments to subprocess models one at a time is prone to missing information shared between datasets and incomplete uncertainty propagation. We propose a Bayesian joint-fitting scheme addressing the above-mentioned concerns by jointly fitting all the available datasets, thus calibrating the entire biogeochemical model in one go using Markov Chain Monte Carlo (MCMC). The identification of null spaces in the parameter distributions from MCMC guided the simplification of certain subprocess models. For example, fast kinetic sorption was replaced by equilibrium sorption, and Monod demethylation was replaced by first-order demethylation. Joint fitting of datasets resulted in complete uncertainty propagation with parameter estimates informed by all available data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Deep Neural Network Informed Markov Chain Monte Carlo Methods

In subsurface flow modeling, quantifying the uncertainty of model parameters and the corresponding uncertainly on output quantities is a crucial task for groundwater management. Markov chain Monte Carlo (MCMC) methods can take advantage of observed data to estimate parameters in a Bayesian setting. However, MCMC can be slow to converge and produce highly correlated samples when the dimensions of the parameters is high. Using gradients for the posterior distribution can help samplers explore the parameter space more efficiently, but obtaining gradients can be computationally challenging.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Moderate-resolution K-band Spectroscopy of Substellar Companion κ Andromedae b

We present moderate-resolution (R ∼ 4000) K-band spectra of the “super-Jupiter,” κ Andromedae b. The data were taken with the OSIRIS integral field spectrograph at Keck Observatory. The spectra reveal resolved molecular lines from H{sub 2}O and CO, and are compared to a custom PHOENIX atmosphere model grid appropriate for young planetary-mass objects. We fit the data using a Markov chain Monte Carlo forward-modeling method. Using a combination of our moderate-resolution spectrum and low-resolution, broadband data from the literature, we derive an effective temperature of T {sub eff} = 1950–2150 K, a surface gravity of logg=3.5--4.5, and a metallicity of [M/H] = −0.2–0.0. These values are consistent with previous estimates from atmospheric modeling and the currently favored young age of the system (<50 Myr). We derive a C/O ratio of 0.70{sub −0.24}{sup +0.09} for the source, broadly consistent with the solar C/O ratio. This, coupled with the slightly subsolar metallicity, implies a composition consistent with that of the host star, and is suggestive of formation by a rapid process. The subsolar metallicity of κ Andromedae b is also consistent with predictions of formation via gravitational instability. Further constraints on formation of the companion will require measurement of the C/O ratio of κ Andromedae A. We also measure the radial velocity of κ Andromedae b for the first time, with a value of −1.4 ± 0.9 km s{sup −1} relative to the host star. We find that the derived radial velocity is consistent with the estimated high eccentricity of κ Andromedae b.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Star formation rate and stellar mass calibrations based on infrared photometry and their dependence on stellar population age and extinction

The stellar mass (M $\star$ ) and the star formation rate (SFR) are among the most important features that characterize galaxies. Measuring these fundamental properties accurately is critical for understanding the present state of galaxies, their history, and future evolution. Infrared (IR) photometry is widely used to measure the M $\star$ and SFR of galaxies because the near-IR traces the continuum emission of the majority of their stellar populations (SPs), and the mid/far-IR traces the dust emission powered by star-forming activity. This work explores the dependence of the IR emission of galaxies on their extinction, and the age of their SPs. It aims to provide accurate and precise IR-photometry SFR and M $\star$ calibrations that account for SP age and extinction while providing quantification of their scatter. We used the CIGALE spectral energy distribution (SED) fitting code to create model SEDs of galaxies with a wide range of star formation histories, dust content, and interstellar medium properties. We fit the relations between M $\star$ and SFR with IR and optical photometry of the model-galaxy SEDs with the Markov chain Monte Carlo (MCMC) method. As an independent confirmation of the MCMC fitting method, we performed a machine-learning random forest (RF) analysis on the same data set. The RF model yields similar results to the MCMC fits, thus validating the latter. This work provides calibrations for the SFR using a combination of the WISE bands 1 and 3, or the JWST NIR-F200W and MIRI-F2100W. It also provides mass-to-light ratio calibrations based on the WISE band-1, the JWST NIR-F200W, and the optical u - r or g - r colors. These calibrations account for the biases attributed to the SP age, while they are given in the form of extinction-dependent and extinction-independent relations. The proposed calibrations show robust estimations while minimizing the scatter and biases throughout a wide range of SFRs and stellar masses. The SFR calibration offers better results, especially in dust-free or passive galaxies where the contributions of old SPs or biases from the lack of dust are significant. Similarly, the M $\star$ calibration yields significantly better results for dusty and high-SFR galaxies where dust emission can otherwise bias the estimations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Bayesian inference of Stochastic reaction networks using Multifidelity Sequential Tempered Markov Chain Monte Carlo

Stochastic reaction network models are often used to explain and predict the dynamics of gene regulation in single cells.These models usually involve several parameters, such as the kinetic rates of chemical reactions, that are not directly measurable and must be inferred from experimental data. Bayesian inference provides a rigorous probabilistic frame-work for identifying these parameters by finding a posterior parameter distribution that captures their uncertainty.Traditional computational methods for solving inference problems such as Markov Chain Monte Carlo methods based on classical Metropolis-Hastings algorithm involve numerous serial evaluations of the likelihood function, which in turn requires expensive forward solutions of the chemical master equation (CME). We propose an alternate approach based on a multifidelity extension of the Sequential Tempered Markov Chain Monte Carlo (ST-MCMC) sampler. This algorithm is built upon Sequential Monte Carlo and solves the Bayesian inference problem by decomposing it into a sequence of efficiently solved subproblems that gradually increase both model fidelity and the influence of the observed data. We reformulate the finite state projection (FSP) algorithm, a well-known method for solving the CME, to produce a hierarchy of surrogate master equations to be used in this multifidelity scheme. To determine the appropriate fidelity, we introduce a novel information-theoretic criteria that seeks to extract the most information about the ultimate Bayesian posterior from each model in the hierarchy without inducing significant bias. This novel sampling scheme is tested with high performance computing resources using biologically relevant problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. Furthermore, the combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Bayesian projection pursuit regression

In projection pursuit regression (PPR), a univariate response variable is approximated by the sum of $M$ “ridge functions,” which are flexible functions of one-dimensional projections of a multivariate input variable. Traditionally, optimization routines are used to choose the projection directions and ridge functions via a sequential algorithm, and $M$ is typically chosen via cross-validation. Here, we introduce a novel Bayesian version of PPR, which has the benefit of accurate uncertainty quantification. To infer appropriate projection directions and ridge functions, we apply novel adaptations of methods used for the single ridge function case ($M$=1), called the Bayesian Single Index Model; and use a Reversible Jump Markov chain Monte Carlo algorithm to infer the number of ridge functions $M$. We evaluate the predictive ability of our model in 20 simulated scenarios and for 23 real datasets, in a bake-off against an array of state-of-the-art regression methods. Finally, we generalize this methodology and demonstrate the ability to accurately model multivariate response variables. Its effective performance indicates that Bayesian Projection Pursuit Regression is a valuable addition to the existing regression toolbox.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Modeling information flow in a computer processor with a multi-stage queuing model

In this paper, we introduce a nonlinear stochastic model to describe the propagation of information inside a computer processor. In this model, a computational task is divided into stages, and information can flow from one stage to another. The model is formulated as a spatially-extended, continuous-time Markov chain where space represents different stages. This model is equivalent to a spatially-extended version of the M/M/s queue. The main modeling feature is the throttling function which describes the processor slowdown when the amount of information falls below a certain threshold. We derive the stationary distribution for this stochastic model and develop a closure for a deterministic ODE system that approximates the evolution of the mean and variance of the stochastic model. In conclusion, we demonstrate the validity of the closure with numerical simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Determining the bubble nucleation efficiency of low-energy nuclear recoils in superheated C$_3$F$_8$ dark matter detectors

The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. The PICO Collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C$_3$F$_8$ from calibration data taken with 5 distinct neutron spectra at various thermodynamic thresholds ranging from 2.1 keV to 3.9 keV. Instead of assuming any particular functional forms for the nuclear recoil efficiency, a generalized piecewise linear model is proposed with systematic errors included as nuisance parameters to minimize model-introduced uncertainties. A Markov-Chain Monte-Carlo (MCMC) routine is applied to sample the nuclear recoil efficiency for fluorine and carbon at 2.45 keV and 3.29 keV thermodynamic thresholds simultaneously. The nucleation efficiency for fluorine was found to be $\geq 50\, \%$ for nuclear recoils of 3.3 keV (3.7 keV) at a thermodynamic Seitz threshold of 2.45 keV (3.29 keV), and for carbon the efficiency was found to be $\geq 50\, \%$ for recoils of 10.6 keV (11.1 keV) at a threshold of 2.45 keV (3.29 keV). Simulated data sets are used to calculate a p-value for the fit, confirming that the model used is compatible with the data. The fit paradigm is also assessed for potential systematic biases, which although small, are corrected for. Additional steps are performed to calculate the expected interaction rates of WIMPs in the PICO-60 detector, a requirement for calculating WIMP exclusion limits.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Constraining Bedrock Groundwater Residence Times in a Mountain System with Environmental Tracer Observations and Bayesian Uncertainty Quantification: Modeling and Data Package

Groundwater residence times provide fundamental descriptions of hydrologic dynamics and mixing processes in mountainous watersheds. Yet, few observational datasets that can constrain groundwater residence times over broad timescales are available in high elevation mountain systems. Here we present field observations from May 2021 of dissolved noble gases (He, Ne, Ar, Kr, and Xe), Chloroflourcarbons (CFCs), Sulfurhexaflouride (SF6), and tritium (3H) sampled from the Pumphouse Lower Montane study site (wells PLM1, PLM6, and PLM7) within the East River Watershed, Colorado. The presented noble gas (PLM_noblegas_2021.csv) and environmental tracer (PLM_tracers_2021.csv) observation datasets, along with the associated modeling scripts, aide in quantifying groundwater residence times and recharge conditions in a high elevation mountain system. Furthermore, the modeling scripts quantify groundwater residence time and noble gas recharge condition uncertainties using a novel Markov-chain Monte Carlo approach. All data modeling scripts are written in the Python code.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Sensitivity Study of Multiscale and Phenomenological Elasto-Viscoplastic Grade 91 Material Models for Component-Scale Response

Many advanced nuclear reactor concepts currently being developed are targeting higher operating temperatures relative to the current fleet of light water nuclear reactors, for efficiency gains and other operational considerations. The design of high temperature structural components with reliable long-term operational performance will depend on material models that accurately capture the inelastic deformation mechanisms active in these environments. In this work, we perform a detailed parameter sensitivity analysis of two unified elasto-viscoplastic Grade 91 material models capable of capturing long term high temperature creep deformation. The first model is a phenomelogical material model from the Nuclear Engineering Material Library (NEML) developed at Argonne National Lab. The NEML model parameters and their uncertainty were fit to a range of Grade 91 experimental data using Bayesian Markov Chain Monte Carlo analysis. The second model is a LAROMance data-driven surrogate material model developed at Los Alamos National Lab. The LAROMance model is fit to a large database of responses produced by a mechanistic crystal plasticity based polycrystal model. Parameters for the LAROMance surrogate material model reflect the pedigree of the Grade 91 microstructure. Both material models have been integrated into the Grizzly code, based on the open-source MOOSE multiphysics simulation framework, to simulate both the progression of aging mechanisms and the effects of that aging on nuclear power plant structures. Grizzly is used analyze a three-dimensional Grade 91 piping system to compare the long-term inelastic response predicted by these two fundamentally different models and assess the sensitivity of the material model input parameters on this quantity of interest.

42 ENGINEERING↗
DOE OSTI2022

Vehicle-to-manufacturing (V2M) system: A novel approach to improve energy demand flexibility for demand response towards sustainable manufacturing

The U.S. manufacturing sector accounts for 77% of the industrial energy consumption, but its participation in demand response (DR) programs is largely lagged behind. The limited flexibility in production scheduling under high capacity utilization and the lack of DR schemes that incorporate energy demand flexibility measures are deemed as major barriers. In this study, a framework of the interactive vehicles-to-manufacturing (V2M) energy sharing system is proposed to improve the energy demand flexibility of the aggregated system and enhance the DR effectiveness for manufacturers. The V2M-based DR scheme aims to reduce the energy cost by load shifting through joint production and energy sharing control, which can eventually promote manufacturing DR implementation even under high capacity utilization requirements and dynamic real-time electricity prices. The V2M system is modeled based on a discrete-Markov chain considering the complex interconnections among various manufacturing resources and multi-directional energy flows among manufacturing facilities, electric vehicles, and the power grid. Based on the system model, a mixed-integer nonlinear programming (MINLP) problem is formulated to identify the optimal DR scheme. The effectiveness of the proposed approach is validated through comparisons with traditional manufacturing DR schemes. Finally, the results show that a 2.1 to 6.5 times energy demand flexibility improvement and an additional 4.7% to 6.9% energy cost reduction can be achieved by the proposed approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Emergent facilitation and glassy dynamics in supercooled liquids

In supercooled liquids, dynamical facilitation refers to a phenomenon where microscopic motion begets further motion nearby, resulting in spatially heterogeneous dynamics. This is central to the glassy relaxation dynamics of such liquids, which show super-Arrhenius growth of relaxation timescales with decreasing temperature. Despite the importance of dynamical facilitation, there is no theoretical understanding of how facilitation emerges and impacts relaxation dynamics. Here, we present a theory that explains the microscopic origins of dynamical facilitation. We show that dynamics proceeds by localized bond-exchange events, also known as excitations, resulting in the accumulation of elastic stresses with which new excitations can interact. At low temperatures, these elastic interactions dominate and facilitate the creation of new excitations near prior excitations. Using the theory of linear elasticity and Markov processes, we simulate a model, which reproduces multiple aspects of glassy dynamics observed in experiments and molecular simulations, including the stretched exponential decay of relaxation functions, the super-Arrhenius behavior of relaxation timescales as well as their two-dimensional finite-size effects. The model also predicts the subdiffusive behavior of the mean squared displacement (MSD) on short, intermediate timescales. Furthermore, we derive the phonon contributions to diffusion and relaxation, which when combined with the excitation contributions produce the two-step relaxation processes, and the ballistic–subdiffusive–diffusive crossover MSD behaviors commonly found in supercooled liquids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Which Combinations of Environmental Conditions and Microphysical Parameter Values Produce a Given Orographic Precipitation Distribution?

This study applies an idealized modeling framework, alongside a Bayesian Markov chain Monte Carlo (MCMC) algorithm, to explore which combinations of upstream environmental conditions and cloud microphysical parameter values can produce a particular precipitation distribution over an idealized two-dimensional, bell-shaped mountain. Simulations focus on orographic precipitation produced when an atmospheric river interacts with topography. MCMC-based analysis reveals that different combinations of parameter values produce a similar precipitation distribution, with the most influential parameters being relative humidity (RH), horizontal wind speed (U), surface potential temperature (θ sfc ), and the snow fall speed coefficient (A s ). RH, U, and A s exhibit interdependence: changes in one or more of these factors can be mitigated by compensating changes in the other(s) to produce similar orographic precipitation rates. The results also indicate that the parameter sensitivities and relationships can vary for spatial subregions and given different environmental conditions. In particular, high θ sfc values are more likely to produce the target precipitation rate and spatial distribution, and thus the ensemble of simulations shows a preference for liquid precipitation at the surface. The results presented here highlight the complexity of orographic precipitation controls, and have implications for flood and water management, observational efforts, and climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Far-field thermal imaging below diffraction limit

Non-uniform self-heating and temperature hotspots are major concerns compromising the performance and reliability of submicron electronic and optoelectronic devices. At deep submicron scales where effects such as contact-related artifacts and diffraction limits accurate measurements of temperature hotspots, non-contact thermal characterization can be extremely valuable. In this work, we use a Bayesian optimization framework with generalized Gaussian Markov random field (GGMRF) prior model to obtain accurate full-field temperature distribution of self-heated metal interconnects from their thermoreflectance thermal images (TRI) with spatial resolution 2.5 times below Rayleigh limit for 530nm illumination. Finite element simulations along with TRI experimental data were used to characterize the point spread function of the optical imaging system. In addition, unlike iterative reconstruction algorithms that use ad hoc regularization parameters in their prior models to obtain the best quality image, we used numerical experiments and finite element modeling to estimate the regularization parameter for solving a real experimental inverse problem.

42 ENGINEERING↗
DOE OSTI2020

Evaluation of residue management practices on barley residue decomposition

Optimizing barley (hordeum vulgare L.) production in Idaho and other parts of the Pacific Northwest (PNW) should focus on farm resource management. The effect of post-harvest residue management on barley residue decomposition has not been adequately studied. Thus, the objective of this study was to determine the effect of residue placement (surface vs. incorporated), residue size (chopped vs. ground-sieved) and soil type (sand and sandy loam) on barley residue decomposition. A 50-day(d) laboratory incubation experiment was conducted at a temperature of 25°C at the Aberdeen Research and Extension Center, Aberdeen, Idaho, USA. Following the study, a Markov-Chain Monte Carlo (MCMC) modeling approach was applied to investigate the first-order decay kinetics of barley residue. An accelerated initial flush of residue carbon(C)-mineralization was measured for the sieved (Day 1) compared to chopped (Day 3 to 5) residues for both surface incorporated applications. The highest evolution of carbon dioxide (CO 2 )-C of 8.3 g kg -1 dry residue was observed on Day 1 from the incorporated-sieved application for both soils. The highest and lowest amount of cumulative CO 2 -C released and percentage residue decomposed over 50-d was observed for surface-chopped (107 g kg -1 dry residue and 27%, respectively) and incorporated-sieved (69 g kg -1 dry residue and 18%, respectively) residues, respectively. There were no significant differences in C-mineralization from barley residue based on soil type or its interactions with residue placement and size (p >0.05). The largest decay constant k of 0.0083 d -1 was calculated for surface-chopped residue where the predicted half-life was 80 d, which did not differ from surface sieved or incorporated chopped. In contrast, incorporated-sieved treatments only resulted in a k of 0.0054 d -1 and would need an additional 48 d to decompose 50% of the residue. Future residue decomposition studies under field conditions are warranted to verify the residue C-mineralization and its impact on residue management.

59 BASIC BIOLOGICAL SCIENCES↗