Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Analytical gradient-based optimization of CALPHAD model parameters

The calibration of CALPHAD (CALculation of PHAse Diagrams) models involves the solution of a very challenging high-dimensional multiobjective optimization problem. Traditional approaches to parameter fitting predominantly rely on gradient-free methods, which while robust, are computationally inefficient and often scale poorly with model complexity. In this work, we introduce and demonstrate a generalizable framework for analytic gradient-based optimization of the parameters of the CALPHAD model enabled by the recently formalized Jansson derivative technique. This method allows for efficient evaluation of gradients of thermodynamic properties at equilibrium with respect to model parameters, even in the presence of arbitrarily complex internal degrees of freedom. Leveraging these semi-analytic gradients, we employ the conjugate gradient (CG) method to optimize thermodynamic model parameters for four binary alloy systems: Cu-Mg, Fe-Ni, Cr-Ni, and Cr-Fe. Across all systems, CG achieves comparable or superior optimality relative to Bayesian ensemble Markov Chain Monte Carlo (MCMC) with improvements in computational efficiency ranging from one to three orders of magnitude. Furthermore, our results establish a new paradigm for CALPHAD assessments in which high fidelity data-rich model calibration becomes tractable using deterministic gradient-informed algorithms.

CALPHAD↗

Deep Reinforcement Learning based Model-free On-line Dynamic Multi-Microgrid Formation to Enhance Resilience

Multi-microgrid formation (MMGF) is a promising solution for enhancing power system resilience. This paper proposes a new deep reinforcement learning (RL) based model-free on-line dynamic MMGF scheme. Additionally, the dynamic MMGF problem is formulated as a Markov decision process, and a complete deep RL framework is specially designed for the topologytransformable micro-grids. In order to reduce the large action space caused by flexible switch operations, a topology transformation method is proposed and an action-decoupling Q-value is applied. Then, a convolutional neural network (CNN) based multi-buffer double deep Q-network (CM-DDQN) is developed to further improve the learning ability of the original DQN method. The proposed deep RL method provides real-time computing to support the on-line dynamic MMGF scheme, and the scheme handles a long-term resilience enhancement problem using an adaptive on-line MMGF to defend changeable conditions. The effectiveness of the proposed method is validated using a 7-bus system and the IEEE 123-bus system. The results show strong learning ability, timely response for varying system conditions and convincing resilience enhancement.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Identification of system, observer, and controller from closed-loop experimental data

This paper considers the identification problem of a system operating in closed-loop with an existing feedback controller. The closed-loop system is excited by a known excitation signal, and the resulting time histories of the closed-loop system response and the feedback signal are measured. From the time history data, the algorithm computes the Markov parameters of a closed-loop observer, from which the Markov parameters of the individual open-loop plant, observer, and controller are recovered. A state space model of the open-loop plant and the gain matrices for the controller and the observer are then realized. The results of the paper are demonstrated by an example using actual aircraft flutter test data.

Juang, Jer-Nan↗

A Space-Based Observational Strategy for Characterizing the First Stars and Galaxies Using the Redshifted 21cm Global Spectrum

The redshifted 21 cm monopole is expected to be a powerful probe of the epoch of the first stars and galaxies(10 less than z less than 35). The global 21 cm signal is sensitive to the thermal and ionization state of hydrogen gas and thusprovides a tracer of sources of energetic photonsprimarily hot stars and accreting black holeswhich ionize andheat the high redshift intergalactic medium (IGM). This paper presents a strategy for observations of the globalspectrum with a realizable instrument placed in a low-altitude lunar orbit, performing night-time 40120 MHzspectral observations, while on the farside to avoid terrestrial radio frequency interference, ionospheric corruption,and solar radio emissions. The frequency structure, uniformity over large scales, and unpolarized state of theredshifted 21 cm spectrum are distinct from the spectrally featureless, spatially varying, and polarized emissionfrom the bright foregrounds. This allows a clean separation between the primordial signal and foregrounds. Forsignal extraction, we model the foreground, instrument, and 21 cm spectrum with eigenmodes calculated viaSingular Value Decomposition analyses. Using a Markov Chain Monte Carlo algorithm to explore the parameterspace defined by the coefficients associated with these modes, we illustrate how the spectrum can be measured andhow astrophysical parameters (e.g., IGM properties, first star characteristics) can be constrained in the presence offoregrounds using the Dark Ages Radio Explorer (DARE).

Burns, Jack O.↗

Quantification of early nonpharmaceutical interventions aimed at slowing transmission of Coronavirus Disease 2019 in the Navajo Nation and surrounding states (Arizona, Colorado, New Mexico, and Utah)

During an early period of the Coronavirus Disease 2019 (COVID-19) pandemic, the Navajo Nation, much like New York City, experienced a relatively high rate of disease transmission. Yet, between January and October 2020, it experienced only a single period of growth in new COVID-19 cases, which ended when cases peaked in May 2020. The daily number of new cases slowly decayed in the summer of 2020 until late September 2020. In contrast, the surrounding states of Arizona, Colorado, New Mexico, and Utah all experienced at least two periods of growth in the same time frame, with second surges beginning in late May to early June. Here, we investigated these differences in disease transmission dynamics with the objective of quantifying the contributions of non-pharmaceutical interventions (NPIs) (e.g., behaviors that limit disease transmission). We considered a compartmental model accounting for distinct periods of NPIs to analyze the epidemic in each of the five regions. We used Bayesian inference to estimate region-specific model parameters from regional surveillance data (daily reports of new COVID-19 cases) and to quantify uncertainty in parameter estimates and model predictions. Our results suggest that NPIs in the Navajo Nation were sustained over the period of interest, whereas in the surrounding states, NPIs were relaxed, which allowed for subsequent surges in cases. Our region-specific model parameterizations allow us to quantify the impacts of NPIs on disease incidence in the regions of interest.

60 APPLIED LIFE SCIENCES↗

Fast matrix algebra for Bayesian model calibration

In Bayesian model calibration, evaluation of the likelihood function usually involves finding the inverse and determinant of a covariance matrix. When Markov Chain Monte Carlo (MCMC) methods are used to sample from the posterior, hundreds of thousands of likelihood evaluations may be required. In this paper, we demonstrate that the structure of the covariance matrix can be exploited, leading to substantial time savings in practice. Here, we also derive two simple equations for approximating the inverse of the covariance matrix in this setting, which can be computed in near-quadratic time. The practical implications of these strategies are demonstrated using a simple numerical case study and the "quack" R package. For a covariance matrix with 1000 rows, application of these strategies for a million likelihood evaluations leads to a speedup of roughly 4000 compared to the naive implementation

97 MATHEMATICS AND COMPUTING↗

Distributional Deep Reinforcement Learning-Based Emergency Frequency Control

Emergency frequency control is one of the most critical approaches to maintain power system stability after major disturbances. With the increasing number of grid-connected renewable energy sources, existing model-based methods of frequency control are facing up with challenges of computational speed and scalability for large-scale systems. In this paper, the emergency frequency control problem is formulated as a Markov Decision Process (MDP) and solved through a novel Distributional Deep Reinforcement Learning (DDRL) method, namely the distributional soft actor critic (DSAC) method. Compared with other RL methods that only estimate the mean value, the proposed DSAC model estimates the distribution of value function over returns. This advancement can lead to more insights and knowledge for the agent, with the benefit of a much faster and more stable learning process, and the improved frequency control performance. Here, the simulation results on IEEE 39-bus and IEEE 118-bus systems demonstrate the effectiveness and robustness of proposed models, as well as the advantage compared to other state-of-the-art DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Operation Optimization Using Reinforcement Learning with Integrated Artificial Reasoning Framework

In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.

Kim, Junyung↗

Bayesian Cloud Property Retrievals from ARM Active and Passive Measurements

The optimum use of the continuous measurements of thermodynamics, radiation, aerosols, clouds and precipitation from the DOE Atmospheric Radiation Measurement (ARM) program is key to achieve the DOE Atmospheric System Research (ASR)’s objectives. One of the key mission requirements is to retrieve cloud and precipitation properties, as well as vertical motion parameters, along the vertical cross- section defined by the profiling active sensors. Such retrievals are challenging to perform continuously in the entire spectrum of cloud and precipitation conditions due to the large natural microphysical and dynamical variability, the often-limited information content in the measurements, and the lack of proper characterization of measurement quality and uncertainty. Today, the acquisition of new remote and in-situ sensors by the ARM program creates opportunities to address the microphysical retrieval problem by exploiting new, more robust retrieval techniques and integrating various scattered advancements in both sensor techniques and retrieval algorithms. During this project, we constructed a robust Bayesian Markov chain Monte Carlo (MCMC) cloud property retrieval algorithm that includes a state of the art radar forward model. Our MCMC-based retrieval produces both the best estimate of height-resolved cloud and precipitation properties in the radar profile, as well as an estimate of the in-cloud vertical motion and turbulence. In addition, the MCMC algorithm automatically produces robust and flexible estimates of retrieval uncertainty. We tested the algorithm on several synthetic cloud profiles obtained from large eddy simulation (LES) models with bin-resolved microphysics.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Approach to the Joint Inversion of Gravity and Magnetic Data, with Application to the Ismenius Area of Mars

This viewgraph presentation reviews a Bayesian approach to the inversion of gravity and magnetic data with specific application to the Ismenius Area of Mars. Many inverse problems encountered in geophysics and planetary science are well known to be non-unique (i.e. inversion of gravity the density structure of a body). In hopes of reducing the non-uniqueness of solutions, there has been interest in the joint analysis of data. An example is the joint inversion of gravity and magnetic data, with the assumption that the same physical anomalies generate both the observed magnetic and gravitational anomalies. In this talk, we formulate the joint analysis of different types of data in a Bayesian framework and apply the formalism to the inference of the density and remanent magnetization structure for a local region in the Ismenius area of Mars. The Bayesian approach allows prior information or constraints in the solutions to be incorporated in the inversion, with the "best" solutions those whose forward predictions most closely match the data while remaining consistent with assumed constraints. The application of this framework to the inversion of gravity and magnetic data on Mars reveals two typical challenges - the forward predictions of the data have a linear dependence on some of the quantities of interest, and non-linear dependence on others (termed the "linear" and "non-linear" variables, respectively). For observations with Gaussian noise, a Bayesian approach to inversion for "linear" variables reduces to a linear filtering problem, with an explicitly computable "error" matrix. However, for models whose forward predictions have non-linear dependencies, inference is no longer given by such a simple linear problem, and moreover, the uncertainty in the solution is no longer completely specified by a computable "error matrix". It is therefore important to develop methods for sampling from the full Bayesian posterior to provide a complete and statistically consistent picture of model uncertainty, and what has been learned from observations. We will discuss advanced numerical techniques, including Monte Carlo Markov

data analysis↗

Development of Unsteady Aerodynamic State-Space Models from CFD-Based Pulse Responses

A method for computing discrete-time state-space models of linearized unsteady aerodynamic behavior directly from aeroelastic CFD codes is presented. The method involves the treatment of CFD-based pulse responses as Markov parameters for use in a system identification /realization algorithm. Results are presented for the AGARD 445.6 Aeroelastic Wing with four aeroelastic modes at a Mach number of 0.96 using the EZNSS Euler/Navier-Stokes flow solver with aeroelastic capability. The System/Observer/Controller Identification Toolbox (SOCIT) algorithm, based on the Ho-Kalman realization algorithm, is used to generate 15th- and 32nd-order discrete-time state-space models of the unsteady aerodynamic response of the wing over the entire frequency range of interest.

Silva, Walter A.↗

Plug & play directed evolution of proteins with gradient-based discrete MCMC

Abstract A long-standing goal of machine-learning-based protein engineering is to accelerate the discovery of novel mutations that improve the function of a known protein. We introduce a sampling framework for evolving proteins in silico that supports mixing and matching a variety of unsupervised models, such as protein language models, and supervised models that predict protein function from sequence. By composing these models, we aim to improve our ability to evaluate unseen mutations and constrain search to regions of sequence space likely to contain functional proteins. Our framework achieves this without any model fine-tuning or re-training by constructing a product of experts distribution directly in discrete protein space. Instead of resorting to brute force search or random sampling, which is typical of classic directed evolution, we introduce a fast Markov chain Monte Carlo sampler that uses gradients to propose promising mutations. We conduct in silico directed evolution experiments on wide fitness landscapes and across a range of different pre-trained unsupervised models, including a 650 M parameter protein language model. Our results demonstrate an ability to efficiently discover variants with high evolutionary likelihood as well as estimated activity multiple mutations away from a wild type protein, suggesting our sampler provides a practical and effective new paradigm for machine-learning-based protein engineering.

59 BASIC BIOLOGICAL SCIENCES↗

Radiation Source Localization Using Surrogate Models Constructed from 3-D Monte Carlo Transport Physics Simulations

Recent research has focused on the development of surrogate models for radiation source localization in a simulated urban domain. We employ the Monte Carlo N-Particle (MCNP) code to provide high- delity simulations of radiation transport within an urban domain. The model is constructed to employ a source location (x, y, z) as input and return the estimated count rate for a set of speci ed detector locations. Because MCNP simulations are computationally expensive, we develop e cient and accurate surrogate models of the detector responses. We construct surrogate models using Gaussian processes (GP) and neural networks (NN) that we train and verify using the MCNP simulations. The trained surrogate models provide an e cient framework for Bayesian inference and experimental design. We employ Delayed Rejection Adaptive Metropolis (DRAM), a Markov Chain Monte Carlo (MCMC) algorithm, to infer the location and intensity of an unknown source. The DRAM results yield a posterior probability distribution for the source's location conditioned on the observed detector count rates. The posterior distribution exhibits regions of high and low probability within the simulated environment identifying potential source locations. In this manner, we can quantify the source location to within at least one of these regions of high probability in the considered cases. Employing these methods, we are able to reduce the space of potential source locations by at least 60%.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SDSS-IV MaStar: theoretical atmospheric parameters for the MaNGA stellar library

ABSTRACT We calculate the fundamental stellar parameters effective temperature, surface gravity, and iron abundance – Teff, log g, [Fe/H] – for the final release of the Mapping Nearby Galaxies at APO (MaNGA) Stellar Library (MaStar), containing 59 266 per-visit-spectra for 24 290 unique stars at intermediate resolution (R ∼ 1800) and high S/N (median = 96). We fit theoretical spectra from model atmospheres by both MARCS and BOSZ-ATLAS9 to the observed MaStar spectra, using the full spectral fitting code pPXF. We further employ a Bayesian approach, using a Markov Chain Monte Carlo (MCMC) technique to map the parameter space and obtain uncertainties. Originally in this paper, we cross match MaStar observations with Gaia photometry, which enable us to set reliable priors and identify outliers according to stellar evolution. In parallel to the parameter determination, we calculate corresponding stellar population models to test the reliability of the parameters for each stellar evolutionary phase. We further assess our procedure by determining parameters for standard stars such as the Sun and Vega and by comparing our parameters with those determined in the literature from high-resolution spectroscopy (APOGEE and SEGUE) and from lower resolution matching template (LAMOST). The comparisons, considering the different methodologies and S/N of the literature surveys, are favourable in all cases. Our final parameter catalogue for MaStar cover the following ranges: 2592 ≤ Teff ≤ 32 983 K; −0.7 ≤ log g ≤ 5.4 dex; −2.9 ≤ [Fe/H] ≤ 1.0 dex and will be available with the last SDSS-IV Data Release, in 2021 December.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Calibration of Stochastic Agent Based Model via Random Forest

Agent-based models (ABM) provide an excellent framework for modeling outbreaks and interventions in epidemiology by explicitly accounting for diverse individual interactions and environments. However, these models are usually stochastic and highly parametrized, requiring precise calibration for predictive performance. When considering realistic numbers of agents and properly accounting for stochasticity, this high-dimensional calibration can be computationally prohibitive. This paper presents a random forest-based surrogate modeling technique to accelerate the evaluation of ABMs and demonstrates its use to calibrate an epidemiological ABM named CityCOVID via Markov chain Monte Carlo (MCMC). The technique is first outlined in the context of CityCOVID's quantities of interest, namely hospitalizations and deaths, by exploring dimensionality reduction via temporal decomposition with principal component analysis (PCA) and via sensitivity analysis. The calibration problem is then presented, and samples are generated to best match COVID-19 hospitalization and death numbers in Chicago from March to June in 2020. Further, these results are compared with previous approximate Bayesian calibration (IMABC) results, and their predictive performance is analyzed, showing improved performance with a reduction in computation.

60 APPLIED LIFE SCIENCES↗

Confronting interacting dark radiation scenarios with cosmological data

Dark radiation (DR) is generally predicted in new physics scenarios that address fundamental puzzles of the Standard Model or tensions in the cosmological data. Cosmological data have the sensitivity to constrain not only the energy density of DR but also whether it is interacting. In this paper, we present a systematic study of five types of interacting DR (free-streaming, fluid, decoupling, instantaneous decoupling, and recoupling DR) and their impact on cosmological observables. We modify the Boltzmann hierarchy to describe all these types of interacting DR under the relaxation time approximation. We, for the first time, robustly calculate the collision terms for recoupling scalar DR and provide a better estimation of the recoupling transition redshift. We demonstrate the distinct features of each type of DR on the cosmic microwave background and matter power spectra. We perform Markov-chain Monte Carlo scans using the Planck 2018 data and baryon acoustic oscillation data. Assuming no new physics in the standard model neutrino sector, we find no statistically significant constraints on the couplings of DR, although there is a slight preference for the fluidlike limit of all the cases. In the case of instantaneous decoupling DR, this limit corresponds to a late transition redshift around recombination. Furthermore, the ΔN eff constraint varies marginally depending on the type of DR.

79 ASTRONOMY AND ASTROPHYSICS↗

Diffusion growth mechanism of penta-twinned Ag nanocrystals from decahedral seeds

Crystals with penta-twinned structures can be produced from diverse fcc metals, but the mechanisms that control the final product shapes are still not well understood. By using the theory of absorbing Markov chains to account for the growth of penta-twinned decahedral seeds via atom deposition and surface diffusion, we predicted the formation of various types of products: decahedra, nanorods, and nanowires. We showed that the type of product depends on the morphology of the seed and that small differences between various seed morphologies can lead to significantly different products. For the case of uncapped decahedra seeds, we compared predictions from our model to nanowire morphologies obtained in two different experiments and obtained favorable agreement. Finally, possible extensions of our model are indicated.

36 MATERIALS SCIENCE↗

Network Modeling of Complex Data Sets

We demonstrate a selection of network and machine learning techniques useful in the analysis of complex datasets, including 2-way similarity networks, Markov clustering, enrichment statistical networks, FCROS differential analysis, and random forests. We demonstrate each of these techniques on the Populus trichocarpa gene expression atlas.

Jones, Piet C.↗