Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS2025

Efficient GPU-Accelerated MultiSource Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational-wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analyzing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains massive black hole binaries, compact galactic binaries, and a parametrized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble Markov Chain Monte Carlo (MCMC) sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or transdimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data.We recover posterior distributions for all 15 (6) of the injected massive black hole binaries (MBHB) in the LDC2A training (hidden) dataset. We catalog ∼12000 galactic binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA↗
DOE OSTI2025

Deep Reinforcement Learning for Distribution System Operations: A Tutorial and Survey

Here, the rapid evolution of modern electric power distribution systems into complex networks of interconnected active devices, distributed generation (DG), and storage poses increasing difficulties for system operators. The large-scale integration of distributed energy resources (DERs) and the rapid exchange of measurement data via communication networks present major opportunities for advancing grid operations but also introduce greater uncertainty, higher data dimensionality, more complex network and device models, and challenging control and optimization problems. Deep reinforcement learning (DRL) algorithms are promising in addressing these challenges. However, they have not been effectively adapted for power systems applications, requiring extensive customization for implementation and evaluation. This has resulted in reproducibility challenges and a steep learning curve for researchers new to applying DRL algorithms to the power systems domain. To bridge these gaps, this tutorial aims to serve as a valuable resource for researchers interested in exploring learning-based algorithms to operate active power distribution networks. Specifically, this work presents a generalized process for translating sequential decision-making problems in power distribution systems into Markov decision process (MDP) formulations, illustrated through concrete grid service examples. Additionally, we introduce a simple environment design strategy to develop and evaluate example DRL algorithms for distribution system applications, complete with an included code repository to guide users through environment construction.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

GIGA-Lens: Fast Bayesian Inference for Strong Gravitational Lens Modeling

We present GIGA-Lens: a gradient-informed, GPU-accelerated Bayesian framework for modeling strong gravitational lensing systems, implemented in TensorFlow and JAX. The three components, optimization using multistart gradient descent, posterior covariance estimation with variational inference, and sampling via Hamiltonian Monte Carlo, all take advantage of gradient information through automatic differentiation and massive parallelization on graphics processing units (GPUs). We test our pipeline on a large set of simulated systems and demonstrate in detail its high level of performance. The average time to model a single system on four Nvidia A100 GPUs is 105 s. The robustness, speed, and scalability offered by this framework make it possible to model the large number of strong lenses found in current surveys and present a very promising prospect for the modeling of ${ \mathcal O }({10}^{5})$ lensing systems expected to be discovered in the era of the Vera C. Rubin Observatory, Euclid, and the Nancy Grace Roman Space Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Noise-specific beating in the higher-level Ramsey curves of a transmon qubit

We report: in the higher levels of superconducting transmon devices and more generally charge sensitive devices, T 2 * measurements made in the presence of low-frequency time-correlated 1/f charge noise and quasiparticle-induced parity flips can give an underestimation of the total dephasing time. The charge variations manifest as beating patterns observed in the overlay of several Ramsey fringe curves and are reproduced with a phenomenological Ramsey curve model, which accounts for the charge variations. T 2 * dephasing times, which more accurately represent the total dephasing time, are obtained. The phenomenological model is compared with a Lindblad master equation model. Both models are found to be in agreement with one another and the experimental data. Finally, the phenomenological formulation enables a simple method in which the power spectral density for the low-frequency noise can be inferred from the overlay of several Ramsey curves.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2014

The Evolution of the Galaxy Rest-Frame Ultraviolet Luminosity Function Over the First Two Billion Years

We present a robust measurement and analysis of the rest-frame ultraviolet (UV) luminosity function at z = 4 to 8. We use deep Hubble Space Telescope imaging over the CANDELS/GOODS fields, the Hubble Ultra Deep Field and the Hubble Frontier Field deep parallel observations near the Abell 2744 and MACS J0416.1- 2403 clusters. The combination of these surveys provides an effective volume of 0.6-1.2 ×10(exp 6) Mpc(exp 3) over this epoch, allowing us to perform a robust search for bright (M(sub UV) less than −21) and faint (M(sub UV) = −18) galaxies. We select galaxies using a well-tested photometric redshift technique with careful screening of contaminants, finding a sample of 7446 galaxies at 3.5 less than z less than 8.5, with more than 1000 galaxies at z of approximately 6 - 8. We measure both a stepwise luminosity function for galaxies in our redshift samples, as well as a Schechter function, using a Markov Chain Monte Carlo analysis to measure robust uncertainties. At the faint end our UV luminosity functions agree with previous studies, yet we find a higher abundance of UV-bright galaxies at z of greater than or equal to 6. Our bestfit value of the characteristic magnitude M* is consistent with −21 at z of greater than or equal to 5, different than that inferred based on previous trends at lower redshift. At z = 8, a single power-law provides an equally good fit to the UV luminosity function, while at z = 6 and 7, an exponential cutoff at the bright-end is moderately preferred. We compare our luminosity functions to semi-analytical models, and find that the lack of evolution in M* is consistent with models where the impact of dust attenuation on the bright-end of the luminosity function decreases at higher redshift, though a decreasing impact of feedback may also be possible. We measure the evolution of the cosmic star-formation rate (SFR) density by integrating our observed luminosity functions to M(sub UV) = −17, correcting for dust attenuation, and find that the SFR density declines proportionally to (1 + z)((exp −4.3)(+/-)(0.5)) at z greater than 4, consistent with observations at z greater than or equal to 9. Our observed luminosity functions are consistent with a reionization history that starts at redshift of approximately greater than 10, completes at z greater than 6, and reaches a midpoint (x(sub HII) = 0.5) at 6.7 less than z less than 9.4. Finally, using a constant cumulative number density selection and an empirically derived rising star-formation history, our observations predict that the abundance of bright z = 9 galaxies is likely higher than previous constraints, though consistent with recent estimates of bright z similar to 10 galaxies.

Galaxy↗
NASA NTRS2006

An Ensemble-Based Smoother with Retrospectively Updated Weights for Highly Nonlinear Systems

Monte Carlo computational methods have been introduced into data assimilation for nonlinear systems in order to alleviate the computational burden of updating and propagating the full probability distribution. By propagating an ensemble of representative states, algorithms like the ensemble Kalman filter (EnKF) and the resampled particle filter (RPF) rely on the existing modeling infrastructure to approximate the distribution based on the evolution of this ensemble. This work presents an ensemble-based smoother that is applicable to the Monte Carlo filtering schemes like EnKF and RPF. At the minor cost of retrospectively updating a set of weights for ensemble members, this smoother has demonstrated superior capabilities in state tracking for two highly nonlinear problems: the double-well potential and trivariate Lorenz systems. The algorithm does not require retrospective adaptation of the ensemble members themselves, and it is thus suited to a streaming operational mode. The accuracy of the proposed backward-update scheme in estimating non-Gaussian distributions is evaluated by comparison to the more accurate estimates provided by a Markov chain Monte Carlo algorithm.

Monte Carlo↗
DOE OSTI2024

GraMeR: Gra ph Me ta R einforcement learning for multi-objective influence maximization

Influence maximization (IM) is a combinatorial problem of identifying a subset of seed nodes in a network (graph), which when activated, provide a maximal spread of influence in the network for a given diffusion model and a budget for seed set size. IM has numerous applications such as viral marketing, epidemic control, sensor placement and other network-related tasks. However, its practical uses are limited due to the computational complexity of current algorithms. Recently, deep reinforcement learning has been leveraged to solve IM in order to ease the computational burden. However, there are serious limitations in current approaches, including narrow IM formulation that only consider influence via spread and ignore self-activation, low scalability to large graphs, and lack of generalizability across graph families leading to a large running time for every test network. In this work, we address these limitations through a unique approach that involves: (1) Formulating a generic IM problem as a Markov decision process that handles both intrinsic and influence activations; (2)incorporating generalizability via meta-learning across graph families. There are previous works that combine deep reinforcement learning with graph neural network, but this work solves a more realistic IM problem and incorporates generalizability across graphs via meta reinforcement learning. Extensive experiments are carried out in various standard networks to validate performance of the proposed Graph Meta Reinforcement learning (GraMeR) framework. Finally, the results indicate that GraMeR is multiple orders faster and generic than conventional approaches when applied on small to medium scale graphs.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1987

Statistics and dynamics of persistent anomalies

Persistent anomalies with recurrent spatial patterns play an important role in the atmosphere's low-frequency variability. A connection between statistical and dynamical methods of description and prediction of persistent anomalies is established by computing and analyzing the empirical orthogonal functions (EOFs) in a simple deterministic model, on the one hand, and in Southern Hemisphere geopotential heights, on the other. The dynamical model is governed by the fully nonlinear, equivalent-barotropic vorticity equation on the sphere, with simplified forcing, dissipation and topography. The Southern Hemisphere data consist in gridded daily maps of 500 mb heights from June 1972 to July 1983. Two types of persistent anomalies appear in this time series, both having a strong wavenumber-three component; they differ by the value of the constant phase of this wave and by the strength of the wavenumber-one component. The first two EOFs bear a striking resemblance to these two patterns. It is concluded that the dynamical interpretation of EOFs is their pointing from the time mean to the most populated regions of the system's phase space. Pursuing this interpretation, a Markov-chain formulation of transitions from one persistent anomaly regime to another is introduced, and the implications for long-range forecasting are discussed.

Mo, Kingtse C.↗
DOE OSTI2022

Learning infinite-horizon average-reward restless multi-action bandits via index awareness

We consider the online restless bandits with average-reward and multiple actions, where the state of each arm evolves according to a Markov decision process (MDP), and the reward of pulling an arm depends on both the current state of the corresponding MDP and the action taken. Since finding the optimal control is typically intractable for restless bandits, existing learning algorithms are often computationally expensive or with a regret bound that is exponential in the number of arms and states. In this paper, we advocate \textit{index-aware reinforcement learning} (RL) solutions to design RL algorithms operating on a much smaller dimensional subspace by exploiting the inherent structure in restless bandits. Specifically, we first propose novel index policies to address dimensionality concerns, which are provably optimal. We then leverage the indices to develop two low-complexity index-aware RL algorithms, namely, (i) GM-R2MAB, which has access to a generative model; and (ii) UC-R2MAB, which learns the model using an upper confidence style online exploitation method. We prove that both algorithms achieve a sub-linear regret that is only polynomial in the number of arms and states. A key differentiator between our algorithms and existing ones stems from the fact that our RL algorithms contain a novel exploitation that leverages our proposed provably optimal index policies for decision-makings.

Xiong, Guojun↗
DOE OSTI2020

CALPHAD Uncertainty Quantification and TDBX

CALPHAD uncertainty quantification (UQ) is the foundation of materials design with quantified confidence. We report a framework and software packages to enable CALPHAD UQ assessment and calculation using commercial CALPHAD software (Thermo-Calc). This Bayesian inference framework is coupled with a Markov chain Monte Carlo algorithm to establish uncertainty traces with a given thermodynamic database file (TDB) and corresponding experimental data points. This general framework is demonstrated with the Ni–Cr binary system. The algorithm is firstly validated on synthetic data with known ground truth. Then it is applied to real experimental data to generate posterior traces. We develop a file format named TDBX, which provides a single source of truth by combining the original TDB content and the traces for each assessed Gibbs energy parameter. CALPHAD UQ calculations are performed based on the TDBX file, from which uncertainties for phase boundaries, enthalpy curves, and solidification range are collected as examples of basic design parameters. This TDBX file with corresponding scripts are made open-source. Finally, the combination of CALPHAD UQ assessments and calculations connected by TDBX supports uncertainty-assisted modeling, enabling the integrated application of modern design with uncertainty methodologies to computational materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Using PyBioNetFit to leverage qualitative and quantitative data in biological model parameterization and uncertainty quantification

Data generated in studies of cellular regulatory systems are often qualitative. For example, measurements of signaling readouts in the presence and absence of mutations may reveal a rank ordering of responses across conditions but not the precise extents of mutation-induced differences. Qualitative data are often ignored by mathematical modelers or are considered in an ad hoc manner, as in the study of Kocieniewski and Lipniacki (2013) [Phys Biol 10: 035006], which was focused on the roles of MEK isoforms in ERK activation. In this earlier study, model parameter values were tuned manually to obtain consistency with a combination of qualitative and quantitative data. This approach is not reproducible, nor does it provide insights into parametric or prediction uncertainties. Here, starting from the same data and the same ordinary differential equation (ODE) model structure, we generate formalized statements of qualitative observations, making these observations more reusable, and we improve the model parameterization procedure by applying a systematic and automated approach enabled by the software package PyBioNetFit. We also demonstrate uncertainty quantification (UQ), which was absent in the original study. Our results show that PyBioNetFit enables qualitative data to be leveraged, together with quantitative data, in parameterization of systems biology models and facilitates UQ. These capabilities are important for reliable estimation of model parameters and model analyses in studies of cellular regulatory systems and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Hadron spectroscopy of pseudoscalar and vector meson photoproduction using linearly polarised photons at CLAS

The field of hadron spectroscopy is informed by experiments which study excited states of the nucleon by detecting the decay products following excitation with a hadronic, leptonic or electromagnetic probe. Experiments using a polarised beam of photons provide an important contribution to the world data. This thesis describes the analysis of data from one such experiment, the CEBAF Large Acceptance Spectrometer at Jefferson Laboratory, Virginia, USA. In the experiment, an incident beam of electrons passes through a diamond radiator producing a linearly polarised photon beam of energy from 1.1 to 2.1 GeV on a liquid hydrogen target. The analysis method and results for two reaction channels are presented. In the first analysis, the polarisation observables {?, P, T, Ox, Oz} for the reaction ??? p ? K0 S ?+ are extracted simultaneously using likelihood sampling with Markov-Chain Monte-Carlo. The results are presented as angular distributions (cos ?K0S) for bins in photon energy E? for a total of 21 bins. The values extracted for T , Ox and Oz are a first measurement of these quantities for this reaction and the beam asymmetry (?) measurement supplements the one previous measurement for this quantity and extends the energy range over which it has been extracted. The measurement of the recoil polarisation, P, is consistent with previous measurements. In a second analysis, the spin density matrix elements (SDMEs) for ? p ? p ? are extracted using similar analysis techniques. The results are presented as angular distributions (cos ?? ) for bins in photon energy E? for a total of 24 bins. This work is the first to extract all nine SDMEs for the full angular range of the ? meson production. A comparison is made to the predictions of the Vector Meson Dominance (VMD) model and the results provide evidence for contributing processes other than VMD, particularly at more backward angles of the ? meson production. The data also indicate non-helicity conserving process in both the s-channel and the t-channel. The results from the first analysis have been passed to the Juelich-Bonn theory group and the effect of including the new data within their dynamical coupled channel model is described. Several nucleon resonances are affected and the impact on the pole positions, widths and photon decay amplitudes of the affected resonances is described.

Clark, Louise↗
NASA NTRS1995

Systematic analysis of coding and noncoding DNA sequences using methods of statistical linguistics

We compare the statistical properties of coding and noncoding regions in eukaryotic and viral DNA sequences by adapting two tests developed for the analysis of natural languages and symbolic sequences. The data set comprises all 30 sequences of length above 50 000 base pairs in GenBank Release No. 81.0, as well as the recently published sequences of C. elegans chromosome III (2.2 Mbp) and yeast chromosome XI (661 Kbp). We find that for the three chromosomes we studied the statistical properties of noncoding regions appear to be closer to those observed in natural languages than those of coding regions. In particular, (i) a n-tuple Zipf analysis of noncoding regions reveals a regime close to power-law behavior while the coding regions show logarithmic behavior over a wide interval, while (ii) an n-gram entropy measurement shows that the noncoding regions have a lower n-gram entropy (and hence a larger "n-gram redundancy") than the coding regions. In contrast to the three chromosomes, we find that for vertebrates such as primates and rodents and for viral DNA, the difference between the statistical properties of coding and noncoding regions is not pronounced and therefore the results of the analyses of the investigated sequences are less conclusive. After noting the intrinsic limitations of the n-gram redundancy analysis, we also briefly discuss the failure of the zeroth- and first-order Markovian models or simple nucleotide repeats to account fully for these "linguistic" features of DNA. Finally, we emphasize that our results by no means prove the existence of a "language" in noncoding DNA.

NASA Discipline Number 14-10↗
DOE OSTI2022

Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network’s universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Self-organized criticality in multi-pulse gamma-ray bursts

The variability in multi-pulse gamma-ray bursts (GRBs) may help to reveal the mechanism of underlying processes from the central engine. To investigate whether the self-organized criticality (SOC) phenomena exist in the prompt phase of GRBs, we statistically study the properties of GRBs with more than 3 pulses in each burst by fitting the distributions of several observed physical variables with a Markov Chain Monte Carlo approach, including the isotropic energy E iso , the duration time T, and the peak count rate P of each pulse. Our sample consists of 454 pulses in 93 GRBs observed by the CGRO/BATSE satellite. The best-fitting values and uncertainties for these power-law indices of the differential frequency distributions are: α$^{d}_{E}$ = 1.54±0.09, α$^{d}_{T}$ = 1.82±$^{+0.14}_{0.15}$ and α$^{d}_{P}$ = 2.09$^{+0.18}_{–0.19}$, while the power-law indices in the cumulative frequency distributions are: α$^{c}_{E}$ = 1.44$^{+0.08}_{–0.10}$, α$^{c}_{T}$ = 1.75$^{+0.141}_{–0.13}$ and α$^{c}_{P}$ = 1.99$^{+0.16}_{–0.19}$. We find that these distributions are roughly consistent with the physical framework of a Fractal-Diffusive, Self-Organized Criticality (FD-SOC) system with the spatial dimension S = 3 and the classical diffusion β=1. The results of this study support that the jet responsible for the GRBs should be magnetically dominated and magnetic instabilities (e.g., kink model, or tearing-model instability) lead the GRB emission region into the SOC state.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2003

Modeling, Analyzing, and Mitigating Dissonance Between Alerting Systems

Alerting systems are becoming pervasive in process operations, which may result in the potential for dissonance or conflict in information from different alerting systems that suggests different threat levels and/or actions to resolve hazards. Little is currently available to help in predicting or solving the dissonance problem. This thesis presents a methodology to model and analyze dissonance between alerting systems, providing both a theoretical foundation for understanding dissonance and a practical basis from which specific problems can be addressed. A state-space representation of multiple alerting system operation is generalized that can be tailored across a variety of applications. Based on the representation, two major causes of dissonance are identified: logic differences and sensor error. Additionally, several possible types of dissonance are identified. A mathematical analysis method is developed to identify the conditions for dissonance originating from logic differences. A probabilistic analysis methodology is developed to estimate the probability of dissonance originating from sensor error, and to compare the relative contribution to dissonance of sensor error against the contribution from logic differences. A hybrid model, which describes the dynamic behavior of the process with multiple alerting systems, is developed to identify dangerous dissonance space, from which the process can lead to disaster. Methodologies to avoid or mitigate dissonance are outlined. Two examples are used to demonstrate the application of the methodology. First, a conceptual In-Trail Spacing example is presented. The methodology is applied to identify the conditions for possible dissonance, to identify relative contribution of logic difference and sensor error, and to identify dangerous dissonance space. Several proposed mitigation methods are demonstrated in this example. In the second example, the methodology is applied to address the dissonance problem between two air traffic alert and avoidance systems: the existing Traffic Alert and Collision Avoidance System (TCAS) vs. the proposed Airborne Conflict Management system (ACM). Conditions on ACM resolution maneuvers are identified to avoid dynamic dissonance between TCAS and ACM. Also included in this report is an Appendix written by Lee Winder about recent and continuing work on alerting systems design. The application of Markov Decision Process (MDP) theory to complex alerting problems is discussed and illustrated with an abstract example system.

Song, Lixia↗
DOE OSTI2021

Theoretical evidence of water serving as a promoter for lithium superoxide disproportionation in Li-O 2 batteries

Experimental evidence has demonstrated that the presence of water in non-aqueous electrolytes significantly affects Li-O 2 electrochemistry. Understanding the reaction mechanism for Li 2 O 2 formation in the presence of water impurities is important to understand Li-O 2 battery performance. A recent experiment has found that very small amounts of water (as low as 40 ppm) can significantly affect the product formation in Li-O 2 batteries as opposed to essentially no water (1 ppm). Although experimental as well as theoretical work has proposed mechanisms of Li 2 O 2 formation in the presence of much larger amounts of water, none of the mechanisms provide an explanation for the observations for very small amounts of water. In this work, density functional theory (DFT) was utilized to obtain a mechanistic understanding of the Li-O 2 discharge chemistry in a dimethoxyethane (DME) electrolyte containing an isolated water and no water. The reaction pathways for Li 2 O 2 formation from LiO 2 on a model system were carefully evaluated with different level of theories, i.e. PBE (PW), B3LYP/6-31G(2df,p), B3LYP/6-311++G(2df,p) and G4MP2. The results indicate that the LiO 2 disproportionation reaction to Li 2 O 2 can be promoted by the water in DME electrolyte, which explains why there is a significant difference compared to when no water is present in the experimentally observed discharge product distributions. Ab initio molecular dynamics calculations were also used to investigate the disproportionation of LiO 2 dimer in explicit DME. This work adds to the fundamental understanding of the discharge chemistry of a Li-O 2 battery.

25 ENERGY STORAGE↗