Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Coupling to rotational manifolds to improve gas-phase pump–probe spectroscopic models

The physical picture of gas-phase optical transitions is normally presented as an isolated two-level system balanced by upward and downward processes. Isolated models assume a phenomenological treatment of collisional dephasing but do not strictly account for collisional population exchange with the rotational baths. While this assumption is valid under low-intensity conditions, where excitation is rate-limiting, isolated models can deviate from Beer’s Law at sufficient pressures and monochromatic intensities when both collisional broadening and power broadening are comparable to (or greater than) lifetime broadening, which are not uncommon conditions for cavity enhanced spectroscopies in the mid-IR spectral range. Although this problem has been addressed by rate-equation models for linear absorption measurements, a general treatment for multi-level quantum mechanical models suitable for non-linear absorption measurements (two-photon/two-color/pump–probe) is lacking. Isolated models require physical parameter inputs that disagree with expected values by at least an order of magnitude. These non-physical models undermine the ability to predict non-linear signal strengths under untested conditions and thereby limit the potential to optimize the sensitivity of non-linear spectroscopies and to expand their analytical applications (e.g., new analytes and/or buffer gases, changes in cavity free-spectral-range, changes in intracavity powers or wavelengths, and accurate investigation of physical phenomena). In this study, we derive bath-coupled models for gaseous pump–probe spectroscopy by application of the quantum Lindblad equation and detailed balance. Bath-coupled models are shown to fit data consistently across variations in intensity and agree with all physically expected values.

Cavity ring-down spectroscopy↗
DOE OSTI2023

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗
NASA NTRS1993

Q-Markov covariance equivalent realization and its application to flexible structure identification

The Q-Markov covariance equivalent realization algorithm is applied to NASA's Minimast structure to identify state-space models for the purpose of designing closed-loop controllers, and laboratory test results are shown for the identification and for the closed-loop performance. The paper also presents for the first time a deterministic formulation of covariance parameters from a pulse response, a stochastic formulation of Markov parameters from a white-noise response, and a simple Q-Markov covariance equivalent realization formulation. This requires only pulse laboratory tests or only white-noise laboratory tests to generate Q-Markov covariance equivalent realizations.

Liu, Ketao↗
DOE OSTI2023

Search for low mass dark matter in DarkSide-50: the bayesian network approach

Abstract We present a novel approach for the search of dark matter in the DarkSide-50 experiment, relying on Bayesian Networks. This method incorporates the detector response model into the likelihood function, explicitly maintaining the connection with the quantity of interest. No assumptions about the linearity of the problem or the shape of the probability distribution functions are required, and there is no need to morph signal and background spectra as a function of nuisance parameters. By expressing the problem in terms of Bayesian Networks, we have developed an inference algorithm based on a Markov Chain Monte Carlo to calculate the posterior probability. A clever description of the detector response model in terms of parametric matrices allows us to study the impact of systematic variations of any parameter on the final results. Our approach not only provides the desired information on the parameter of interest, but also potential constraints on the response model. Our results are consistent with recent published analyses and further refine the parameters of the detector response model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1971

Bayesian recursive image estimation.

A procedure for recursively estimating images that are characterized statistically by the mean and correlation functions associated with the random process representing the brightness level is proposed for the case where the images are corrupted by additive noise. First, a dynamic model is developed with a response characteristic which matches that of the scanner output (the input of the estimator is the output of a horizontal line scanner) in a statistical sense. Such models have the form of an ordinary differential or difference equation with white noise input. An insignificant approximation is introduced by using a constant-coefficient model. The appropriate model is a vector valued difference equation with the solution representing a vector Markov process. The next step is to obtain the minimum mean square estimate of the image by using a Kalman filter. Since the image estimation is an interpolation problem, two successive runs over the observation are performed in opposite directions and the resultant estimates are averaged. Examples are included for illustration.

Nahi, N. E.↗
NASA NTRS1995

Interdecadal Variations in the Alaska Gyre

Climatic dynamic topography variations in the Alaska gyre during the period 1968-1990 are described with an objective analysis of more than 12000 STD and XBT stations, and COADS wind stress data Interannual the dynamic height and SST variations were correlated and were consistent with recently described large-scale climatic shifts in the North Pacific. The gyre was centered more to the east, circulation appeared stronger, and SST was lower during the early to mid-1970s than during the 1980s. The Aleutian low (NP and PNA indices) intensified during the interim, but the response did not appear as a gyre spinup. Instead, the associated wind stress anomalies forced a slowly varying dynamic height anomaly across the eastern and northern part of the gyre through Ekman convergence, which had the effect of displacing the gyre's low somewhat to the WSW in the 1980s. The wind curl spectrum was white, and the slow oceanic response was modeled as stochastic-forced climate variability with a simple first-order Markov autoregression process. Forcing was assumed to be Ekman pumping of the pycnocline, and the damping coefficient was estimated from the data to be approx. 1 yr. A hindcast with observed winds gave estimated dynamic height patterns similar to those observed, with a canonical correlation of 0.79 at 99% confidence. This response was weak in the western half of the gyre, where slow baroclinic variability may have been influenced by long Rossby wave propagation. A simple autoregression simulation using artificial white noise forcing shows the evolution of decadal variations similar in nature to those observed. This result, along with the low frequency correlation between dynamic height and SST, suggests that the upper-ocean climatic variability in this region is primarily wind forced.

Lagerloef, Gary S.E.↗
NASA NTRS2011

Unsupervised Detection of Planetary Craters by a Marked Point Process

With the launch of several planetary missions in the last decade, a large amount of planetary images is being acquired. Preferably, automatic and robust processing techniques need to be used for data analysis because of the huge amount of the acquired data. Here, the aim is to achieve a robust and general methodology for crater detection. A novel technique based on a marked point process is proposed. First, the contours in the image are extracted. The object boundaries are modeled as a configuration of an unknown number of random ellipses, i.e., the contour image is considered as a realization of a marked point process. Then, an energy function is defined, containing both an a priori energy and a likelihood term. The global minimum of this function is estimated by using reversible jump Monte-Carlo Markov chain dynamics and a simulated annealing scheme. The main idea behind marked point processes is to model objects within a stochastic framework: Marked point processes represent a very promising current approach in the stochastic image modeling and provide a powerful and methodologically rigorous framework to efficiently map and detect objects and structures in an image with an excellent robustness to noise. The proposed method for crater detection has several feasible applications. One such application area is image registration by matching the extracted features.

Troglio, G.↗
DOE OSTI2023

Stochastic Price Generation for Evaluating Wholesale Electricity Market Bidding Strategies

This work presents a novel method for generating electricity price scenarios from statistical properties of past electricity prices using a hybrid statistical and reduced-form stochastic model. Previous work in applying stochastic differential equations (SDE) to model electricity prices has focused on daily average prices. To extend stochastic price generation methods to hourly or sub-hourly pricing, we address several weaknesses in the state-of-the-art: (1) we replace the mean-reversion component of the SDE with an ARIMA process that is better able to characterize the daily and weekly trends; (2) we extend the price-spike, or jump process to account for conditional probabilities of price spikes occurring in consecutive time steps by replacing the traditional Poisson process for modeling jumps with a generalized point process model inspired by brain neuron models; and (3) we replace the traditional method of estimating spike intensity with empirical variance with a Markov process based on observed price spike intensity transitions. The method is demonstrated with electricity prices from the US ERCOT market and a use-case example is provided for bidding an energy storage unit into the day-ahead and real-time energy markets of ERCOT using stochastic optimization methods. Results show that the the synthetic price model out performs a (naive) persistence forecast model by resulting in 24% to 47% more in profits over 168 simulated days.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1988

The inclusion of semi-Markov reconfiguration transitions into the computer-aided Markov evaluator (CAME) program

The modifications to the rule-based CAME program which allow it to more accurately model the fault-handling processes of fault-tolerant systems are described. This new capability is added to the CAME program by modeling the fault-handling processes of fault-tolerant systems. The integrated airframe/propulsion control system architecture (IAPSA II) reference configuration currently under development is detailed.

Rosch, Gene↗
DOE OSTI2022

Multimodal parameter spaces of a complex multi-channel neuron model

One of the most common types of models that helps us to understand neuron behavior is based on the Hodgkin–Huxley ion channel formulation (HH model). A major challenge with inferring parameters in HH models is non-uniqueness: many different sets of ion channel parameter values produce similar outputs for the same input stimulus. Such phenomena result in an objective function that exhibits multiple modes (i.e., multiple local minima). This non-uniqueness of local optimality poses challenges for parameter estimation with many algorithmic optimization techniques. HH models additionally have severe non-linearities resulting in further challenges for inferring parameters in an algorithmic fashion. To address these challenges with a tractable method in high-dimensional parameter spaces, we propose using a particular Markov chain Monte Carlo (MCMC) algorithm, which has the advantage of inferring parameters in a Bayesian framework. The Bayesian approach is designed to be suitable for multimodal solutions to inverse problems. We introduce and demonstrate the method using a three-channel HH model. We then focus on the inference of nine parameters in an eight-channel HH model, which we analyze in detail. We explore how the MCMC algorithm can uncover complex relationships between inferred parameters using five injected current levels. The MCMC method provides as a result a nine-dimensional posterior distribution, which we analyze visually with solution maps or landscapes of the possible parameter sets. The visualized solution maps show new complex structures of the multimodal posteriors, and they allow for selection of locally and globally optimal value sets, and they visually expose parameter sensitivities and regions of higher model robustness. We envision these solution maps as enabling experimentalists to improve the design of future experiments, increase scientific productivity and improve on model structure and ideation when the MCMC algorithm is applied to experimental data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Comparison of several system identification methods for flexible structures

In the last few years various methods of identifying structural dynamics models from modal testing data have appeared. This paper presents a comparison of four of these algorithms: the Eigensystem Realization Algorithm (ERA), the modified version ERA/DC where DC indicates that it makes use of data correlations, the Q-Markov Cover algorithm, and an algorithm due to Moonen, DeMoor, Vandenberghe and Vandewalle. The comparison is made using a five mode computer model of the 20 meter Mini-Mast truss structure at NASA Langley Research Center, and various noise levels are superimposed to produce simulated data. The results show that for the example considered ERA/DC generally gives the best results; that ERA/DC is always at least as good as ERA which is shown to be a special case of ERA/DC; that Q-Markov requires the use of significantly more data than ERA/DC to produce comparable results; and that in some situations Q-Markov cannot produce comparable results.

Lew, J.-S.↗
DOE OSTI2022

Commuter preferences for a first-mile/last-mile microtransit service in the United States

Transportation system models rely heavily upon value of time (VOT) estimates to predict customer behavior. Accurate VOT estimates are particularly vital for planning new services such as on-demand ride hailing or microtransit because customers’ sensitivity to wait time, walk time, and route detour time affects their likelihood of selecting these modes. If an incorrect VOT is assumed during service planning, then ridership will be depressed because of a mismatch between their preferences and how the system is designed. In this paper, we report on the measurement of VOT for microtransit, a shared first-mile/last-mile mobility service, obtained using stated preference microdata from four U.S. cities. Here, we found a median in-vehicle VOT for microtransit of $\$$18.63 (95% CI: $\$$13.39–$\$$24.46) and an access VOT of $\$$75.38 (95% CI: $\$$59.22–$\$$94.96). The former is practically equal to the VOT we found for respondents’ current modes ($\$$20.24, 95% CI: $\$$13.71–$\$$26.94). We also found that men, younger riders, the highly educated, and transit riders are more likely to be interested in microtransit. Since the disutility of time spent on microtransit is not higher than that of other modes, we believe this new service has the potential to attract riders, and particularly if the system is designed with low waiting and walking times.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Approximate inference for constructing astronomical catalogs from images

Here, we present a new, fully generative model for constructing astronomical catalogs from optical telescope image sets. Each pixel intensity is treated as a random variable with parameters that depend on the latent properties of stars and galaxies. These latent properties are themselves modeled as random. We compare two procedures for posterior inference. One procedure is based on Markov chain Monte Carlo (MCMC) while the other is based on variational inference (VI). The MCMC procedure excels at quantifying uncertainty, while the VI procedure is 1000 times faster. On a supercomputer, the VI procedure efficiently uses 665,000 CPU cores to construct an astronomical catalog from 50 terabytes of images in 14.6 minutes, demonstrating the scaling characteristics necessary to construct catalogs for upcoming astronomical surveys.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2016

Real-time Identification and Control of Satellite Signal Impairments Solution and Application of the Stratonovich Equation Part 1. Theoretical Development

As satellite communications systems become both more complex and reliant with respect to their operating environment, it has become imperative to be able to identify, during real-time operation, the onset of one or more impairments to the quality of overall communications system integrity. One of the most important aspects to monitor of a satellite link operating within the Earth's atmosphere is the signal fading due to the occurrence of rain and/or phase scintillations. This, of course, must be done in the presence of the associated measurement uncertainty or potentially faulty measurement equipment such as in the Advanced Communication Technology Satellite (ACTS) experiment. In the present work, an approach originally suggested in 1991, and apparently still considered iconoclastic, will be significantly developed and applied to the satellite communications link on which the deleterious composite signal fade is the result of one or many component fade mechanisms. Through the measurement (with the attendant uncertainty or 'error' in the measurement) of such a composite fading satellite signal, it is desired to extract the level of each of the individual fading mechanisms so they can be appropriately mitigated before they impact the overall performance of the communications network. Rather than employing simple-minded deterministic filtering to the real-time fading, the present approach is built around all the models and/or descriptions used to describe the individual fade components, including their dynamic evolution. The latter is usually given by a first-order Langevin equation. This circumstance allows the description of the associated temporal transition probability densities of each of the component processes. By using this description, along with the real-time measurements of the composite fade (along with the measurement errors), one can obtain statistical estimates of the levels of each of the component fading mechanisms as well as their predicted values into the future. This is all accomplished by the use of the well-known Stratonovich integro-differential equation that results from the model of the measured signal fade that is also tailored to adaptively adjust the values of the parameters used in the statistical models of the individual fade mechanisms. Three examples of increasing complexity are addressed and solved for the iterative determination of fade component levels from the measured composite signal fade in the presence of measurement error and, in the last case, with uncertainty in the model parameters.

Countermeasure↗
DOE OSTI2021

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Operation Optimization using Reinforcement Learning with Integrated Artificial Reasoning Framework

In large and complex systems, operational decision-making requires a systematic analysis with a vast amount of data from both process parameters and component status monitoring. In this paper, we present an integrated artificial reasoning approach for system state transition models that can help operational decision-making with explainable and traceable reasoning. The integrated artificial reasoning framework is a physics-based approach of defining the system structure in a Bayesian network, so we leveraged it in a Markov decision process (MDP) for finding optimal operational solutions. In our proposed framework, the MDP is implemented on a dynamic Bayesian network (DBN), which represents causalities in a system. The multilevel flow modeling was utilized in order to extract these causalities in a more efficient and objective manner. Since multilevel flow modeling is based on the fundamental energy and mass conservation laws, the target system is decomposed into several mass, energy, and information structures, which serve as the basis for a DBN. The MDP consists of the processes of finding a solution for the Bellman equation, which can be derived from the conditional probability equations of the constructed DBN. System operators can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from the component degradation process or random failures. We analyzed a simplified example system to illustrate finding an optimal operational policy with this approach.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Dark matter clumps as sources of gravitational-wave glitches in LIGO-Virgo-KAGRA data

We consider the hypothetical possibility that nonstationary glitch features in the noise of ground-based gravitational-wave detectors could be produced by small dark matter clumps that pass through the earth in the vicinity of gravitational-wave detectors. Here, we first derive the gravitational-wave strain that would be generated by the passage of such a dark matter clump. We find that the strain is primarily sourced by the Newtonian gravitational acceleration of the mirrors toward the clump and by the Shapiro time delay of the photons in the laser beams as they pass through the gravitational potential created by the dark matter clump. We also find that the Newtonian acceleration effect dominates the gravitational-wave strain for both ground and space-based interferometers. We then compare our dark matter clump, gravitational-wave strain model to 84 Koi-Fish glitches detected during the second observing run of the LIGO/Virgo/KAGRA Collaboration through a Markov chain Monte Carlo Bayesian analysis. We find that all glitches but nine can be confidently rejected as having originated from dark matter clumps. For the remaining glitches, the dark matter hypothesis cannot be excluded, and the maximum a posteriori parameters yield minimum densities of about 10 −7 g⁡/cm 3 , within the model. These results allow us to place the first direct upper limits with gravitational-wave detectors on the local over-density of dark matter in the form of clumps in the local neighborhood of Earth, namely 𝜌 DM ⁢clumps ≲ 10 −15 g⁡/cm −3 .

Astronomy and AstroPhysics↗