Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Markov models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Which Combinations of Environmental Conditions and Microphysical Parameter Values Produce a Given Orographic Precipitation Distribution?

This study applies an idealized modeling framework, alongside a Bayesian Markov chain Monte Carlo (MCMC) algorithm, to explore which combinations of upstream environmental conditions and cloud microphysical parameter values can produce a particular precipitation distribution over an idealized two-dimensional, bell-shaped mountain. Simulations focus on orographic precipitation produced when an atmospheric river interacts with topography. MCMC-based analysis reveals that different combinations of parameter values produce a similar precipitation distribution, with the most influential parameters being relative humidity (RH), horizontal wind speed (U), surface potential temperature (θ sfc ), and the snow fall speed coefficient (A s ). RH, U, and A s exhibit interdependence: changes in one or more of these factors can be mitigated by compensating changes in the other(s) to produce similar orographic precipitation rates. The results also indicate that the parameter sensitivities and relationships can vary for spatial subregions and given different environmental conditions. In particular, high θ sfc values are more likely to produce the target precipitation rate and spatial distribution, and thus the ensemble of simulations shows a preference for liquid precipitation at the surface. The results presented here highlight the complexity of orographic precipitation controls, and have implications for flood and water management, observational efforts, and climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Far-field thermal imaging below diffraction limit

Non-uniform self-heating and temperature hotspots are major concerns compromising the performance and reliability of submicron electronic and optoelectronic devices. At deep submicron scales where effects such as contact-related artifacts and diffraction limits accurate measurements of temperature hotspots, non-contact thermal characterization can be extremely valuable. In this work, we use a Bayesian optimization framework with generalized Gaussian Markov random field (GGMRF) prior model to obtain accurate full-field temperature distribution of self-heated metal interconnects from their thermoreflectance thermal images (TRI) with spatial resolution 2.5 times below Rayleigh limit for 530nm illumination. Finite element simulations along with TRI experimental data were used to characterize the point spread function of the optical imaging system. In addition, unlike iterative reconstruction algorithms that use ad hoc regularization parameters in their prior models to obtain the best quality image, we used numerical experiments and finite element modeling to estimate the regularization parameter for solving a real experimental inverse problem.

42 ENGINEERING↗
DOE OSTI2020

Evaluation of residue management practices on barley residue decomposition

Optimizing barley (hordeum vulgare L.) production in Idaho and other parts of the Pacific Northwest (PNW) should focus on farm resource management. The effect of post-harvest residue management on barley residue decomposition has not been adequately studied. Thus, the objective of this study was to determine the effect of residue placement (surface vs. incorporated), residue size (chopped vs. ground-sieved) and soil type (sand and sandy loam) on barley residue decomposition. A 50-day(d) laboratory incubation experiment was conducted at a temperature of 25°C at the Aberdeen Research and Extension Center, Aberdeen, Idaho, USA. Following the study, a Markov-Chain Monte Carlo (MCMC) modeling approach was applied to investigate the first-order decay kinetics of barley residue. An accelerated initial flush of residue carbon(C)-mineralization was measured for the sieved (Day 1) compared to chopped (Day 3 to 5) residues for both surface incorporated applications. The highest evolution of carbon dioxide (CO 2 )-C of 8.3 g kg -1 dry residue was observed on Day 1 from the incorporated-sieved application for both soils. The highest and lowest amount of cumulative CO 2 -C released and percentage residue decomposed over 50-d was observed for surface-chopped (107 g kg -1 dry residue and 27%, respectively) and incorporated-sieved (69 g kg -1 dry residue and 18%, respectively) residues, respectively. There were no significant differences in C-mineralization from barley residue based on soil type or its interactions with residue placement and size (p >0.05). The largest decay constant k of 0.0083 d -1 was calculated for surface-chopped residue where the predicted half-life was 80 d, which did not differ from surface sieved or incorporated chopped. In contrast, incorporated-sieved treatments only resulted in a k of 0.0054 d -1 and would need an additional 48 d to decompose 50% of the residue. Future residue decomposition studies under field conditions are warranted to verify the residue C-mineralization and its impact on residue management.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Trivializing Flow in 2D-O(3) model

The two dimensional O(3) sigma model, just as quantum chromodynamics, is an asymptotically free theory with a mass gap. Therefore, it is an interesting and simple toy model to investigate algorithms for Markov Chain Monte Carlo simulations of quantum chromodynamics. In this talk, we discuss the construction of a trivializing map, a field transformation from a given theory to a trivial one, through a suitably chosen gradient flow. An analytic solution for the generating functional of this trivializing flow has been obtained by a perturbative expansion in the flow time. Utilizing this solution allows for new approaches to be considered when proposing updates for a Markov Chain Monte Carlo algorithm.

Chamness, Christopher↗
NASA NTRS1984

Optimal maintenance center inventories for fault-tolerant repairable systems

A probabilistic approach is taken to determine the optimal repairable parts inventory for a maintenance center, servicing machines which contain several m-out-of-n systems of different parts, with a constraint on the total inventory investment. A model, based on the discrete Markov process, accounts for a typical ultrareliable avionics system, such as one presently being developed by NASA. The dynamic programming algorithm for minimizing the stockout and holding costs is applied to an exemplary maintenance center, and solutions for single-item and multi-item cases are given. The computational burden is noted to be reasonable and a computer program is used to generate optimal solutions.

Lawrence, S. H.↗
NASA NTRS1995

Stochastic charging of dust grains in planetary rings: Diffusion rates and their effects on Lorentz resonances

Dust grains in planetary rings acquire stochastically fluctuating electric charges as they orbit through any corotating magnetospheric plasma. Here we investigate the nature of this stochastic charging and calculate its effect on the Lorentz resonance (LR). First we model grain charging as a Markov process, where the transition probabilities are identified as the ensemble-averaged charging fluxes due to plasma pickup and photoemission. We determine the distribution function P(t;N), giving the probability that a grain has N excess charges at time t. The autocorrelation function tau(sub q) for the strochastic charge process can be approximated by a Fokker-Planck treatment of the evolution equations for P(t; N). We calculate the mean square response to the stochastic fluctuations in the Lorentz force. We find that transport in phase space is very small compared to the resonant increase in amplitudes due to the mean charge, over the timescale that the oscillator is resonantly pumped up. Therefore the stochastic charge variations cannot break the resonant interaction; locally, the Lorentz resonance is a robust mechanism for the shaping of etheral dust ring systems. Slightly stronger bounds on plasma parameters are required when we consider the longer transit times between Lorentz resonances.

Schaffer, L.↗
NASA NTRS1995

MMPP Traffic Generator for the Testing of the SCAR 2 Fast Packet Switch

A prototype MWP Traffic Generator (TG) has been designed for testing of the COMSAT-supplied SCAR II Fast Packet Switch. By generating packets distributed according to a Markov-Modulated Poisson Process (MMPP) model. it allows the assessment of the switch performance under traffic conditions that are more realistic than could be generated using the COMSAT-supplied Traffic Generator Module. The MMPP model is widely believed to model accurately real-world superimposed voice and data communications traffic. The TG was designed to be as much as possible of a "drop-in" replacement for the COMSAT Traffic Generator Module. The latter fit on two Altera EPM7256EGC 192-pin CPLDs and produced traffic for one switch input port. No board changes are necessary because it has been partitioned to use the existing board traces. The TG, consisting of parts "TGDATPROC" and "TGRAMCTL" must merely be reprogrammed into the Altera devices of the same name. However, the 040 controller software must be modified to provide TG initialization data. This data will be given in Section II.

Chren, William A., Jr.↗
NASA NTRS2011

Use of Inverse Reinforcement Learning for Identity Prediction

We adopt Markov Decision Processes (MDP) to model sequential decision problems, which have the characteristic that the current decision made by a human decision maker has an uncertain impact on future opportunity. We hypothesize that the individuality of decision makers can be modeled as differences in the reward function under a common MDP model. A machine learning technique, Inverse Reinforcement Learning (IRL), was used to learn an individual's reward function based on limited observation of his or her decision choices. This work serves as an initial investigation for using IRL to analyze decision making, conducted through a human experiment in a cyber shopping environment. Specifically, the ability to determine the demographic identity of users is conducted through prediction analysis and supervised learning. The results show that IRL can be used to correctly identify participants, at a rate of 68% for gender and 66% for one of three college major categories.

Hayes, Roy↗
NASA NTRS2012

The Photochemical Reflectance Index from Directional Cornfield Reflectances: Observations and Simulations

The two-layer Markov chain Analytical Canopy Reflectance Model (ACRM) was linked with in situ hyperspectral leaf optical properties to simulate the Photochemical Reflectance Index (PRI) for a corn crop canopy at three different growth stages. This is an extended study after a successful demonstration of PRI simulations for a cornfield previously conducted at an early vegetative growth stage. Consistent with previous in situ studies, sunlit leaves exhibited lower PRI values than shaded leaves. Since sunlit (shaded) foliage dominates the canopy in the reflectance hotspot (coldspot), the canopy PRI derived from field hyperspectral observations displayed sensitivity to both view zenith angle and relative azimuth angle at all growth stages. Consequently, sunlit and shaded canopy sectors were most differentiated when viewed along the azimuth matching the solar principal plane. These directional PRI responses associated with sunlit/shaded foliage were successfully reproduced by the ACRM. As before, the simulated PRI values from the current study were closer to in situ values when both sunlit and shaded leaves were utilized as model input data in a two-layer mode, instead of a one-layer mode with sunlit leaves only. Model performance as judged by correlation between in situ and simulated values was strongest for the mature corn crop (r = 0.87, RMSE = 0.0048), followed by the early vegetative stage (r = 0.78; RMSE = 0.0051) and the early senescent stage (r = 0.65; RMSE = 0.0104). Since the benefit of including shaded leaves in the scheme varied across different growth stages, a further analysis was conducted to investigate how variable fractions of sunlit/shaded leaves affect the canopy PRI values expected for a cornfield, with implications for 20 remote sensing monitoring options. Simulations of the sunlit to shaded canopy ratio near 50/50 +/- 10 (e.g., 60/40) matching field observations at all growth stages were examined. Our results suggest in the importance of the sunlit/shaded fraction and canopy structure in understanding and interpreting PRI.

Cheng, Yen-Ben↗
NASA NTRS2016

Deep Space Optical Link ARQ Performance Analysis

Substantial advancements have been made toward the use of optical communications for deep space exploration missions, promising a much higher volume of data to be communicated in comparison with present -day Radio Frequency (RF) based systems. One or more ground-based optical terminals are assumed to communicate with the spacecraft. Both short-term and long-term link outages will arise due to weather at the ground station(s), space platform pointing stability, and other effects. To mitigate these outages, an Automatic Repeat Query (ARQ) retransmission method is assumed, together with a reliable back channel for acknowledgement traffic. Specifically, the Licklider Transmission Protocol (LTP) is used, which is a component of the Disruption-Tolerant Networking (DTN) protocol suite that is well suited for high bandwidth-delay product links subject to disruptions. We provide an analysis of envisioned deep space mission scenarios and quantify buffering, latency and throughput performance, using a simulation in which long-term weather effects are modeled with a Gilbert -Elliot Markov chain, short-term outages occur as a Bernoulli process, and scheduled outages arising from geometric visibility or operational constraints are represented. We find that both short- and long-term effects impact throughput, but long-term weather effects dominate buffer sizing and overflow losses as well as latency performance.

optical space communications↗
NASA NTRSDate not supplied

Energy-Optimized Path Planning for Uas in Varying Winds Via Reinforcement Learning

In this paper we propose a reinforcement learning (RL) algorithm for path planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to UAV path planning problems are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs need to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health, and off-nominal battery power consumption. Machine learning methods such as reinforcement learning (RL) have the potential to revolutionize how vehicles navigate in such uncertain environments. In this study, we compute UAV trajectories from a pre-determined starting position to a target cell within a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption and operation time. The UAV navigates the grid by taking actions to move in any of the eight cardinal and inter-cardinal directions, under constant thrust profile. The resultant UAV state is sampled from a probability distribution which accounts for the UAV’s action, local wind velocity, and the presence of obstacles or boundaries. As the unmanned airspace gets more complex due to multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance need to be made. Our Markov Decision Process (MDP) environment model can capture any combination of these in the optimization objective, making it novel compared to other work in the field.

trajectory planning↗
NASA NTRS1993

Semi-Markov Unreliability Range Evaluator

Semi-Markov Unreliability Range Evaluator, SURE, computer program is software tool for analysis of reconfigurable, fault-tolerant systems. Traditional reliability analyses based on aggregates of fault-handling and fault-occurrence models. SURE provides efficient means for calculating accurate upper and lower bounds for probabilities of death states for large class of semi-Markov mathematical models, and not merely those reduced to critical-pair architectures.

Butler, Ricky W.↗
NASA NTRS1980

Wheat forecast economics effect study

A model to assess the value of improved information regarding the inventories, productions, exports, and imports of crop on a worldwide basis is discussed. A previously proposed model is interpreted in a stochastic control setting and the underlying assumptions of the model are revealed. In solving the stochastic optimization problem, the Markov programming approach is much more powerful and exact as compared to the dynamic programming-simulation approach of the original model. The convergence of a dual variable Markov programming algorithm is shown to be fast and efficient. A computer program for the general model of multicountry-multiperiod is developed. As an example, the case of one country-two periods is treated and the results are presented in detail. A comparison with the original model results reveals certain interesting aspects of the algorithms and the dependence of the value of information on the incremental cost function.

Mehra, R. K.↗
DOE OSTI2021

Development of CTF modeling of interfacial drag, wall shear, and interfacial heat transfer for bubbly and annular-mist flow regimes

This milestone report discusses improvements to CTF closure models for modeling of bubbly and annular mist two-phase flow conditions, which are important for accurate modeling and simulation for boiling water reactor (BWR) conditions. Models that were improved include the two-phase wall shear, wall boiling, and phase mass and heat transfer. A new flow regime map was implemented to improve on the prediction of transition to annular flow, which was generally largely over-predicted by the legacy CTF flow regime map. The annular mist interfacial drag models were also reviewed and new models were proposed for implementation into the code. In addition to implementing new models, an activity was performed to calibrate these new models to experimental data using a Markov Chain Monte Carlo technique, thus further improving their accuracy. Finally, new experiments were implemented into the CTF validation matrix which add more two-phase pressure drop and void measurements for the assessment of CTF for modeling of BWRs. The results show that the Chisholm model, which was implemented and then calibrated, results in significantly improved comparison against the Riso two-phase pressure drop data. Furthermore, improvements in the implicit heat transfer and wall boiling models resulted in good agreement with the void measurement data.

42 ENGINEERING↗
DOE OSTI2022

Behavioral and Population Data-Driven Distribution System Load Modeling

Distribution system residential load modeling and analysis for different geographic areas within a utility or an independent system operator territory are critical for enabling small-scale, aggregated distributed energy resources to participate in grid services under Federal Energy Regulatory Commission Order No. 2222 [1]. In this study, we develop a methodology of modeling residential load profiles in different geographic areas with a focus on human behavior impact. First, we construct a behavior-based load profile model leveraging state-of-the-art appliance models. We simulate human activity and occupancy using Markov chain Monte Carlo methods calibrated with the American Time Use Survey data set. Second, we link our model with cleaned Current Population Survey data from the U.S. Census Bureau. Finally, we populate two sets of 500 households using California and Texas census data, respectively, to perform an initial analysis of the load in different geographic areas with various group features (e.g., different income levels). To distinguish the effect of population behavior differences on aggregated load, we simulate load profiles for both sets assuming fixed physical household parameters and weather data. Analysis shows that average daily load profiles vary significantly by income and income dependency varies by locality.

American Time Use Survey↗
NASA NTRSDate not supplied

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗