Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Based System Engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Metabolic flux and resource balance in the oleaginous yeast Rhodotorula toruloides

The yeast Rhodotorula toruloides is a promising bioproduction organism due to its high lipid yields and ability to grow on cheap and abundant substrates. Quantitative, systems-level assessment of its metabolic activity is accordingly merited. Resource-balance analysis (RBA) models capture not only reaction stoichiometry but also enzyme requirements for catalysis, providing valuable tools for understanding metabolic trade-offs and optimizing metabolic engineering strategies. Here, in this work, we present systems-level measurements of R. toruloides metabolic flux based on isotope tracing and metabolic flux analysis. In combination with new proteomic measurements, these flux data are used to parameterize a genome-scale resource balance model rtRBA. We find that S. cerevisiae and R. toruloides grow at nearly indistinguishable rates using similar biosynthetic but dramatically different central metabolic programs. R. toruloides consumes one-fifth as much glucose, which it metabolizes primarily via the pentose phosphate pathway and TCA cycle unlike primarily glycolysis in S. cerevisiae . Overall, across these two divergent yeasts, protein abundances aligned more closely than metabolic flux. Resource balance modeling of these metabolic programs predicts superior theoretical yields but lower productivities in R. toruloides than S. cerevisiae for industrial chemicals, highlighting the value of rapid glucose uptake for productivity but respiratory metabolism for yields.

60 APPLIED LIFE SCIENCES↗

End-to-end Analytics for Grid Arch Design & All-hazard Assessment

Resiliency, reliability, and security of the next-generation smart grid depend upon leveraging advanced communication and computing technologies, integrating them with physical power systems, and developing real-time, fast, data-based applications to help in wide-area monitoring and control of the grid. Using a high sampling data rate from phasor measurement units (PMUs) to develop applications has opened the door to achieving the next-generation grid requirements. The North American Synchrophasor Initiative Network (NASPlnet) was developed in 2007-09 to create a standard and guide for PMU data exchanges. With the advancement in both networking and grid requirements, it is necessary to evaluate the performance of different NASPInet versions and their impact on applications. Therefore, we need a cyber-power cosimulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents a cyber-physical co-simulation testbed using NS3 to model the communication network, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application based on PMU data in an Institute of Electrical and Electronics Engineers 39-bus test system is presented using this co-simulation testbed.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A GPU-accelerated Monte Carlo dose calculation platform and its application toward validating an MRI-guided radiation therapy beam model

Purpose: The clinical commissioning of IMRT subject to a magnetic field is challenging. The purpose of this work is to develop a GPU-accelerated Monte Carlo dose calculation platform based on PENELOPE and then use the platform to validate a vendor-provided MRIdian head model toward quality assurance of clinical IMRT treatment plans subject to a 0.35 T magnetic field. Methods: PENELOPE was first translated from FORTRAN to C++ and the result was confirmed to produce equivalent results to the original code. The C++ code was then adapted to CUDA in a workflow optimized for GPU architecture. The original code was expanded to include voxelized transport with Woodcock tracking, faster electron/positron propagation in a magnetic field, and several features that make gPENELOPE highly user-friendly. Moreover, the vendor-provided MRIdian head model was incorporated into the code in an effort to apply gPENELOPE as both an accurate and rapid dose validation system. A set of experimental measurements were performed on the MRIdian system to examine the accuracy of both the head model and gPENELOPE. Ultimately, gPENELOPE was applied toward independent validation of patient doses calculated by MRIdian’s KMC. Results: An acceleration factor of 152 was achieved in comparison to the original single-thread FORTRAN implementation with the original accuracy being preserved. For 16 treatment plans including stomach (4), lung (2), liver (3), adrenal gland (2), pancreas (2), spleen(1), mediastinum (1), and breast (1), the MRIdian dose calculation engine agrees with gPENELOPE with a mean gamma passing rate of 99.1% ± 0.6% (2%/2 mm). Conclusions: A Monte Carlo simulation platform was developed based on a GPU- accelerated version of PENELOPE. This platform was used to validate that both the vendor-provided head model and fast Monte Carlo engine used by the MRIdian system are accurate in modeling radiation transport in a patient using 2%/2 mm gamma criteria. Future applications of this platform will include dose validation and accumulation, IMRT optimization, and dosimetry system modeling for next generation MR-IGRT systems.

60 APPLIED LIFE SCIENCES↗

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An asynchronous traversal engine for graph-based rich metadata management

Rich metadata in high-performance computing (HPC) systems contains extended information about users, jobs, data files, and their relationships. Property graphs are a promising data model to represent heterogeneous rich metadata flexibly. Specifically, a property graph can use vertices to represent different entities and edges to record the relationships between vertices with unique annotations. The high-volume HPC use case, with millions of entities and relationships, naturally requires an out-of-core distributed property graph database, which must support live updates (to ingest production information in real time), low-latency point queries (for frequent metadata operations such as permission checking), and large-scale traversals (for provenance data mining). Among these needs, large-scale property graph traversals are particularly challenging for distributed graph storage systems. Most existing graph systems implement a "level synchronous" breadth-first search algorithm that relies on global synchronization in each traversal step. This performs well in many problem domains; but a rich metadata management system is characterized by imbalanced graphs, long traversal lengths, and concurrent workloads, each of which has the potential to introduce or exacerbate stragglers (i.e., abnormally slow steps or servers in a graph traversal) that lead to low overall throughput for synchronous traversal algorithms. Previous research indicated that the straggler problem can be mitigated by using asynchronous traversal algorithms, and many graph-processing frameworks have successfully demonstrated this approach. Such systems require the graph to be loaded into a separate batch-processing framework instead of being iteratively accessed, however. In this work, we investigate a general asynchronous graph traversal engine that can operate atop a rich metadata graph in its native format. We outline a traversal-aware query language and key optimizations (traversal-affiliate caching and execution merging) necessary for efficient performance. We further explore the effect of different graph partitioning strategies on the traversal performance for both synchronous and asynchronous traversal engines. Our experiments show that the asynchronous graph traversal engine is more efficient than its synchronous counterpart in the case of HPC rich metadata processing, where more servers are involved and larger traversals are needed. Furthermore, the asynchronous traversal engine is more adaptive to different graph partitioning strategies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Surrogate Modeling of Nonlinear Dynamic Systems: A Comparative Study

Surrogate models play a vital role in overcoming the computational challenge in designing and analyzing nonlinear dynamic systems, especially in the presence of uncertainty. This paper presents a comparative study of different surrogate modeling techniques for nonlinear dynamic systems. Four surrogate modeling methods, namely, Gaussian process (GP) regression, a long short-term memory (LSTM) network, a convolutional neural network (CNN) with LSTM (CNN-LSTM), and a CNN with bidirectional LSTM (CNN-BLSTM), are studied and compared. All these model types can predict the future behavior of dynamic systems over long periods based on training data from relatively short periods. The multi-dimensional inputs of surrogate models are organized in a nonlinear autoregressive exogenous model (NARX) scheme to enable recursive prediction over long periods, where current predictions replace inputs from the previous time window. Three numerical examples, including one mathematical example and two nonlinear engineering analysis models, are used to compare the performance of the four surrogate modeling techniques. The results show that the GP-NARX surrogate model tends to have more stable performance than the other three deep learning (DL)-based methods for the three particular examples studied. The tuning effort of GP-NARX is also much lower than its deep learning-based counterparts.

42 ENGINEERING↗

A Strategy for Forced Oscillation Suppression

Wide-area time-synchronized measurements have recently revealed troublesome forced oscillations (FOs) within modern synchronized power grids. In some cases, these FOs represent a dangerous hazard to the system. Recent research has focused on locating the source of FOs to provide operators with knowledge for mitigating their impact locally. This paper presents a complementary mitigation strategy, which is to purposely induce a second oscillation into the grid which cancels the impact of the FO. Such a strategy is complementary in that it may provide valuable time to operators attempting to locate the FOs source and to determine how to rectify it. This paper presents a suppression control strategy which modulates controllable devices to automatically cancel the impact of the FO without the need for locating the source of the original FO. The strategy is based upon tuned feedback control. In this study, the approach is demonstrated on a simulation system via modulation of inverter-based generation.

42 ENGINEERING↗

A causal perspective on reliability assessment

Causality in an engineered system pertains to how a system output changes due to a controlled change or intervention on the system or system environment. Engineered systems designs reflect a causal theory regarding how a system will work, and predicting the reliability of such systems typically requires knowledge of this underlying causal structure. The aim of this work is to introduce causal modeling tools that inform reliability predictions based on biased data sources. We present a novel application of the popular structural causal modeling (SCM) framework to reliability estimation in an engineering application, illustrating how this framework can inform whether reliability is estimable and how to estimate reliability given a set of data and assumptions about the subject matter and data generating mechanism. When data are insufficient for estimation, sensitivity studies based on problem-specific knowledge can inform how much reliability estimates can change due to biases in the data and what information should be collected next to provide the most additional information. We apply the approach to a pedagogical example related to a real, but proprietary, engineering application, considering how two types of biases in data can influence a reliability calculation.

42 ENGINEERING↗

Tuning martensitic transformations via coherent second phases in nanolaminates using free energy landscape engineering

In this work we explore the possibilities and limitations of using a coherent second phase to engineer the thermo-mechanical properties of a martensitic alloy by modifying the underlying free energy landscape that controls the transformation. We use molecular dynamics simulations of a model atomistic system where the properties of a coherent, nanoscale second phase can be varied systematically. With a base martensitic material that undergoes a temperature-induced transformation from a cubic austenite to a monoclinic martensite, simulations show significant ability to engineer the transformation temperatures, from a ~50% reduction to a ~200% increase, with 50 at.% of the cubic second phase. We establish correlations between the properties of the second phase, the transformation characteristics, and the microstructure via the free energy landscape of the twophase systems. Coherency stresses have a strong influence on the martensitic variants observed and can even cause the non-martensitic second phase to undergo a transformation. Reducing the stiffness of the second phase increases the transformation strain and modifies the martensitic microstructure, increasing the volume fraction of the transformed material. This increase in transformation strain is accompanied by a significant increase in Af and thermal hysteresis, while Ms remains unaltered. Our findings on the tunability of martensitic transformations can be used for informed searches of second phases to achieve desired material properties, such as achieving room temperature, lightweight shape memory alloys.

36 MATERIALS SCIENCE↗

Review Article: Stress in thin films and coatings: Current status, challenges, and prospects

The issue of stress in thin films and functional coatings is a persistent problem in materials science and technology that has congregated many efforts, both from experimental and fundamental points of view, to get a better understanding on how to deal with, how to tailor, and how to manage stress in many areas of applications. With the miniaturization of device components, the quest for increasingly complex film architectures and multiphase systems and the continuous demands for enhanced performance, there is a need toward the reliable assessment of stress on a submicron scale from spatially resolved techniques. Also, the stress evolution during film and coating synthesis using physical vapor deposition (PVD), chemical vapor deposition, plasma enhanced chemical vapor deposition (PECVD), and related processes is the result of many interrelated factors and competing stress sources so that the task to provide a unified picture and a comprehensive model from the vast amount of stress data remains very challenging. This article summarizes the recent advances, challenges, and prospects of both fundamental and applied aspects of stress in thin films and engineering coatings and systems, based on recent achievements presented during the 2016 Stress Workshop entitled “Stress Evolution in Thin Films and Coatings: from Fundamental Understanding to Control.” Evaluation methods, implying wafer curvature, x-ray diffraction, or focused ion beam removal techniques, are reviewed. Selected examples of stress evolution in elemental and alloyed systems, graded layers, and multilayer-stacks as well as amorphous films deposited using a variety of PVD and PECVD techniques are highlighted. Based on mechanisms uncovered by in situ and real-time diagnostics, a kinetic model is outlined that is capable of reproducing the dependence of intrinsic (growth) stress on the grain size, growth rate, and deposited energy. The problems and solutions related to stress in the context of optical coatings, inorganic coatings on plastic substrates, and tribological coatings for aerospace applications are critically examined. This review also suggests strategies to mitigate excessive stress levels from novel coating synthesis perspectives to microstructural design approaches, including the ability to empower crack-based fabrication processes, pathways leading to stress relaxation and compensation, as well as management of the film and coating growth conditions with respect to energetic ion bombardment. Future opportunities and challenges for stress engineering and stress modeling are considered and outlined.

36 MATERIALS SCIENCE↗

System-level perturbations of cell metabolism using CRISPR/Cas9

CRISPR/Cas9 (clustered regularly interspaced palindromic repeats and the associated protein Cas9) techniques have made genome engineering and transcriptional reprogramming studies much more advanced and cost-effective. For metabolic engineering purposes, the CRISPR-based tools have been applied to single and multiplex pathway modifications and transcriptional regulations. The effectiveness of these tools allows researchers to implement genome-wide perturbations, test model-guided genome editing strategies, and perform transcriptional reprogramming perturbations in a more advanced manner than previously possible. In this mini-review we highlight recent studies adopting CRISPR/Cas9 for systems-level perturbations and model-guided metabolic engineering.

60 APPLIED LIFE SCIENCES↗

Accuracy of HVAC Load Predictions: Validation of EnergyPlus and DOE-2 using FLEXLAB Measurements

The aim of the project reported here was to better understand the level of accuracy of three building energy simulation (BES) engines (‘engines’) — EnergyPlus™, DOE-2.1e, and DOE-2.2 — by identifying and investigating significant deviations between the performance predicted by these engines and actual performance as measured in the FLEXLAB® test facility at Lawrence Berkeley National Laboratory (LBNL). The specific test conditions included some of those prescribed in ANSI/ASHRAE Standard 140 - Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs. Detailed measurements of FLEXLAB performance, including indoor temperatures and heat fluxes and air-flow and water flow rates and temperatures in the Heating, Ventilating and Air Conditioning (HVAC) system, together with hourly weather data, were recorded and used in analyzing the simulation results from EnergyPlus v8.8, DOE-2.2 v3.65 and DOE-2.1e v127. These engines are commonly used in the United States for building energy code compliance, federal, state, and utility incentives programs, as well as energy efficient design of new buildings and energy retrofit of existing buildings. Seven conventional overhead mixing ventilation scenarios were tested and each engine was found to have a similar level of agreement with the measurements of space-level heating and sensible cooling loads. These results provide useful information regarding the accuracy of these engines in predicting the cooling and heating load elements of whole building energy performance. This information is intended for practitioners who are concerned about transitioning between simulation tools with different engines and for managers of utility programs leveraging these tools for evaluating and/or projecting measure savings to be incentivized under their programs. The results of the comparisons of simulated and measured performance indicate that the predictions from all three engines are not significantly different. The 24-hour average value of the absolute mean bias indicates the likely magnitude of the error in any particular case. The average mean bias is reduced by cancelation of overprediction in one case by underprediction in another. The daytime absolute mean biases, which may be more important for both energy performance and occupant comfort, are ~6%, presumably because of the greater complexity involved in simulating in the presence of solar radiation. EnergyPlus typically overpredicts the cooling load and/or underpredicts the heating load by ~1.5% and the DOE-2 engines typically underpredict the cooling load by approximately the same amount. The Root Mean Square Error is relatively more sensitive to shorter term variations in the difference between predicted and measured loads; the three engines have similar values, ~10%, suggesting that the uncertainties in their predictions of peak loads may also be similar in magnitude. The implication of these results is that users, both designers and program analysts, can use EnergyPlus, DOE-2.1e, or DOE-2.2 to model conventional commercial buildings equipped with overhead mixing ventilation with a similar level of confidence. Further work is required to better understand the variability in the level of agreement between the engine predictions and FLEXLAB measurements, where a particular engine will agree well with FLEXLAB in some cases and not so well in others and another engine will agree or disagree in different cases. As the sources of this variability are identified and eliminated or reduced significantly, it is recommended that the experimental capabilities and methods developed in the study reported here should be applied to validating heating and cooling load calculations for spaces with different types of furniture and miscellaneous loads. These methods should then be applied to low energy space conditioning systems in EnergyPlus including, in particular, radiant slab and radiant ceiling panel cooling and heating systems and ‘mixed mode’ systems that combine mechanical cooling and natural ventilation systems, focusing on controls, including control of thermal mass. The work reported here addresses the conventional method of heating and cooling occupied spaces; other methods, such as the use of radiant heating and cooling systems have the potential to provide equivalent occupant comfort, or better, with lower energy consumption. These systems are addressed more explicitly in EnergyPlus but there is a need for empirical validation to give users the same level of confidence in modeling these systems that they have, or should have, in modeling conventional systems, based on the results presented here.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Predictive modeling and reducing cyclic variability in autoignition engines

Methods and systems are provided for controlling a vehicle engine to reduce cycle-to-cycle combustion variation. A predictive model is applied to predict cycle-to-cycle combustion behavior of an engine based on observed engine performance variables. Conditions are identified, based on the predicted cycle-to-cycle combustion behavior, that indicate high cycle-to-cycle combustion variation. Corrective measures are then applied to prevent the predicted high cycle-to-cycle combustion variation.

33 ADVANCED PROPULSION SYSTEMS↗

An Improved CRISPR Interference Tool to Engineer Rhodococcus opacus

Rhodococcus opacus is a non-model bacterium that is well suited for valorizing lignin. Despite recent advances in our systems-level understanding of its versatile metabolism, studies of its gene functions at a single gene level are still lagging. Elucidating gene functions in non-model organisms is challenging due to limited genetic engineering tools that are convenient to use. To address this issue, we developed a simple gene repression system based on CRISPR interference (CRISPRi). This gene repression system uses a T 7 RNA polymerase system to express a small guide RNA, demonstrating improved repression compared to the previously demonstrated CRISPRi system (i.e., the maximum repression efficiency improved from 58% to 85%). Additionally, our cloning strategy allows for building multiple CRISPRi plasmids in parallel without any PCR step, facilitating the engineering of this GC-rich organism. Using the improved CRISPRi system, we confirmed the annotated roles of four metabolic pathway genes, which had been identified by our previous transcriptomic analysis to be related to the consumption of benzoate, vanillate, catechol, and acetate. Furthermore, we showed our tool’s utility by demonstrating the inducible accumulation of muconate that is a precursor of adipic acid, an important monomer for nylon production. While the maximum muconate yield obtained using our tool was 30% of the yield obtained using gene knockout, our tool showed its inducibility and partial repressibility. In conclusion, our CRISPRi tool will be useful to facilitate functional studies of this non-model organism and engineer this promising microbial chassis for lignin valorization.

09 BIOMASS FUELS↗

SU-E-T-355: Efficient Scatter Correction for Direct Ray-Tracing Based Dose Calculation

Purpose: To propose a scatter correction method with linear computational complexity for direct-ray-tracing (DRT) based dose calculation. Due to its speed and simplicity, DRT is widely used as a dose engine in the treatment planning system (TPS) and monitor unit (MU) verification software, where heterogeneity correction is applied by radiological distance scaling. However, such correction only accounts for attenuation but not scatter difference, causing the DRT algorithm less accurate than the model-based algorithms for small field size in heterogeneous media. Methods: Inspired by the convolution formula derived from an exponential kernel as is typically done in the collapsed-cone-convolution-superposition (CCCS) method, we redesigned the ray tracing component as the sum of TERMA scaled by a local deposition factor, which is linear with respect to density, and dose of the previous voxel scaled by a remote deposition factor, D(i)=aρ(i)T(i)+(b+c(ρ(i)-1))D(i-1),where T(i)=e(-αr(i)+β(r(i))2) and r(i)=Σ-(j=1,..,i)ρ(j).The two factors together with TERMA can be expressed in terms of 5 parameters, which are subsequently optimized by curve fitting using digital phantoms for each field size and each beam energy. Results: The proposed algorithm was implemented for the Fluence-Convolution-Broad-Beam (FCBB) dose engine and evaluated using digital slab phantoms and clinical CT data. Compared with the gold standard calculation, dose deviations were improved from 20% to 2% in the low density regions of the slab phantoms for the 1-cm field size, and within 2% for over 95% of the volume with the largest discrepancy at the interface for the clinical lung case. Conclusion: We developed a simple recursive formula for scatter correction for the DRT-based dose calculation with much improved accuracy, especially for small field size, while still keeping calculation to linear complexity. The proposed calculator is fast, yet accurate, which is crucial for dose updating in IMRT optimization.

60 APPLIED LIFE SCIENCES↗

Quantized Electronic Doping towards Atomically Controlled “Charge-Engineered” Semiconductor Nanocrystals

“Charge engineering” of semiconductor nanocrystals (NCs) through so-called electronic impurity doping is a long-standing challenge in colloidal chemistry and holds promise for ground-breaking advancements in many optoelectronic, photonic, and spin-based nanotechnologies. To date, our knowledge is limited to a few paradigmatic studies on a small number of model compounds and doping conditions, with important electronic dopants still unexplored in nanoscale systems. Equally importantly, fine-tuning of charge engineered NCs is hampered by the statistical limitations of traditional approaches. The resulting intrinsic doping inhomogeneity restricts fundamental studies to statistically averaged behaviors and complicates the realization of advanced device concepts based on their advantageous functionalities. We aim to address these issues by realizing the first example of II–VI NCs electronically doped with an exact number of heterovalent gold atoms, a known p-type acceptor impurity in bulk chalcogenides. Single-dopant accuracy across entire NC ensembles is obtained through a novel non-injection synthesis employing ligand-exchanged gold clusters as “quantized” dopant sources to seed the nucleation of CdSe NCs in organic media. Structural, spectroscopic, and magneto-optical investigations trace a comprehensive picture of the physical processes resulting from the exact doping level of the NCs. Gold atoms, doped here for the first time into II–VI NCs, are found to incorporate as nonmagnetic Au + species activating intense size-tunable intragap photoluminescence and artificially offsetting the hole occupancy of valence band states. Fundamentally, the transient conversion of Au + to paramagnetic Au 2+ (5d 9 configuration) under optical excitation results in strong photoinduced magnetism and diluted magnetic semiconductor behavior revealing the contribution of individual paramagnetic impurities to the macroscopic magnetism of the NCs. Altogether, our results demonstrate a new chemical approach toward NCs with physical functionalities tailored to the single impurity level and offer a versatile platform for future investigations and device exploitation of individual and collective impurity processes in quantum confined structures.

36 MATERIALS SCIENCE↗

MOFA: Multi-objective Flux Analysis for the COBRA Toolbox

Environments of biological organisms are frequently nutrient and energy limited. This necessitates that systems exert tight regulation of trade-offs among key biological processes. Quantitative knowledge of these tradeoffs is essential for successful manipulation of biosystems (e.g., metabolic engineering projects). Using genome-scale constraint-based models of metabolism (GSMs), Multi-Objective Flux Analysis (MOFA) allows analyses of trade-offs among a system’s key biological tasks. The leading software for conducting a variety of constraint-based analyses using GSMs is the COBRA Toolbox for MATLAB. Results: We have developed a new add-on tool for COBRA that performs MOFA for a number of objectives only limited by computation power.

59 BASIC BIOLOGICAL SCIENCES↗

Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states

Maintenance policy optimization usually is faced with challenges that arise from an imperfect knowledge of system degradation models and from the partial observability of system degradation states. Here, this paper proposes a reinforcement learning method to address these two challenges for a class of maintenance problems with Markov degradation processes. The reinforcement learning approach consists of a learning component and a planning component. Using sequentially collected observations, at each step of decision-making the learning component improves the knowledge of system degradation in terms of the probability distributions of the transition rates based on sequential Bayesian inference. Using the updated transition rates, at each step of decision-making the maintenance policy optimization problem is then formulated as a partially observable Markov decision problem, and the planning component computes the optimal maintenance policy that maximizes the expected cumulative reward. The proposed method is illustrated using a numerical example with repair and inspection maintenance actions. The result shows that as more observations are collected, the learning component progressively learns the true system degradation process, and the planning component adjusts the optimal maintenance policy accordingly as well, which leads to increased reward.

42 ENGINEERING↗