Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Based Systems Engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Development and Demonstration of a Fuel-Efficient, Class 8 Tractor & Trailer Engine System (SuperTruck II)

Navistar presents the SuperTruck II (ST II) Final Report to the Unites States Department of Energy (US DOE), which covers the five Budget Periods (BPs) from 10-1-2016 through 6-30-2022. For ST II, Navistar built on the achievements of the SuperTruck I (ST I) Program as a catalyst to continue critical research, design and development, testing, and operations to reach the ambitious goals of the ST II project. This approach allowed Navistar to continue contributing to the essential needs of our nation for safe, efficient, and cost-effective delivery of goods and services, as we reduced negative environmental effects and improved operational productivity. This document contains information specified in DOE F 4600.2, Final Scientific/Technical Report DOE F 241.3, B. SCIENTIFIC/TECHNICAL REPORTS, explaining how we met and exceeded program requirements. Throughout this Final Report, Navistar extracted information from documents prepared during the project that represent our management, design and development, building, and testing efforts to meet and exceed SuperTruck II project goals. Navistar followed Plan requirements to achieve / exceed Project Objectives: a) >100% improvement in vehicle freight efficiency (FE) (on ton-MPG basis) relative to 2009 baseline with stretch goal of 140% improvement [actual: 170%); b) >55% engine brake thermal efficiency (BTE) demonstrated in operational engine at a 65-mph cruise point on a dynamometer – ≥31% increase from 2009 baseline [actual: 55.20% of combined BTE) ; and c) development and implementation of commercially cost effective technologies (in terms of a simple payback). Technology selection / development path focused on developing technologies applicable for production within 3-year approach, while ensuring technology readiness and cost of ownership for end users. The Program was organized into five budget periods: Requirements / Technology Assessment and Initial Hardware Testing; Technology Development and Concept Readiness Demonstration; Technology Finalization and Validation Tractor / Trailer Fabrication, Integration and Commissioning Demonstration; and Fuel Economy (FE) and Brake Thermal Efficiency (BTE) and Program Completion. Leadership was provided by DOE, with tasks performed by laboratories (Argonne National Laboratory, Lawrence Livermore National Laboratory); partners at Bosch, TPI, Dana, and J.B. Hunt; , and support from University of Michigan and Clemson University. Navistar lead this team with Principal Investigator / Contracting Officer; Project Manager (PM); Vehicle, Engine, and Aftertreatment Engineers; Finance Manager, Technical Program Leads, and Legal/IP; and other key personnel. Work also included personnel in risk management; funding / budget / finance. Work involved analysis, development, testing, and down selection of individual/system engine, aftertreatment, and vehicle technologies, with integration of selected technologies into a prototype vehicle for demonstration of fuel-efficiency gain. Work also included component/integrated system level development of truck and trailer aerodynamics, base engine efficiency, advanced aftertreatment, combustion efficiency, waste heat recovery, hybrid powertrain, reduced rolling resistance, weight reduction, idle reduction, and driver feedback. As ST II progressed, Navistar performed computer-based modeling / simulations of technologies focused on the primary operational areas: Engine, Aftertreatment, and Vehicle. During the ST II Program, the COVID Virus outbreak unexpectedly challenged by the effects of, which affected staffing, scheduling, design, supplies, availability of materials, production procedures, and testing. The DOE responded by extending the program by three quarters to ensure that project tasks were completed for this vital project. Focus continued on analyzing, developing, testing, and down selecting individual-/system-level engine and vehicle technologies for integration of the final selected technologies into a prototype vehicle that would demonstrate fuel-efficiency gains made possible through these technologies. This included component/integrated system-level development of truck and trailer aerodynamics, base engine efficiency, advanced aftertreatment, combustion efficiency, waste heat recovery, solar power, distributed and intelligent vehicle power, hybrid powertrain, reduced rolling resistance, weight reduction, idle reduction, and driver feedback. Throughout the program, function, reliability, and performance at all levels were ensured through testing. Proof of this approach was demonstrated in multiple, on-road demonstrations: Scenario A (Flatland) Fuel Economy, Scenario B (Hilly) Fuel Economy, and City Cycle Tests. Other benefits derived from ST II included new/improved products, publications, patents, and next-step capabilities related to electric/hydrogen vehicles and autonomous driving.

Zukouski, Russ↗
DOE OSTI2024

A Phenomenological Thermal Spray Wall Interaction Modeling Framework Applied to a High Temperature Ignition Assistant Device

Airborne compression ignition engines must operate with reliable ignition systems to achieve proper ignition at every cycle, particularly at high altitudes. Glow-plug-based ignition-assistant (IA) devices can provide the necessary energy to preheat the fuel and ensure ignitability of the fuel-air mixture. Ignitability of liquid sprays can be facilitated via direct impingement onto the hot IA surface, however this comes with adverse effects on the IA durability. Therefore, optimizing an IA’s design requires detailed understanding of the physics of fuel spray impingement of superheated surfaces. While spray impingement on relatively low wall temperatures has been extensively studied and appropriate numerical models have been proposed through the years, fundamental understanding of high-speed liquid spray impingement on superheated walls is still elusive. This work aims to formulate a phenomenological thermal spray-wall interaction framework for modeling the film-boiling-induced heat transfer, atomization, and dispersion of fuel spray droplets impinging onto a superheated IA device. A qualitative comparison of the new phenomenological model is performed against optical experiments from the literature of an F-24 fuel spray injected onto an IA device located 12 mm away from the injector tip. The temperature of the IA was set at 1400 K. The fuel injection pressure was 400 bar, while the ambient gas pressure and temperature were 30 bar and 800 K, respectively. The performance of the phenomenological model is evaluated in comparison with two other state-of-art models from the literature. A qualitative analysis of the different spray and fuel-air mixture characteristics is performed to outline the differences in the predictions offered by the new phenomenological model and the two state-of-art spray-wall interaction models.

droplet dispersion↗
NASA NTRS2006

Technologies for Aircraft Noise Reduction

Technologies for aircraft noise reduction have been developed by NASA over the past 15 years through the Advanced Subsonic Technology (AST) Noise Reduction Program and the Quiet Aircraft Technology (QAT) project. This presentation summarizes highlights from these programs and anticipated noise reduction benefits for communities surrounding airports. Historical progress in noise reduction and technologies available for future aircraft/engine development are identified. Technologies address aircraft/engine components including fans, exhaust nozzles, landing gear, and flap systems. New "chevron" nozzles have been developed and implemented on several aircraft in production today that provide significant jet noise reduction. New engines using Ultra-High Bypass (UHB) ratios are projected to provide about 10 EPNdB (Effective Perceived Noise Level in decibels) engine noise reduction relative to the average fleet that was flying in 1997. Audio files are embedded in the presentation that estimate the sound levels for a 35,000 pound thrust engine for takeoff and approach power conditions. The predictions are based on actual model scale data that was obtained by NASA. Finally, conceptual pictures are shown that look toward future aircraft/propulsion systems that might be used to obtain further noise reduction.

Huff, Dennis L.↗
DOE OSTI2021

Pyomo.GDP: an ecosystem for logic based modeling and optimization development

We present three core principles for engineering-oriented integrated modeling and optimization tool sets—intuitive modeling contexts, systematic computer-aided reformulations, and flexible solution strategies—and describe how new developments in Pyomo.GDP for Generalized Disjunctive Programming (GDP) advance this vision. We describe a new logical expression system implementation for Pyomo.GDP allowing for a more intuitive description of logical propositions. The logical expression system supports automated reformulation of these logical constraints to linear constraints. We also describe two new logic-based global optimization solver implementations built on Pyomo.GDP that exploit logical structure to avoid “zero-flow” numerical difficulties that arise in nonlinear network design problems when nodes or streams disappear. These new solvers also demonstrate the capability to link to external libraries for expanded functionality within an integrated implementation. We present these new solvers in the context of a flexible array of solution paths available to GDP models. Finally, we present results on a new library of GDP models demonstrating the value of multiple solution approaches.

42 ENGINEERING↗
NASA NTRS2016

Development of a Subcell Based Modeling Approach for Modeling the Architecturally Dependent Impact Response of Triaxially Braided Polymer Matrix Composites

Understanding the high velocity impact response of polymer matrix composites with complex architectures is critical to many aerospace applications, including engine fan blade containment systems where the structure must be able to completely contain fan blades in the event of a blade-out. Despite the benefits offered by these materials, the complex nature of textile composites presents a significant challenge for the prediction of deformation and damage under both quasi-static and impact loading conditions. The relatively large mesoscale repeating unit cell (in comparison to the size of structural components) causes the material to behave like a structure rather than a homogeneous material. Impact experiments conducted at NASA Glenn Research Center have shown the damage patterns to be a function of the underlying material architecture. Traditional computational techniques that involve modeling these materials using smeared homogeneous, orthotropic material properties at the macroscale result in simulated damage patterns that are a function of the structural geometry, but not the material architecture. In order to preserve heterogeneity at the highest length scale in a robust yet computationally efficient manner, and capture the architecturally dependent damage patterns, a previously-developed subcell modeling approach where the braided composite unit cell is approximated as a series of four adjacent laminated composites is utilized. This work discusses the implementation of the subcell methodology into the commercial transient dynamic finite element code LS-DYNA (Livermore Software Technology Corp.). Verification and validation studies are also presented, including simulation of the tensile response of straight-sided and notched quasi-static coupons composed of a T700/PR520 triaxially braided [0deg/60deg/-60deg] composite. Based on the results of the verification and validation studies, advantages and limitations of the methodology as well as plans for future work are discussed.

finite element method↗
NASA NTRS1999

True Concurrent Thermal Engineering Integrating CAD Model Building with Finite Element and Finite Difference Methods

Thermal engineering has long been left out of the concurrent engineering environment dominated by CAD (computer aided design) and FEM (finite element method) software. Current tools attempt to force the thermal design process into an environment primarily created to support structural analysis, which results in inappropriate thermal models. As a result, many thermal engineers either build models "by hand" or use geometric user interfaces that are separate from and have little useful connection, if any, to CAD and FEM systems. This paper describes the development of a new thermal design environment called the Thermal Desktop. This system, while fully integrated into a neutral, low cost CAD system, and which utilizes both FEM and FD methods, does not compromise the needs of the thermal engineer. Rather, the features needed for concurrent thermal analysis are specifically addressed by combining traditional parametric surface based radiation and FD based conduction modeling with CAD and FEM methods. The use of flexible and familiar temperature solvers such as SINDA/FLUINT (Systems Improved Numerical Differencing Analyzer/Fluid Integrator) is retained.

Panczak, Tim↗
NASA NTRSDate not supplied

Plant Watering in Low Gravity: The Study of the Fluid Dynamic Characteristics of Lunar Regolith Simulant for the Application of Crop Production Systems Using Scaled Capillary Devices

Bioregenerative life support is key to sustaining human life on the surface of other celestial bodies for missions beyond Low Earth Orbit (LEO). One example of such life support includes crop production systems capable of producing both plants and fungi for astronaut consumption. There have been numerous efforts to design and deploy such systems; however, there have been persistent fundamental issues with the water delivery systems. This study aims to understand and model the fluid dynamics of crop production systems to inform engineers about the key parameters needed for the design of such systems. The primary objective is to validate and expand upon NASA’s previous study, the Plant Water Management (PWM) experiments, to understand the fluid phenomena present in substrate-based systems. The model will then be expanded to include parameters for changing the test material of potential growth media as well as the varying water demands of the crop throughout its different stages in its life cycle. Specifically, this study is focused on the viability of using lunar regolith for agricultural purposes. Terrestrial-based scaled capillary models will be utilized to mimic the fluid phenomena occurring due to the low gravity environment seen on the lunar surface. Ultimately, the study will model the fluid flow present in the lunar regolith simulant and inform researchers on how to incorporate the material into crop production systems on the lunar surface.

gravity↗
NASA NTRS1991

Supersonic propulsion simulation by incorporating component models in the large perturbation inlet (LAPIN) computer code

An approach to simulating the internal flows of supersonic propulsion systems is presented. The approach is based on a fairly simple modification of the Large Perturbation Inlet (LAPIN) computer code. LAPIN uses a quasi-one dimensional, inviscid, unsteady formulation of the continuity, momentum, and energy equations. The equations are solved using a shock capturing, finite difference algorithm. The original code, developed for simulating supersonic inlets, includes engineering models of unstart/restart, bleed, bypass, and variable duct geometry, by means of source terms in the equations. The source terms also provide a mechanism for incorporating, with the inlet, propulsion system components such as compressor stages, combustors, and turbine stages. This requires each component to be distributed axially over a number of grid points. Because of the distributed nature of such components, this representation should be more accurate than a lumped parameter model. Components can be modeled by performance map(s), which in turn are used to compute the source terms. The general approach is described. Then, simulation of a compressor/fan stage is discussed to show the approach in detail.

Cole, Gary L.↗
DOE OSTI2019

Constructs and systems and methods for engineering a CO2 fixing photorespiratory by-pass pathway

Methods and compositions to introduce a synthetic pathway based on the 3-hydroxypropionate bicycle into an organism such as the model cyanobacterium, Synechococcus elongatus sp. PCC 7942. The heterologously expressed pathway acts as a photorespiratory bypass as well as an additional carbon fixation cycle orthogonal to the endogenous Calvin-Benson cycle. We demonstrate the function of all six introduced enzymes, which not only has implications on increasing net-photosynthetic productivity, but also key enzymes in the pathway are involved in high-value products that are of biotechnological interest, such as 3-hydroxypropionate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

New Educational Modules Using a Cyber-Distribution System Testbed

At Washington State University (WSU), a modern cyber-physical system testbed has been implemented based on an industry grade distribution management system (DMS) that is integrated with remote terminal units (RTUs), smart meters, and a solar photovoltaic (PV). In addition, the real model from the Avista Utilities distribution system in Pullman, WA, is modeled in DMS. The proposed testbed environment allows students and instructors to utilize these facilities for innovations in learning and teaching. For power engineering education, this testbed helps students understand the interaction between a cyber system and a physical distribution system through industrial level visualization. The testbed provides a distribution system monitoring and control environment for students. Compared with a simulation based approach, the testbed brings the students' learning environment a step closer to the real world. The educational modules allow students to learn the concepts of a cyber-physical system and an electricity market through an integrated testbed. Furthermore, the testbed provides a platform in the study mode for students to practice working on a real distribution system model. Here, this paper describes the new educational modules based on the testbed environment. Three modules are described together with the underlying educational principles and associated projects.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1997

Micromechanics Analysis Code (MAC) Developed

The ability to accurately predict the thermomechanical deformation response of advanced composite materials continues to play an important role in the development of these strategic materials. Analytical models that predict the effective behavior of composites are used not only by engineers in performing structural analysis of large-scale composite components but also by material scientists in developing new material systems. For an analytical model to fulfill these two distinct functions, it must be based on a micromechanics approach that uses physically based deformation and life constitutive models, and it must allow one to generate the average (macro) response of a composite material given the properties of the individual constituents and their geometric arrangement. Only then can such a model be used by a material scientist to investigate the effect of different deformation mechanisms on the overall response of the composite and, thereby, identify the appropriate constituents for a given application. However, if a micromechanical model is to be used in a large-scale structural analysis it must be (1) computationally efficient, (2) able to generate accurate displacement and stress fields at both the macro and micro level, and (3) compatible with the finite element method. In addition, new advancements in processing and fabrication techniques now make it possible to engineer the architectures of these advanced composite systems. Full utilization of these emerging manufacturing capabilities require the development of a computationally efficient micromechanics analysis tool that can accurately predict the effect of microstructural details on the internal and macroscopic behavior of composites. Computational efficiency is required because (1) a large number of parameters must be varied in the course of engineering (or designing) composite materials and (2) the optimization of a material's microstructure requires that the micromechanics model be integrated with optimization algorithms. From this perspective, analytical approaches that produce closed-form expressions which describe the effect of a material's internal architecture on the overall material behavior are preferable to numerical methods such as the finite element or finite difference schemes.

Source record↗
DOE OSTI2012

DEVELOPMENT OF A SOFTWARE DESIGN TOOL FOR HYBRID SOLAR-GEOTHERMAL HEAT PUMP SYSTEMS IN HEATING- AND COOLING-DOMINATED BUILDINGS

This project provides an easy-to-use, menu-driven, software tool for designing hybrid solar-geothermal heat pump systems (GHP) for both heating- and cooling-dominated buildings. No such design tool currently exists. In heating-dominated buildings, the design approach takes advantage of glazed solar collectors to effectively balance the annual thermal loads on the ground with renewable solar energy. In cooling-dominated climates, the design approach takes advantage of relatively low-cost, unglazed solar collectors as the heat rejecting component. The primary benefit of hybrid GHPs is the reduced initial cost of the ground heat exchanger (GHX). Furthermore, solar thermal collectors can be used to balance the ground loads over the annual cycle, thus making the GHX fully sustainable; in heating-dominated buildings, the hybrid energy source (i.e., solar) is renewable, in contrast to a typical fossil fuel boiler or electric resistance as the hybrid component; in cooling-dominated buildings, use of unglazed solar collectors as a heat rejecter allows for passive heat rejection, in contrast to a cooling tower that consumes a significant amount of energy to operate, and hybrid GHPs can expand the market by allowing reduced GHX footprint in both heating- and cooling-dominated climates. The design tool allows for the straight-forward design of innovative GHP systems that currently pose a significant design challenge. The project lays the foundations for proper and reliable design of hybrid GHP systems, overcoming a series of difficult and cumbersome steps without the use of a system simulation approach, and without an automated optimization scheme. As new technologies and design concepts emerge, sophisticated design tools and methodologies must accompany them and be made usable for practitioners. Lack of reliable design tools results in reluctance of practitioners to implement more complex systems. A menu-driven software tool for the design of hybrid solar GHP systems is provided that is based on mathematically robust, validated models. An automated optimization tool is used to balance ground loads and incorporated into the simulation engine. With knowledge of the building loads, thermal properties of the ground, the borehole heat exchanger configuration, the heat pump peak hourly and seasonal COP for heating and cooling, the critical heat pump design entering fluid temperature, and the thermal performance of a solar collector, the total GHX length can be calculated along with the area of a supplemental solar collector array and the corresponding reduced GHX length. An economic analysis module allows for the calculation of the lowest capital cost combination of solar collector area and GHX length. ACKNOWLEDGMENTS This project was funded by the United States Department of Energy DOE-DE-FOA-0000116, Recovery Act Geothermal Technologies Program: Ground Source Heat Pumps. The lead contractor, The University of Hartford, was supported by The University of Dayton, and the Oak Ridge National Laboratories. All funding and support for this project as well as contributions of graduate and undergraduate students from the contributing institutions are gratefully acknowledged.

14 SOLAR ENERGY↗
NASA NTRS1985

Composite Loads Spectra for Select Space Propulsion Structural Components: Probabilistic Load Model Development

This effort is in support of the development of the expert system of computer codes to predict the loads on select structural components of a space propulsion engine. The development will be based primarily on the space shuttle main engine (SSME) test data base. Because of random variations of the many different sources of the loadings on the selected structural components and transients, a probabilistic approach to the problems was adopted. The goal of this task is to characterize all of the individual sources of loads at critical structural locations, such as the turbine blades, the transfer ducts, and liquid oxygen posts, using state-of-the-art probabilistic methods with varying levels of sophistication. The second phase of this work is the development of a composite load model based on a probabilistic synthesis of the individual load model previously developed. This model will be based on the stochastic combination of the load variables and not on the physical process for the combination of the individual loads to the composite load seen by the selected structural components.

Kurth, R.↗
DOE OSTI2017

MOFA: Multi-objective Flux Analysis for the COBRA Toolbox

Environments of biological organisms are frequently nutrient and energy limited. This necessitates that systems exert tight regulation of trade-offs among key biological processes. Quantitative knowledge of these tradeoffs is essential for successful manipulation of biosystems (e.g., metabolic engineering projects). Using genome-scale constraint-based models of metabolism (GSMs), Multi-Objective Flux Analysis (MOFA) allows analyses of trade-offs among a system’s key biological tasks. The leading software for conducting a variety of constraint-based analyses using GSMs is the COBRA Toolbox for MATLAB. Results: We have developed a new add-on tool for COBRA that performs MOFA for a number of objectives only limited by computation power.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2012

Antenna Calibration and Measurement Equipment

A document describes the Antenna Calibration & Measurement Equipment (ACME) system that will provide the Deep Space Network (DSN) with instrumentation enabling a trained RF engineer at each complex to perform antenna calibration measurements and to generate antenna calibration data. This data includes continuous-scan auto-bore-based data acquisition with all-sky data gathering in support of 4th order pointing model generation requirements. Other data includes antenna subreflector focus, system noise temperature and tipping curves, antenna efficiency, reports system linearity, and instrument calibration. The ACME system design is based on the on-the-fly (OTF) mapping technique and architecture. ACME has contributed to the improved RF performance of the DSN by approximately a factor of two. It improved the pointing performances of the DSN antennas and productivity of its personnel and calibration engineers.

Rochblatt, David J.↗
NASA NTRS2021

Modernizing NASA’s Space Flight Safety and Mission Success (S&MS) Assurance Framework In Line With Evolving Acquisition Strategies and Systems Engineering Practices

This paper presents the objectives-driven, case-based safety and mission success (S&MS) assurance framework being developed by the NASA Office of Safety and Mission Assurance (OSMA), including its motivations and its implementation via a S&MS Assurance Standard that is under development, supplemented by supporting standards including an S&MS Analysis Management Standard that is also under development. A need to evolve NASA’s S&MS assurance framework has emerged in recent years, resulting from the need to accommodate new acquisition models; the need to accommodate evolving systems engineering (SE) practices; the need to stipulate acceptable levels of S&MS risk; the need for improved integration of S&MS into SE; and the need for clearer risk acceptance accountability. The objectives-driven, case-based S&MS assurance framework proposed here is responsive to that need. Its key features include: • The establishment, by NASA Acquirers, of fundamental S&MS performance objectives that define limits of acceptability for the likelihoods that mission technical objectives will be accomplished and that people, assets, and environments put at risk by the mission will not be adversely affected; • The development and approval of Providers’ S&MS plans for meeting Acquirers’ S&MS performance objectives, including commitments to support Acquirer audit, investigation, and reporting needs; • The development, by Providers, of S&MS assurance cases that argue, supported by evidence, that the Provider has met, or is on track to meeting, the fundamental S&MS objectives; • The evaluation, throughout the program/project life cycle, of Provider S&MS assurance cases as the primary S&MS-related technical basis for Acquirer risk acceptance and the granting to the Provider of authority to proceed through the program/project life cycle. This proposed S&MS assurance framework is notable for its lack of prescription of traditional S&MS requirements and strategies such as defined failure tolerances, margins, or analysis requirements. Instead, Providers are given latitude to propose their own strategies for meeting the fundamental S&MS performance objectives, subject to independent review and Acquirer approval. The result is a framework for S&MS assurance that is at once both rigorous and flexible.

Assurance Case↗
NASA NTRS2002

Radio Wave Propagation Handbook for Communication on and Around Mars

This handbook examines the effects of the Martian environment on radio wave propagation on Mars and in the space near the planet. The environmental effects include these from the Martian atmosphere, ionosphere, global dust storms, aerosols, clouds, and geomorphologic features. Relevant Martian environmental parameters were extracted from the measurements of Mars missions during the past 30 years, especially from Mars Pathfinder and Mars Global Surveyor. The results derived from measurements and analyses have been reviewed through an extensive literature search. The updated parameters have been theoretically analyzed to study their effects on radio propagation. This handbook also provides basic information about the entire telecommunications environment on and around Mars for propagation researchers, system engineers, and link analysts. Based on these original analyses, some important recommendations have been made, including the use of the Martian ionosphere as a reflector for Mars global or trans-horizon communication between future Martian colonies, reducing dust storm scattering effects, etc. These results have extended our wave propagation knowledge to a planet other than Earth; and the tables, models, and graphics included in this handbook will benefit telecommunication system engineers and scientific researchers.

Ho, Christian↗
DOE OSTI2022

Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states

Maintenance policy optimization usually is faced with challenges that arise from an imperfect knowledge of system degradation models and from the partial observability of system degradation states. Here, this paper proposes a reinforcement learning method to address these two challenges for a class of maintenance problems with Markov degradation processes. The reinforcement learning approach consists of a learning component and a planning component. Using sequentially collected observations, at each step of decision-making the learning component improves the knowledge of system degradation in terms of the probability distributions of the transition rates based on sequential Bayesian inference. Using the updated transition rates, at each step of decision-making the maintenance policy optimization problem is then formulated as a partially observable Markov decision problem, and the planning component computes the optimal maintenance policy that maximizes the expected cumulative reward. The proposed method is illustrated using a numerical example with repair and inspection maintenance actions. The result shows that as more observations are collected, the learning component progressively learns the true system degradation process, and the planning component adjusts the optimal maintenance policy accordingly as well, which leads to increased reward.

42 ENGINEERING↗