Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Industrial Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Power increases using wind direction spatial filtering for wind farm control: Evaluation using FLORIS, modified for dynamic settings

As wind energy plays a growing role in the energy sector, new methods for controlling wind turbines and wind farms to maximize performance are garnering industry interest. A developing body of research treats the entire wind farm as a control system, with individual turbines acting as agents in a network, allowing farm-level objectives to be considered. Two promising developments in this research are wake steering control, which seeks to increase the power generated at a wind farm by directing the wakes of upstream turbines away from downstream ones, and communication-based spatial filtering, which seeks to improve the quality of information used by turbine- and farm-level controllers by combining measurements of the wind field collected at the individual turbines. The latter method has been shown to improve the estimates of wind direction at the turbines; however, the resulting potential for increased power capture warrants further investigation. With this paper, we begin to address this gap by combining wake steering with wind direction spatial filtering. To do so, we present a preliminary method for assessing the power capture of dynamic controllers using wind farm codes designed for time-averaged simulation. This allows us to generate results much more rapidly than would be possible using high-fidelity wind farm simulators and may be useful in many wind farm control design applications.

17 WIND ENERGY↗
DOE OSTI2025

Engineering microalgal cell wall-anchored proteins using GP1 PPSPX motifs and releasing with intein-mediated fusion

AbstractHarnessing and controlling the localization of recombinant proteins is critical for advancing applications in synthetic biology, industrial biotechnology, and drug delivery. This study explores protein anchoring and controlled release inChlamydomonas reinhardtii, providing innovative tools for these fields. Using truncated variants of the GP1 glycoprotein fused to the plastic-degrading enzyme PHL7, we identified the PPSPX motif as essential for anchoring proteins to the cell wall. Constructs with increased PPSPX content exhibited reduced secretion but improved anchoring, pinpointing the potential anchor-signal sites of GP1 and highlighting the distinct roles of these motifs in protein localization. Building on the anchoring capabilities established with these glycomodules, we also demonstrated a controlled release system using a pH-sensitive intein derived from RecA fromMycobacterium tuberculosis. This intein efficiently cleaved and released PHL7 and mCherry that was fused to GP1 under acidic conditions, enabling precise temporal and environmental control. At pH 5.5, fluorescence kinetics demonstrated significant mCherry release from the pJPW4mCherry construct within 4 hours. In contrast, release was minimal under pH 8.0 conditions and negligible for the pJPW2mCherry (W2) control, irrespective of the pH. Additionally, bands on the Western blot at the expected size of mCherry also showed its efficient release from the mCherry::intein::GP1 fusion protein at pH 5.5. Conversely, at pH 8.0, no bands were detected. This anchor-release approach offers significant potential for drug delivery, biocatalysis, and environmental monitoring applications. By integrating glycomodules and pH-sensitive inteins, this study establishes a versatile framework for optimizing protein localization and release inC. reinhardtii, with broad implications for proteomics, biofilm engineering, and scalable therapeutic delivery systems.Graphical Abstract

Kang, Kalisa (ORCID:0009000619398129)↗
NASA NTRS2002

Active Control Analysis for Aeroelastic Instabilities in Turbomachines

Turbomachines onboard aircraft operate in a highly complex and harsh environment. The unsteady flowfield inherent to turbomachines leads to several problems associated with safety, stability, performance and noise. In-flight surge or flutter incidents could be catastrophic and impact the safety and reliability of the aircraft. High-Cycle-Fatigue (HCF), on the other hand, can significantly impact safety, readiness and maintenance costs. To avoid or minimize these problems generally a more conservative design method must be initiated which results in thicker blades and a loss of performance. Actively controlled turbomachines have the potential to reduce or even eliminate the instabilities by impacting the unsteady aerodynamic characteristics. By modifying the unsteady aerodynamics, active control may significantly improve the safety and performance especially at off-design conditions, reduce noise, and increase the range of operation of the turbomachine. Active control can also help improve reliability for mission critical applications such as the Mars Flyer. In recent years, HCF has become one of the major issues concerning the cost of operation for current turbomachines. HCF alone accounts for roughly 30% of maintenance cost for the United States Air-Force. Other instabilities (flutter, surge, rotating-stall, etc.) are generally identified during the design and testing phase. Usually a redesign overcomes these problems, often reducing performance and range of operation, and resulting in an increase in the development cost and time. Despite a redesign, the engines do not have the capabilities or means to cope with in-flight unforeseen vibration, stall, flutter or surge related instabilities. This could require the entire fleet worldwide to be stood down for expensive modifications. These problems can be largely overcome by incorporating active control within the turbomachine and its design. Active control can help in maintaining the integrity of the system in unforeseen events and provide for more aggressive designs to reduce the weight and improve efficiency of the turbomachine. Another area where active control can be useful is in controlling and suppressing rotating stall and surge in compressors, thereby increasing its operating range. Although some of these benefits will be offset by the added cost and weight penalty of the control system, the potential benefits in safety, reliability, performance, and noise characteristics are significant enough to warrant research in the area of active control of turbomachines. There is renewed interest within industry to understand unsteady aerodynamic behavior. This improved understanding not only leads to better design of turbomachines, which avoid instabilities but also which helps in understanding the controllability of the instabilities. The proliferation of micro-electro-mechanical-system (MEMS) devices has made available new tools to designers for employing feedback controls at reasonable costs. MEMS have also made the control devices small and unobtrusive enough to be implemented within the turbomachine without significant obstruction to the flow path. This has made active-control very attractive especially for systems requiring extreme confidence.

Keith, Theo G., Jr.↗
NASA NTRS2010

Aircraft Loss of Control Causal Factors and Mitigation Challenges

Loss of control is the leading cause of jet fatalities worldwide. Aside from their frequency of occurrence, accidents resulting from loss of aircraft control seize the public s attention by yielding a large number of fatalities in a single event. In response to the rising threat to aviation safety, the NASA Aviation Safety Program has conducted a study of the loss of control problem. This study gathered four types of information pertaining to loss of control accidents: (1) statistical data; (2) individual accident reports that cite loss of control as a contributing factor; (3) previous meta-analyses of loss of control accidents; and (4) inputs solicited from aircraft manufacturers, air carriers, researchers, and other industry stakeholders. Using these information resources, the study team identified the causal factors that were cited in the greatest number of loss of control accidents, and which were emphasized most by industry stakeholders. This report describes the study approach, the key causal factors for aircraft loss of control, and recommended mitigation strategies to make near-term impacts, mid-term impacts, and Next Generation Air Transportation System impacts on the loss of control accident statistics

Jacobson, Steven R.↗
DOE OSTI2024

Integrate Latimer Controls' Solution into RTAC (CRADA Final Report, CRD-23-24672)

Latimer Controls, Inc. was awarded two vouchers under the Department of Energy's American-Made Solar Prize Round 6 to conduct collaborative research at a national laboratory. The National Renewable Energy Laboratory (NREL) was selected as a partner to assist Latimer Controls in the performance evaluation of its photovoltaic (PV) control software. This collaboration focuses on developing a hardware-in-the-loop (HIL) testbed at NREL, which will be used to test and validate the Latimer PV control technology in a realistic yet de-risked environment. Both Latimer and NREL teams will work together to analyze the collected test data, derive insights, and disseminate the scientific findings. Recent studies underscore the potential of solar energy as a zero-marginal-cost and zero-emission flexibility resource within the bulk power system, particularly when integrated with advanced control systems. To enhance the performance of such systems, Latimer Controls has developed leading-edge technologies, including machine learning (ML) algorithms and hierarchical inverter set-point allocation methods. These innovations are designed to estimate the operational headroom of large PV plants for grid integration and control. However, comprehensive validation under real-world conditions remains necessary. To address this gap, the concurrent CRADA project proposes the real-world application and validation of the Latimer Control solution within a HIL environment. Initially, the Latimer algorithm was developed and tested within MATLAB Simulink, a platform suitable for research-level simulations and iterative development. However, transitioning this technology to a real solar site as an industry-ready solution necessitates implementation in a format compatible with widely used solar power plant controllers. In this additional CRADA work, the MATLAB Simulink-based logic will be translated into Structured Text, a programming language compliant with IEC 61131 standards, which is commonly used for custom logic implementations in industry-leading programmable logic controllers (PLCs), such as the Schweitzer SEL real-time automation controller (RTAC). This transition will facilitate the deployment of the Latimer Control solution in real-world solar power plants, thereby advancing the technology towards commercialization.

14 SOLAR ENERGY↗
NASA NTRS1972

The Right to Regulate

An introduction to the historical and constitutional framework of industry regulation by local and Federal Governments is presented. Problems of the confiscation of private property without due process, government control and the rights and duties of the regulated industry are discussed.

Vittek, J. F.↗
NASA NTRS1997

A Web-Based System for Monitoring and Controlling Multidisciplinary Design Projects

In today's competitive environment, both industry and government agencies are under enormous pressure to reduce the time and cost of multidisciplinary design projects. A number of frameworks have been introduced to assist in this process by facilitating the integration of and communication among diverse disciplinary codes. An examination of current frameworks reveals weaknesses in various areas such as sequencing, displaying, monitoring, and controlling the design process. The objective of this research is to explore how Web technology, in conjunction with an existing framework, can improve these areas of weakness. This paper describes a system that executes a sequence of programs, monitors and controls the design process through a Web-based interface, and visualizes intermediate and final results through the use of Java(Tm) applets. A small sample problem, which includes nine processes with two analysis programs that are coupled to an optimizer, is used to demonstrate the feasibility of this approach.

Salas, Andrea O.↗
DOE OSTI2020

Accelerated Aging Humidity Chamber for Nuclear Grade HEPA Filter Media

A unique accelerated aging humidity chamber for simulating the natural aging process of nuclear grade high efficiency particulate air (HEPA) filter media is being designed, implemented, and tested. The nuclear industry currently lacks information regarding the shelf life and service life of HEPA filter media. The Department of Energy recommends disposing of HEPA filters 10 years after the manufacture date for filters operated under dry conditions. Studies have shown the tensile strength and water repellency of HEPA filter media diminish with age. The chamber's principal function is to sustain an elevated relative humidity condition for an extended duration specified by the Arrhenius aging model. To accomplish this, various design parameters were established: (1) consistently achieve uniform humidity conditions within the chamber to equally expose media sheets, (2) ensure the chamber is sufficiently sealed to mitigate the uncontrolled infiltration of air, (3) confidently secure the media sheets to avert the introduction of unnecessary stressing/creasing, (4) fabricate the chamber from clear polycarbonate material to allow inspection of the media sheets, (5) provide a safe and ergonomic design for personnel, (6) ensure the chamber design is replicable and relatively easy to fabricate/assemble. A humidity source, fan, PID controller, humidity and temperature transmitters, and data loggers are required for proper operation and control of the chamber. The humidity source must accommodate target values up to 95% relative humidity throughout the chamber. The three humidity and temperature transmitters are strategically spaced throughout the chamber to ensure uniform conditions. The 10 cubic feet per minute (CFM) fan selected intends to accomplish the desired air change rate inside the chamber of approximately 20 air changes per hour (ACH). The 2 plenums on the upper and lower portions of the chamber utilize a perforated design to uniformly distribute air, promote air mixing, and control the air velocity entering the chamber. Industrial blueprint hanging clamps are being retrofitted to be seated within the chamber drawers and firmly secure the nuclear grade filter media. The aged media will be evaluated using autopsy methodology, and the results obtained intend to help clarify the useful life of nuclear grade HEPA filters. Nuclear grade high efficiency particulate air (HEPA) filters are defined as disposable, extended-media, dry-type filters with a rigid casing enclosing the full depth of the pleats and have a minimum particle removal efficiency of 99.97%. [1] - HEPA filters are constantly exposed to stressors and subsequently have been shown to degrade as the filter ages. Properties such as tensile strength and water repellency, along with others, are negatively impacted. [2] - Due to the scarcity of naturally aged HEPA filters available, it is crucial to develop accelerated aging methods which effectively mimic the natural degradation effects. - After accelerated aging, the filters are subject to testing in the Axial Flow Large Scale Test Stand (ALSTS) and other analysis techniques such as the same qualification tests performed directly after being manufactured. - Quality data is necessary for future decisions regarding the lifetime of nuclear grade HEPA filters. - The objective is to develop a prototype accelerated aging humidity chamber for nuclear grade HEPA filter media. The chamber should expose the media to commonly occurring stressors to expedite the degradation process caused by aging. PID yields reliable and reproducible results: - CFD model correlates well with actual performance; - Further analysis is needed to complete characterization; - Future work for the chamber is still to be completed. The data shown in Figure 5 and Table 1 indicate the system is functioning as designed. As can be determined from the system response evaluation in Table 1, the PID controller is yielding reliable and reproducible results at each set point. As the set point increases, the time constant and 20% settling time increase accordingly. From the results in Table 1, it stands to reason that the CFD model correlates well with the actual performance of the system. Each system response parameter for the 90%RH* CFD model is slightly lower than the parameters collected from the physical model tested at an equivalent set point. This is to be expected considering the inlet in the CFD model is a constant supply of water vapor, whereas the physical model uses a PID controller to monitor the amount of water vapor needed and reacts accordingly. More analysis is still to be done on the prototype chamber. A pressure test will be conducted in order to determine the hourly leak rate of the chamber. This test will involve constant air flow into the chamber until the desired pressure is reached. A uniformity test will also be conducted in order to ensure each filter medium is being exposed to equivalent relative humidity levels. This test will involve an array of humidity meters strategically oriented inside the chamber to record any possible gradients. Future work for the chamber includes dehumidification abilities, tests while fully loaded with filters, and temperature control. Once completed, the autopsy team at Institute of Clean Energy Technology will conduct necessary accelerated aging studies as needed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Accelerating Optimal Integration of Energy Efficiency Strategies with Industrialized Modular Construction: Preprint

The National Renewable Energy Laboratory's (NREL's) Industrialized Construction Innovation team first introduced the Industrialized Construction Assessment Framework to achieve affordable, net-zero energy (NZE) modular multifamily buildings in the 2020 ACEEE paper "Integrating Energy Efficiency Strategies with Industrialized Construction for our Clean Energy Future." Since then, NREL has continued to drive the ambitious plan to accelerate optimal integration of energy efficiency strategies during industrialized construction with little or no additional cost, labor, and production time. This follow-on paper introduces the Energy in Modular (EMOD) buildings method and presents NREL's research efforts over the last two years in collaboration with industry, including affordable housing partners. NREL has developed an idealized NZE modular multifamily building design that incorporates five energy efficiency strategies well suited for industrialized construction in factories: (1) envelope thermal control, (2) envelope infiltration control, (3) mechanical, electrical, and plumbing systems, (4) smart controls, and (5) solar plus storage. This paper highlights results from leveraging design for manufacturing and assembly principles, testing, and validation pilots with factory partners; demonstrating pod prototypes in test stand at NREL; and performing simulations. Overall, these research efforts address barriers to whole-building system integration, such as poor installation quality of thermal and air barriers; lack of unitized systems for space conditioning, energy recovery and ventilation, and water heating; problematic on-site installation, commissioning, and configuration of controls; and lack of cost-effective integration for grid-friendly design and emerging technologies. Conclusively, the paper delineates next steps for future work with NREL's partners toward developing a transformational pathway for our clean energy future.

affordable housing↗
DOE OSTI2025

An open control sequence specification to scale building demand flexibility via analytics software

For over two decades, researchers and practitioners have showcased the ability of large commercial buildings to provide grid services by shedding or shifting load. Various utility demand response (DR) and virtual power plant (VPP) programs throughout the United States are presently utilizing these demand-side resources. However, growth of these programs have been limited, in part due to the high cost necessary to integrate the DR control strategies into the building automation system (BAS). Implementing these strategies involves adjusting control sequences, necessitating dozens of hours of customized programming per building, limiting their adoption to large organizations and progressive owners. Recent efforts by researchers and industry have demonstrated the capability of energy management and information systems (EMIS), originally designed for fault detection and diagnostics, to interface with existing BAS and perform supervisory control to optimize building operations. While these approaches are quickly being adopted by industry, demand flexibility (DF) control strategies remain limited in product offerings. One of the challenges is the lack of documented best-practice DF sequences, despite the rich literature on field implementations. This paper develops a new open-specification for a zone-based temperature adjustment shed strategy for commercial building HVAC systems, describing the specification’s implementation in two EMIS tools in both experimental and field settings. Both implementations successfully reduced electric load by at least 40% on average during the called event, while maintaining temperature limits. This study’s detailed process from specification to deployment shows the potential for scalability as well as highlights challenges related to integration with heterogeneous BAS products.

Granderson, Jessica↗
DOE OSTI2020

Estimation of Large-Scale Wind Field Characteristics Using Supervisory Control and Data Acquisition Measurements

As the wind energy industry continues to push for increased power production and lower cost of energy, the focus of research has expanded from individual turbines to entire wind farms. Among a host of interesting problems to be solved when considering the wind farm as a whole, we consider the challenge of scalar field estimation, based on information already collected at the individual turbine level. We aim to estimate the large-scale, low-frequency characteristics of the wind field, such as the mean wind direction and the overall decrease in wind speed across the farm, and employ a Kalman filter that models the wind field using a polynomial function. We compare the proposed method’s performance to both a simple averaging technique and filtering of individual turbine measurements. The method presented is not limited to wind turbines and is applicable in other situations where multiple remote agents are used to estimate a scalar field.

estimation↗
NASA NTRS1989

Force/torque and tactile sensors for sensor-based manipulator control

The autonomy of manipulators, in space and in industrial environments, can be dramatically enhanced by the use of force/torque and tactile sensors. The development and future use of a six-component force/torque sensor for the Hermes Robot Arm (HERA) Basic End-Effector (BEE) is discussed. Then a multifunctional gripper system based on tactile sensors is described. The basic transducing element of the sensor is a sheet of pressure-sensitive polymer. Tactile image processing algorithms for slip detection, object position estimation, and object recognition are described.

Vanbrussel, H.↗
NASA NTRS1993

RACE pulls for shared control

Maintaining and supporting an aircraft fleet, in a climate of reduced manpower and financial resources, dictates effective utilization of robotics and automation technologies. To help develop a winning robotics and automation program the Air Force Logistics Command created the Robotics and Automation Center of Excellence (RACE). RACE is a command wide focal point. Race is an organic source of expertise to assist the Air Logistic Center (ALC) product directorates in improving process productivity through the judicious insertion of robotics and automation technologies. RACE is a champion for pulling emerging technologies into the aircraft logistic centers. One of those technology pulls is shared control. Small batch sizes, feature uncertainty, and varying work load conspire to make classic industrial robotic solutions impractical. One can view ALC process problems in the context of space robotics without the time delay. The ALC's will benefit greatly from the implementation of a common architecture that supports a range of control actions from fully autonomous to teleoperated. Working with national laboratories and private industry, we hope to transition shared control technology to the depot floor. This paper provides an overview of the RACE internal initiatives and customer support, with particular emphasis on production processes that will benefit from shared control technology.

Leahy, M. B., Jr.↗
NASA NTRS1996

An Assessment of IMPAC - Integrated Methodology for Propulsion and Airframe Controls

This report documents the work done under a NASA sponsored contract to transition to industry technologies developed under the NASA Lewis Research Center IMPAC (Integrated Methodology for Propulsion and Airframe Control) program. The critical steps in IMPAC are exercised on an example integrated flight/propulsion control design for linear airframe/engine models of a conceptual STOVL (Short Take-Off and Vertical Landing) aircraft, and MATRIXX (TM) executive files to implement each step are developed. The results from the example study are analyzed and lessons learned are listed along with recommendations that will improve the application of each design step. The end product of this research is a set of software requirements for developing a user-friendly control design tool which will automate the steps in the IMPAC methodology. Prototypes for a graphical user interface (GUI) are sketched to specify how the tool will interact with the user, and it is recommended to build the tool around existing computer aided control design software packages.

Walker, G. P.↗
NASA NTRS1993

Reduction of Model Complexity by Active Control

The mathematical models of many dynamic systems of interest in the aerospace industry are inherently complex and of high order. Rather than grapple with the full-complexity models for such systems, the control designers often elect to derive low-order, reduced-complexity models for which a control system can be designed. The subject of model-order reduction has received a significant amount of attention in control engineering literature. This paper describes and demonstrates a novel active-control methodology that can be used to design a control system that automatically forces the original system to behave like a chosen reduced-complexity model by treating the effects of the original complexity-related terms as disturbances acting on the reduced-complexity system. The method is demonstrated by several worked examples involving both linear and nonlinear systems, supported by simulation results.

Bukley, Angelia P.↗
DOE OSTI2023

Safety-Related Instrumentation and Control Pilot Upgrade: Conceptual - Detailed Design Phase Report and Lessons Learned

Historically, regulatory barriers have precluded nuclear plant safety-related (SR) Instrumentation and Control (I&C) system modernizations. These barriers have been largely addressed by industry and United States Nuclear Regulatory Commission (NRC) efforts, including development of the License Amendment Request (LAR) Alternate Review (AR) process for digital I&C upgrades. The U.S. Department of Energy (DOE) and the Idaho National Laboratory (INL) are supporting a SR I&C pilot upgrade at the Limerick Generating Station (LGS) to demonstrate this process and capturing associated lessons learned for the benefit of industry. In 2021, a paper summarizing lessons learned as captured in INL/EXT-20-59809, Safety Related Instrumentation & Control Pilot Upgrade Initial Scoping Phase Implementation Report and Lessons Learned was presented at the 12th NPIC & HMIT conference. It is recommended that readers of this paper review reference 1 or the associated Nuclear Journal paper for context. This paper summarizes activities performed and lessons learned for the conceptual design phase and portions of the detailed design phase as captured in INL/RPT-23-XXXX, “Safety-Related Instrumentation and Control Pilot Upgrade: Conceptual - Detailed Design Phase Report and Lessons Learned.” The portions of the effort covered by reference 2 include conceptual design phase activities from December 2020, through completion in November 2021, and detailed design activities through September 2022. These efforts and associated detailed documentation in reference 3 are intended to support similar industry upgrades as a foundation stone for a Digital Transformation that will improve plant safety, reliability, and operational performance while lowering plant total cost of ownership.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Improved Moisture Management Technology for Eco-N-Control Fertilizer

Three fertilizer technologies to manage nitrogen (N) release rates in soil dominate the market today: 1) bulk controlled-release technologies, which use the intrinsic solubility properties of a N-organic co-polymer to control N release; 2) barrier-based controlled-release technologies, which use porous polymer or sulfur coatings as a physical barrier to control N release from encapsulated N nutrients; and 3) slow-release technologies, which use enzyme inhibitors to chemically slow down the transformation of N nutrients into ammonia (NH 3 ) or to temporarily reduce populations of bacteria in the soil that are responsible for converting ammonium (NH 4 + ) to highly soluble nitrates. These technologies are expensive and provide only limited control of N-release rates. Also, from another environmental perspective, synthetic polymer coatings do not decompose easily and will accumulate over time with continuous application of fertilizer. For most of the past two decades we have been developing the Eco-N-Control solid-nitride fertilizer technology, a type of bulk controlled-release technology. With Eco-N-Control, solid-nitride compounds weather like a mineral, slowly releasing N at a rate determined by their composition. Testing by an industrial collaborator, however, showed that earlier versions of Eco-N-Control released at 25% of the desired rate when deployed in unsaturated soils. The overall goal of the current project, therefore, was to strengthen our IP position and the potential for licensing of Eco-N-Control solid-nitride fertilizer technology by developing new ways to manage the level of moisture in contact with the fertilizer when applied to soil thereby ensuring the desired N-release rate. We achieved this goal by developing a biodegradable polymer cross-linking approach that substantially improved performance of our patented solid-nitride fertilizer. We found that cross-linking an environmentally friendly and biodegradable polymer with a mixture of solid nitrides, other N-nutrient compounds and other additives offers several advantages: 1) mechanical robustness of fertilizer beads, 2) chemical stability during storage, 3) maintenance of sufficient water content in the vicinity of the nitride, and 4) control of N-release rates. We also updated our N-release testing protocol to more realistically simulate the conditions found in soil. Finally, we filed an invention disclosure record to protect these new aspects of Eco-N-Control technology, which offers a potential way to lower both agricultural and industrial pollution by providing an efficient N-delivery mechanism to plants.

42 ENGINEERING↗
DOE OSTI2023

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗