Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “operating costs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Electrocatalytic Valorization into H2 and Hydrocarbons of an Aqueous Stream Derived from Hydrothermal Liquefaction

Electrocatalytic oxidation is an attractive process for valorizing the carbon and removal of nitrogen present in the aqueous waste streams at ambient conditions. Here, we evaluated the electrocatalytic oxidation as a function of applied potential over a commercial Pt electrode of aqueous waste stream generated via hydrothermal liquefaction. We validated the conversion of quantifiable carbon (e.g., carboxylic acids, alpha hydroxyacids, alcohols, ketones, amides) and unquantifiable carbon as well as nitrogen removal. The unquantifiable carbon was valorized to quantifiable short chain organic molecules (e.g., acetic). Model studies showed that carboxylic acids, alcohol and ketones converted following (non-) Kolbe chemistry. Amides and alpha hydroxyacids formed carboxylic acids that subsequently converted via (non-) Kolbe chemistry. Ammonia was oxidized into N2. The reaction rate varied for each molecule family with carboxylic acids and ammonia having the highest reaction rates. The main reaction products from the electrocatalytic oxidation at the anode were volatile, short chain hydrocarbons (i.e., olefins, paraffins) and CO generated via Kolbe chemistry, while H2 was generated at the cathode. The parallel denitrification, valorization of carbon, and H2 generation of the aqueous waste can replace and simplify the current unit operations used in a commercial hydrothermal liquefaction process. The high operation potential required to drive the electrocatalytic reaction is responsible for high operation costs; however, they can be either partially subsidized with sale of excess H2 at the current DOE goal of $2/kg H2. Thus, the present work shows how electrocatalytic oxidation can be used to valorize aqueous waste streams into volatile hydrocarbons and H2.

Electrocatalytic oxidation, Aqueous waste valoriza↗
DOE OSTI2022

Optimizing design and dispatch of a renewable energy system with combined heat and power

We embellish a mixed-integer program that prescribes a set of renewable energy, conventional generation, and storage technologies to procure, along with a corresponding dispatch strategy. Specifically, we add combined heat and power to this set. The model minimizes fixed and operational costs less incentives for the use of various technologies, subject to a series of component interoperability and system-wide constraints. The resulting mixed-integer linear program contains hundreds of thousands of variables and constraints. We demonstrate how to efficiently formulate and solve the corresponding instances such that we produce near-optimal solutions in minutes. A previous rendition of the model required hours of solution time for the same instances.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Energy flexibility of residential buildings: A systematic review of characterization and quantification methods and applications

With building electric demand becoming increasingly dynamic, and a growing percentage of intermittent renewable power generation from solar photovoltaics and wind turbines, the power grid is facing increasing challenge to manage the real time balance between the supply and demand. With advancements in smart sensing and metering, smart appliances, electric vehicles, and energy storage technologies, demand side management of residential buildings can help the grid to improve stability by optimizing flexible loads. This paper reviews recent studies on residential building demand side management, with a focus on characterization and quantification of energy flexibility covering various types of flexible loads, metrics, methods, and applications. The reviewed studies showed four levels of applications: building level (45%), district or community level (29%), system level (19%), and building sector level (7%). Shifting loads is the dominant flexibility type in 60% of applications, followed by shedding (19%), generation (16%), and modulating (6%). Depending on the technology and application scope, flexible operations have a wide range of performance, with peak power reductions of 1%~65%, energy savings up to 60%, operational cost reduction of 1%~48%, and greenhouse gas emission reductions of up to29%. More than half (51%) of the studies employed control strategies to achieve flexibility; among those 72% used optimal controls, while 28% used rule-based controls. About 58% of the studies used mathematical formulation to quantify energy flexibility. Most studies were based on simulation, while less than 15% of the studies had measurements from experiments or field tests. The review reveals research opportunities to address significant gaps in the existing literature: (1) establishing a common definition and performance metrics for energy flexibility of buildings that are technology and application agnostic, (2) developing an ontology to standardize representation of flexibility resources for interoperability, (3) integrating occupant impacts into the quantification and optimization of energy flexibility, and (4) developing requirements and credits of energy flexibility in building energy codes and standards. Findings from the review can inform future research and development of energy flexible buildings which are essential to a reliable and resilient power grid.

Li, H↗
DOE OSTI2020

Reused cultivation water from a self-inhibiting alga does not inhibit other algae but alters their microbiomes

Economical production of algal commodities (food, feed, and fuels) requires reusing cultivation water to reduce operating costs. While some algae strains show growth inhibition in reused water, other strains appear un-affected. Reusing water to grow different strains (i.e., crop rotation) could potentially improve overall biomass production compared to water reuse with the same strain by reducing accumulation of strain-specific waste products, limiting carryover of population-specific pathogens such as viruses, and introducing bacteria that degrade residual organic matter. Here, batch culture experiments tested the effects of reused cultivation water from the self-inhibiting diatom Staurosira sp. C323 on the diatom Navicula sp. SFP and green alga Chlorella sp. D046, as well as their microbiomes. Navicula sp. and Chlorella sp. grew well in Staurosira sp. reused water, indicating that previously observed self-inhibition was likely specific to this Staurosira strain. While algal mi-crobiomes were not significantly different between controls and reused water treatments, specific bacteria taxa were differentially abundant in reused treatments, suggesting that some taxa responded to compounds re-maining in the reused water. Finally, results suggest that algae growth responses in reused water may depend largely on strain-specific factors, and that crop rotation can support biomass production.

09 BIOMASS FUELS↗
DOE OSTI2024

A study on the impact of using a subchannel resolution for modeling of large break loss of coolant accidents

The nuclear industry is investigating the feasibility of transitioning from 18- to 24-month fuel cycles because of the positive impact it would have on the operational costs for the current fleet of light-water reactors. A challenge to making this change is the increased risk of fuel fragmentation, relocation, and dispersal (FFRD) due to the known potential for ceramic fuel to pulverize into fine particles at the higher discharge burnups. Previous work has been performed by the Nuclear Energy Advanced Modeling and Simulation program to assess FFRD risk in high-burnup cores using the BISON fuel performance code and a coarse mesh thermal hydraulics (T/H) solution for a loss-of-coolant accident (LOCA) using the TRACE system T/H code. Because of the importance of the T/H solution for FFRD assessment, this study seeks to investigate the impact of using higher-fidelity subchannel techniques for modeling of the LOCA transient. CTF was used to model a subregion of a high-burnup core that was depleted by the Virtual Environment for Reactor Applications (VERA) multiphysics core simulator. Both coarse-mesh and pin-resolved models were created in CTF, and a consistent coarse-mesh TRACE model was also developed to allow for benchmarking the code results. Further, a large-break loss-of-coolant accident (LBLOCA) reflood transient was simulated using these three models, and results were compared. Results showed some consistent differences between the CTF and TRACE coarse models, including a higher peak cladding temperature (PCT) prediction in CTF and later quenching in CTF; however, the transient clad temperature behavior was similar, and these differences are likely due to post-critical heat flux heat transfer modeling differences and minimum film boiling temperature model differences. The pin-resolved results indicate that the PCT in the lumped model is often under-predicted by as much as 70 °C and that PCT occurs at a different location than the high-power pin in the assembly. The lumped model predicts a difference of 10 °C or less between the average and hot pins in the assembly, whereas the pin-resolved model predicts a range of over 100 °C. These results indicate that higher-fidelity T/H results may have an impact on predicted core behavior during LOCA, which may be important to consider when assessing FFRD risk.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Extended convex hull-based distributed optimal energy flow of integrated electricity-gas systems

Integrated electricity and gas systems are constructed to facilitate the gas-fired generation, and the distributed operation of these integrated systems have received much attention due to the increased emphasis on data security and privacy between different agencies. This paper proposes an extended convex hull based method to address optimal energy flow problems for the integrated electricity and gas systems in a distributed manner. First, a multi-block electricity-gas system model is constructed by dividing the whole system into N blocks considering both physical and regional differences. This multi-block model is then convexified by replacing the nonconvex gas transmission equation with the extended convex hull-based constraints. The Jacobi-Proximal alternating direction method of multipliers algorithm is adopted to solve the convexified model and minimize its operation cost. Finally, the feasibility of the optimal solution for the convexified model is checked, and a sufficient condition is developed. If the sufficient condition is satisfied, the optimal solution for the original nonconvex problem can be recovered from that for the convexified problem. Simulation results demonstrate that the proposed method is tractable and effective in obtaining feasible optimal solutions for multi-block optimal energy flow problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Regional difference and related cooling electricity savings of air pollutant affected natural ventilation in commercial buildings across the US

Maintaining indoor air pollutants under acceptable levels is significant to protect occupants from exposure to excessive air pollutants in natural ventilation. In this paper, using the representative air pollutant concentration data, we present the natural ventilation usability with associated cooling energy saving potentials in different location settings (urban and city center, suburban and rural) of the US under the influence of local weather conditions and major outdoor air pollutants, i.e. PM2.5, PM10 and ozone. It is found that the impacts of air pollutants on natural ventilation are usually higher in urban/suburban areas than rural areas (up to 25% difference) with the PM2.5 being the most significant outdoor air pollutant affecting natural ventilation usage. Furthermore, ozone could become increasingly influential on natural ventilation as moving from urban to suburban/rural areas. As to the cooling energy saving considering the impacts of outdoor air pollutants, natural ventilation is estimated to save approximately 10%–40% cooling energy (800–2600 kWh per small commercial building) annually in different location settings of investigated areas across the US. The following economic analysis demonstrates that these electricity savings lead to approximately 80–540 dollars annual savings of building operation cost per building. If the time of use rate is adopted, these cost savings could further increase by approximately 20% (Los Angeles) to more than 50% (Albuquerque) depending on different rate structures, which further demonstrates the potential of adopting natural ventilation as a sustainability measurement with benefits for building owners without compromising occupants health.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Investigation of HVAC operation strategies for office buildings during COVID-19 pandemic

To minimize the indoor transmission of contaminants, such as the virus that can lead to COVID-19, buildings must provide the best indoor air quality possible. Improving indoor air quality can be achieved through the building's HVAC system to decrease any concentration of indoor contaminants by dilution and/or by source removal. However, doing so has practical downsides on the HVAC operation that are not always quantified in the literature. This paper develops a temporal simulation capability that is used to investigate the indoor virus concentration and operational cost of an HVAC system for two mitigation strategies: (1) supplying 100% outdoor air into the building and (2) using different HVAC filters, including MERV 10, MERV 13, and HEPA filters. These strategies are applied to a hypothetical medium office building consisting of five occupied zones and located in a cold and dry climate. We modeled the building using the Modelica Buildings library and developed new models for HVAC filtration and virus transmission to evaluate COVID-19 scenarios. We show that the ASHRAE-recommended MERV 13 filtration reduces the average virus concentration by about 10% when compared to MERV 10 filtration, with an increase in site energy consumption of about 3%. In contrast, the use of 100% outdoor air reduces the average indoor concentration by about an additional 1% compared to MERV 13 filtration, but significantly increases heating energy consumption. Use of HEPA filtration increases the average indoor concentration and energy consumption compared to MERV 13 filtration due to the high resistance of the HEPA filter.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Influence of design and operating parameters for additively manufactured intensified packing devices on CO 2 -Absorption column cooling and capture efficiency

Solvent-based CO 2 absorption is technologically a matured CO 2 capture pathway but suffers from: high regeneration energy demand, and solvent temperature rise and decreased capture efficiency caused by the heat of reaction. While research has focused on developing non-aqueous and low-aqueous solvents for decreasing the regeneration energy, the temperature bulge due to exothermic absorption is typically dealt with by cooling the solvent with an external inter-stage heat-exchanger. This approach may increase the overall process footprint, as well as capital and operating costs. Here, the current study explores a process intensification approach by incorporating inside the column an additively manufactured intensified packing device that consists of corrugated plates and internal coolant channels. The corrugated plates provide surface area for mass transfer between gas and liquid, while cooling fluid inside the internal channels removes heat from the exothermic reactive system. Two different intensified devices with specific surface areas of 266 m 2 /m 3 and 359 m 2 /m 3 were designed, manufactured, and tested inside a 2.06-m long and 0.203-m diameter column packed with commercial Mellapak 250Y packing. The device with a lower surface area showed up to 27 % reduction in cooling performance. A steady-state heat transfer model provides good agreement with the experimental column temperature and intra-stage heat removal data. Although a decrease in heat transfer performance was observed for the device with lower surface area, CO 2 capture experiments performed with simulated flue gas and low-aqueous solvent demonstrated that both intensified devices lead to a similar improvement of 12 % in capture efficiency. This study provides an understanding on simplifying the intensified packing device geometry and decreasing the device fabrication cost by 25 % without compromising with the CO 2 absorption performance of the packed column.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Effect of H 2 O on the ethylene glycol/alkali dismantling of bagasse for high-value conversion

Using a high-boiling alcohol system to dismantle main components of biomass is a feasible technology. Reducing dismantle operating costs and improving dismantle efficiency are essential for promoting the green, economical, and sustainable development of biomass refining. Therefore, based on the low cost and chemical properties of H 2 O at high temperature, the effects of different H 2 O dosages in NaOH-catalyzed ethylene glycol (HBAA) system on the dismantling efficiency of bagasse, surface lignin coverage, recovered-lignin activity and enzymatic hydrolysis efficiency were investigated. Compared with the HBAA dismantling system without H 2 O, the HBAA system with 60% w/v H 2 O can obviously increase the removal rates of lignin and hemicellulose, while recovering up to 99% of cellulose and significantly declining surface lignin coverage, thus enhancing the enzymatic hydrolysis efficiency. Additionally, the results of density functional theory calculations and 2D HSQC NMR analysis prove that the synergy between H 2 O and ethylene glycol can promote the esterification reaction occurrence at the α-C carbon cation in β-O-4 structure of lignin, thereby protecting the β-O-4 aromatic ether bond. Simultaneously, when the H 2 O dosage increase from 0% to 60%, the enzymatic yield increases from 84.51% to 93.74% with an enzyme load of 10 FPU/g. Based on experimental results, this study conducted a techno-economic analysis of bagasse dismantling for ethanol and co-production of lignin, achieving a minimum ethanol selling price of $\$$1.07 per kg. Here, in this study, a green and economical solution for dismantling the main components of bagasse is developed, which is important for the high-value conversion of bagasse.

Ethylene glycol↗
DOE OSTI2023

Targeted electrochemical reduction of carcinogenic N -nitrosamines from emission control systems within CO 2 capture plants

N-Nitrosamines are one of the environmentally significant byproducts from aqueous amine-based post-combustion carbon capture systems (CCS) due to their potential risk to human health. Safely mitigating nitrosamines before they are emitted from these CO 2 capture systems is therefore a key concern before widescale deployment of CCS can be used to address worldwide decarbonization goals. Electrochemical decomposition is one viable route to neutralize these harmful compounds. The circulating emission control waterwash system, commonly installed at the end of the flue gas treatment trains to minimize amine solvent emissions, plays an important role to capture N-nitrosamines and control their emission into the environment. The waterwash solution is the last point where these compounds can be properly neutralized before becoming an environmental hazard. In this study, the decomposition mechanisms of N-nitrosamines in a simulated CCS waterwash with residual alkanolamines was investigated using several laboratory-scale electrolyzers utilizing carbon xerogel (CX) electrodes. Hcell experiments revealed that N-nitrosamines were decomposed through a reduction reaction and are converted into their corresponding secondary amines thereby neutralizing their environmental impact. Batch-cell experiments statistically examined the kinetic models of N-nitrosamine removal by a combined adsorption and decomposition processes. The cathodic reduction of the N-nitrosamines statistically obeyed the first-order reaction model. Finally, a prototype flow-through reactor using an authentic waterwash was used to successfully target and decompose N-nitrosamines to below the detectable level without degrading the amine solvent compounds allowing them to be return to the CCS and lower the system operating costs. Furthermore, the developed electrolyzer was able to efficiently remove greater than 98% of N-nitrosamines from the waterwash solution without producing any additional environmentally harmful compounds and offers an effective and safe route to mitigate these compounds from CO 2 capture systems.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2021

Shared automated vehicle fleet operations for first-mile last-mile transit connections with dynamic pooling

Shared automated vehicles (SAVs) have the potential to promote transit ridership by providing efficient first-mile last-mile (FMLM) connections through reduced operational costs to fleet providers and lower out-of-pocket costs to riders. To help plan for a future of integrated mobility, this paper investigates the impacts of SAVs serving FMLM connections, as a mode that provides flexibility in access/egress decisions and is well coordinated with train station schedules. To achieve this objective, a novel dynamic pooling algorithm was introduced to match SAVs with riders while coordinating the riders' arrival times at the light-rail station to a known train schedule. Microsimulations of SAVs and travelers throughout two central Austin neighborhoods show how larger service areas, higher levels of SAV demand, and longer arrival times between successive trains require larger SAV fleet sizes and higher SAV utilization rates to deliver close traveler wait times. Four-person SAVs appear to perform similar to 6-seat SAVs but will cost less to provide. Using a dynamic pooling algorithm tightly coordinated with train arrivals (every 15 min) delivers 87% of travelers to their stations in time to catch the next train, whereas uncoordinated assignments deliver just 58% of travelers in time.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Resource distribution under spatiotemporal uncertainty of disease spread: Stochastic versus robust approaches

We consider the problem of optimizing locations of distribution centers (DCs) and plans for distributing resources such as test kits and vaccines, under spatiotemporal uncertainties of disease spread and demand for the resources. We aim to balance the operational cost (including costs of deploying facilities, shipping, and storage) and quality of service (reflected by demand coverage), while ensuring equity and fairness of resource distribution across multiple populations. We compare a sample-based stochastic programming (SP) approach with a distributionally robust optimization (DRO) approach using a moment-based ambiguity set. Numerical studies are conducted on instances of distributing COVID-19 vaccines in the United States and test kits, to compare SP and DRO models with a deterministic formulation using estimated demand and with the current resource distribution plans implemented in the US. We demonstrate the results over distinct phases of the pandemic to estimate the cost and speed of resource distribution depending on scale and coverage, and show the “demand-driven” properties of the SP and DRO solutions. Furthermore, our results further indicate that if the worst-case unmet demand is prioritized, then the DRO approach is preferred despite of its higher overall cost. Nevertheless, the SP approach can provide an intermediate plan under budgetary restrictions without significant compromises in demand coverage.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Desalination metamodels and a framework for cross-comparative performance simulations

There is an opportunity to save energy and reduce operational expenses when choosing a suitable desalination method aided by computational modeling. Existing models are not conducive to generalized comparisons between different desalination methods. Therefore, the work in this study developed metamodels for six desalination methods, grouped them into thermal and molecular transport families, and validated their predictive performance within 9% difference from published data. This validated framework allowed comparisons of desalination methods at their prescribed ranges of operational conditions that they were designed for. These conditions specify feed salinity ranges of 1.6 to 2.4 g/kg for Capacitive Deionization and Reverse Osmosis (RO), 2.8 to 4.2 g/kg for Electrodialysis, 28 to 42 g/kg for Thermovapor Compression and Humidification-Dehumidification, and 37 to 55 g/kg for Multi-Effect Distillation (MED). Despite different operational conditions, all models exhibit non-linear, positive correlation between energy consumption and system size in response to feed salinity and production rate. The framework is also employed in a cross-comparative analysis between MED and RO whose results suggest that energy intensity for MED is an order of magnitude greater than RO for the same operational conditions, but actual operational costs are comparable. Overall, the framework is ready for deployment in case studies of actual desalination plants.

42 ENGINEERING↗
DOE OSTI2022

Residential Demand Flexibility: Modeling Occupant Behavior using Sociodemographic Predictors

Demand flexibility (DF) has the potential to increase the saturation of renewables in the grid and reduce operating costs for both utilities and customers. However, less than 8% of U.S. residential electric customers are enrolled in DF programs. A major research gap on this topic is an uneven understanding of behavioral drivers of electricity use and DF program participation at the household level. In this study, we employ machine learning models to predict residential occupant behavior in activities relevant to DF. We model occupants' extensive decisions (i.e., choice of action) and intensive behaviors (i.e., amount of time spent) during peak and off-peak time periods using the publicly available American Time Use Survey, which includes activities data for approximately 200,000 respondents. In our machine learning models, predictions for both extensive and intensive behavior fell within a +/-20% error margin at the aggregate level. We identify 13 key sociodemographic predictors of DF-related intensive behavior using LASSO inference and beta coefficient ranking. However, these top predictors differ by activity, suggesting potential scope for differential user targeting for DF events and technologies during program design. This work also contributes to understanding when and who might adopt these DF technologies based on their daily routine activities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Energy, economic, and environmental analysis of integration of thermal energy storage into district heating systems using waste heat from data centres

Data centres produce waste heat, which can be utilized in district heating systems. However, the mismatch between data centres’ heat supply and district heating systems’ heat demands limits its utilization. Further, high peak loads increase the operation cost of district heating systems. This study aimed to solve these problems by introducing thermal energy storages. A water tank and a borehole thermal energy storage system were selected as the short-term and long-term thermal energy storage, respectively. Energy, economic, and environmental indicators were introduced to evaluate different solutions. The case study was a campus district heating system in Norway. Results showed that the water tank could shave the peak load by 31% and save the annual energy cost by 5%. The payback period was lower than 15 years when the storage efficiency remained higher than 80%. However, it had no obvious benefits in terms of mismatch relieving and CO emissions reduction. In contrast, the borehole thermal energy storage increased the waste heat utilization rate to 96% and reduced the annual CO emissions by 8%. However, the payback period was more than 17 years. These results provide guidelines for the retrofit of district heating systems, where data centres’ waste heat is available.

25 ENERGY STORAGE↗
DOE OSTI2022

Optimal control to handle variations in moisture content and reactor in-feed rate

The variations in feedstock characteristics, such as moisture and particle size distribution, lead to an inconsistent flow of feedstock from the biomass pre-processing system to the reactor in-feed system. These inconsistencies result in low on-stream times at the reactor in-feed equipment. This research develops an optimal process control method for a biomass pre-processing system comprised of milling and densification operations to provide the consistent flow of feedstock to a reactor's throat. This method uses a mixed-integer optimization model to identify optimal bale sequencing, equipment in-feed rate, and buffer location and size in the biomass pre-processing system. This method, referred to as the hybrid process control (HPC), aims to maximize throughput over time. We compare HPC with a baseline feed forward process control. Our case study based on switchgrass finds that HPC reduces the variation of a reactor's feeding rate by up to 100% without increasing the operating cost of the biomass pre-processing system for biomass with moisture ranging from 10 to 25%. Additionally, HPC reduces the cost of processing biomass by 0.36%–2.22%, and reduces processing time by 0.35%-2.24%. Furthermore, a biorefinery can adapt HPC to achieve its design capacity.

09 BIOMASS FUELS↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗