Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “closed loop simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

WEST L-mode record long pulses guided by predictions using Integrated Modeling

A new record was set on the WEST Tokamak, designed to operate long duration plasmas in a tungsten (W) environment, with an injected energy of 1.15 GJ and a plasma duration 364s. Scenario development was supported by integrated modeling using the High Fidelity Plasma Simulator (HFPS), the European IMAS-coupled version of JETTO/JINTRAC, which integrates physics-driven modules into a unified framework. In particular, a reduced model for Lower-Hybrid heating and Current-Drive (LHCD) and the quasi-linear turbulent transport model TGLF are crucial for long pulses predictions up to the Last Closed Flux Surface (LCFS). Using this workflow, a 100 s reference discharge was modeled and plasma kinetic profiles and loop voltage were quantitatively well matched. In preparation for the recent long duration experiments, non-inductive current-drive actuators (I P , n e , P LHCD ) were varied to determine the operational domain going towards fully non-inductive discharges. In particular, decreasing the plasma current is shown to ease the access to such conditions, with a careful monitoring of (n e , P LHCD ) to avoid machine limitations. In addition, post-prediction experiments conducted within the investigated parameter range validated the predicted dependencies and were shown to be in quantitative agreement. Exploratory work on the use of ECCD for MHD stability purpose is also introduced.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Full-Loop Simulation of the Combustion of Biomass in a Circulating Fluidized Bed Combustor

Interest in circulating fluidized bed (CFB) boilers as a power generation technology has skyrocketed in recent years because of several advantages this technology offers over conventional boilers, such as increased gas-solid mixing, which results in higher combustion efficiency, and the ability to use lower rank fuels. CFB combustors are operated at lower temperatures than conventional thermal power generation combustors, thus reducing NO x emissions, while SO 2 emissions can be conveniently controlled through the addition of Ca-based sulfur sorbents within the combustor. This report summarizes the development of a comprehensive computational fluid dynamics (CFD) model for biomass combustion in a 50 kW th CFB combustor employing the multiphase particle-in-cell (PIC) approach in the open-source Multiphase Flow with Interphase eXchanges (MFiX) Software Suite at the U.S. Department of Energy (DOE) National Energy Technology Laboratory (NETL). The experimental combustor was designed, built, and operated at CanmetENERGY, Natural Resources Canada in Ottawa, Canada. This work is the culmination of a multi-year collaboration between NETL and CanmetENERGY. The hydrodynamics in the full loop are validated against cold-flow experiments conducted at CanmetENERGY. To mimic the dense packing in the standpipe in the absence of a collisional model in the MFiX-PIC approach, the ram valve in the return leg is partially closed to obstruct the flow. A combustion reaction scheme was developed that considers the volatiles released by the fuel as a lumped species that fully converts to CO 2 and H 2 O. The so-called enhanced simplified combustion scheme produces an excellent match with experimental data in terms of the species concentrations of CO 2 and O 2 at the outlet and the freeboard, demonstrating the utility of the comprehensive model for a range of flow conditions and operating temperatures. Furthermore, the model can be readily adapted to simulate combustion of a variety of biomass fuels as well as co-fired systems under air and oxy-fuel conditions.

09 BIOMASS FUELS↗

Regional surrogates for predictive control of digital twins

Digital twins of complex systems must involve a model that is fast, generalizable, and usable for real-time control. For example, high-fidelity nonlinear multiphysics simulations can capture laser-material interactions, but are too slow for optimization or model predictive control (MPC). Reduced-order models, used to accelerate such computation, frequently fail to generalize to unseen inputs or control states. We show theoretically that this failure is intrinsic, i.e., that a learned model is non-unique outside the sampled subspace when its low-rank structure arises from limited excitation and clustered eigenvalues, rather than from a user-imposed truncation alone. Motivated by this result, we propose a control-ready regional surrogate-construction framework for both autonomous and nonautonomous dynamics; it employs Koopman lifting to represent nonlinearities, while preserving spatial locality. We illustrate our approach by constructing a control-ready surrogate for the digital twin of a thermal component of additive-manufacturing process. Our surrogate, localized in space through a von Neumann stencil, is learned from noisy high-fidelity simulations that emulate thermal-camera images collected during the manufacturing. It is linear in thermo-physically augmented states so that MPC reduces to a convex quadratic program. The surrogate requires no online correction, generalizes to unseen scan paths and power profiles of the laser, and is more than three orders of magnitude faster than a finite-difference solver. Furthermore, when the MPC sequence computed on the digital twin is applied to this solver, closed-loop temperature regulation is recovered, showing that the surrogate preserves control-relevant input-output behavior.

Data-driven model↗

MFIX-Exa: Performance prediction of multiphase energy conversion devices

MFIX-Exa targets the high-fidelity CFD-DEM model in which particles are unresolved by the fluid grid (typically using a fluid mesh approximately twice the particle diameter) but discrete particle dynamics including collisions are resolved with a simple linear-spring dashpot model. The fluid field is solved with a modern low Mach number formation of a cell-centered, nodal-pressure approximate projection method using a Godunov scheme . Physics capabilities include: complex geometries via embedded boundaries (EBs), open and closed system ideal gas equations of state, species transport and heterogeneous chemi- cal reactions. MFIX-Exa is built on the AMReX software framework, the ECP Block-Structured Adaptive Mesh Refinement (AMR) Co-Design Center, which allows the code to be portable and performant.Further integration into the ECP ecosystem includes HYPRE linear solvers and Ascent for in situ visualization. Current project efforts focus on scaling up realistic simulations to the KPP of the challenge problem: NETs 50kW chemical looping reactor, shakedown and scaling on JSLE and OLCF TDS systems and reaching for any remaining performance improvements.

Musser, Jordan↗

Model-based Cyber-attack Detection for Voltage Source Converters in Island Microgrids

With the upgrading of communication and control in microgrids, cyber threats on the power converters are increasing. Here, in this paper, a novel model-based cyber-attack detection methodology is proposed for each voltage source converter in microgrids. The Harmonics State Space Matrix (H-Matrix) is used to build the closed-loop transfer function, providing model-based estimation with the grid voltage and control reference. Then, the space phase model (SPM) is used to calculate residual to detect cyber-attacks in voltage source converter (VSC). As controller and converter parameters are included in the H-matrix, the proposed method also could detect cyber-attacks when voltage fluctuation occurs in the grid. To verify the feasibility of the proposed method, several attacks targeting VSC in an islanded microgrid are simulated in MATLAB. Simulation and detection results are introduced to demonstrate the resilience and feasibility of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Monte Carlo control loops for cosmic shear cosmology with DES Year 1 data

Weak lensing by large-scale structure is a powerful probe of cosmology and of the dark universe. This cosmic shear technique relies on the accurate measurement of the shapes and redshifts of background galaxies and requires precise control of systematic errors. Monte Carlo control loops (MCCL) is a forward modeling method designed to tackle this problem. It relies on the ultra fast image generator (UFig) to produce simulated images tuned to match the target data statistically, followed by calibrations and tolerance loops. Here, we present the first end-to-end application of this method, on the Dark Energy Survey (DES) Year 1 wide field imaging data. We simultaneously measure the shear power spectrum $C_ℓ$ and the redshift distribution $n(z)$ of the background galaxy sample. The method includes maps of the systematic sources, point spread function (PSF), an approximate Bayesian computation (ABC) inference of the simulation model parameters, a shear calibration scheme, and a fast method to estimate the covariance matrix. We find a close statistical agreement between the simulations and the DES Y1 data using an array of diagnostics. In a nontomographic setting, we derive a set of $C_ℓ$ and $n(z)$ curves that encode the cosmic shear measurement, as well as the systematic uncertainty. Following a blinding scheme, we measure the combination of $Ω_m$, $σ_8$, and intrinsic alignment amplitude $A_{IA}$, defined as $S_8D_{IA}=σ_8(Ω_m/0.3)^{0.5}D_{IA}$, where $D_{IA}=1-0.11(A_{IA}-1)$. We find $S_8D_{IA}=0.8954_{-0.039}^{+0.054}$, where systematics are at the level of roughly 60% of the statistical errors. We discuss these results in the context of earlier cosmic shear analyses of the DES Y1 data. Our findings indicate that this method and its fast runtime offer good prospects for cosmic shear measurements with future wide-field surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Feedback-Based Fault-Tolerant and Health-Adaptive Optimal Charging of Batteries

The key technology barriers that hinder the growth of Electric Vehicles (EVs) are long charging time, the shorter life-time of EV batteries, and battery safety. Specifically, EV charging protocols have significant effects on battery lifetime and safety. If not charged properly, the battery could end up with shorter life, and more importantly, improper charging can cause battery faults leading to catastrophic failures. To overcome these barriers, we propose a closed-loop feedback based approach, that enables real-time optimal fast charging protocol adaptation to battery health and possess active diagnostic capabilities in the sense that, during charging, it detects real-time faults and takes corrective action to mitigate such fault effects. We utilize battery electrical-thermal model, explicit battery capacity and power fade aging models, and thermal fault model to capture battery behavior. In conjunction with the models, we adopt linear quadratic optimal control techniques to realize the feedback-based control algorithm. Simulation studies are presented to illustrate the effectiveness of the proposed scheme.

batteries↗

Pair Cascades in Magnetar Magnetospheres

Resonant inverse Compton scattering (RICS) of soft thermal photons by relativistic particles on closed magnetic field loops has been proposed to explain the hard emission observed up to and beyond 200 keV from magnetars. If particles injected at the base of the loops have Lorentz factors ≳10 2 , the RICS spectra will be attenuated by both one-photon pair production and photon splitting in the ultrastrong magnetar fields, producing additional spectral components from pair synchrotron radiation and split photons that produce further generations of pairs and split photons. We investigate such cascades initiated by the primary injected electrons through a Monte Carlo simulation, and study the cascade spectra and pair distributions. For most observer angles, the pair synchrotron and split-photon spectra dominate the RICS primary spectra and produce complex polarization signals. In particular, the synchrotron spectra are highly polarized with degree 40%–80%, are softer than the RICS spectra, and may account for the high polarization of some magnetar spectra observed by the Imaging X-ray Polarimetry Explorer above 3 keV.

79 ASTRONOMY AND ASTROPHYSICS↗

Capturing Deuteration Effects in a Molecular Mechanics Force Field: Deuterated THF and the THF–Water Miscibility Gap

Deuteration is a common chemical modification used in conjunction with experiments such as neutron scattering, NMR, and Fourier-transform infrared for the study of molecular systems. Under the Born–Oppenheimer (BO) approximation, while the underlying potential energy surface remains unchanged by isotopic substitutions, isotopic substitution still alters intramolecular vibrations, which in turn may alter intermolecular interactions. Molecular mechanics (MM) force fields used in classical molecular dynamics simulations are assumed to represent local approximations of the BO potential energy surfaces, and hence, MD simulations using simple isotopic mass substitutions should capture BO-compatible isotope effects. However, standard MM force-field parameterizations do not directly fit to the local harmonic quantum mechanical (QM) Hessian that describes the BO surface, but rather to QM normal-modes and/or mass-dependent internal-coordinate derived distortion energies. In this study, using tetrahydrofuran (THF)–water mixtures as our model system, we show that not only does a simple mass-substitution approach fail to capture an experimentally characterized deuteration effect (the loss of the closed-loop miscibility gap associated with the complete deuteration of THF) but also it is necessary to generate new MM force-field parameters that correctly describe isotopic dependent vibrations to capture the experimental deuteration effect. We show that the origin of this failure is a result of using mass-dependent features to fit the THF MM force field, which unintentionally biases the bonded terms of the force field to represent only the isotopologue used during the original force-field parameterization. In addition, we make use of our isotopologue-corrected force field for D 8 THF to examine the molecular origins of the isotope-dependent loss of the THF–water miscibility gap.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning-Based Technique for Automated Sensor Characterization

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and prototyping phases. Nonetheless, detector characterization continues to be a major bottleneck in device development. During the testing phase, a significant time investment is required to characterize the device in different operating conditions and find optimal operating parameters. The total effort spent on characterization and parameter optimization can occupy a year or more of an expert s time. In this work, we present a novel technique for automated sensor calibration that aims to accelerate the testing stage of the development cycle. This technique leverages closed-loop Bayesian optimization (BO), using real-time measurements to guide parameter selection and identify optimal operating states. We demonstrate the method with a novel low-noise CCD, showing that the machine learning-driven tool can efficiently characterize and optimize operation of the sensor in a couple of days without supervision of a device expert.

Zepeda, Cuevas [Chicago U., KICP]↗

Automating Sensor Characterization with Bayesian Optimization

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and prototyping phases. Nonetheless, detector characterization continues to be a major bottleneck in device development. During the testing phase, a significant time investment is required to characterize the device in different operating conditions and find optimal operating parameters. The total effort spent on characterization and parameter optimization can occupy a year or more of an expert's time. In this work, we present a novel technique for automated sensor calibration that aims to accelerate the testing stage of the development cycle. This technique leverages closed-loop Bayesian optimization (BO), using real-time measurements to guide parameter selection and identify optimal operating states. We demonstrate the method with a novel low-noise CCD, showing that the machine learning-driven tool can efficiently characterize and optimize operation of the sensor in a couple of days without supervision of a device expert.

Cuevas-Zepeda, Julian [Chicago U., KICP; Chicago U↗

Report on Year-4 of Water NSTF Matrix Testing: Facility Maintenance and Accident Testing

Under support from the Department of Energy (DOE) and the Office of Advanced Reactor Technologies (ART), a large-scale test facility has been constructed at Argonne National Laboratory to generate NQA-1 qualified validation data for passive decay heat removal systems in advanced reactors. The Natural convection Shutdown heat removal Test Facility (NSTF) reflects key features of a ½ scale, water-based, Reactor Cavity Cooling System (RCCS) and is intended to study the behavior, bound performance, and ultimately guide design decisions for passive decay heat removal systems for advanced reactors. In addition to the experimental activities detailed in this report, a supportive computational modeling effort is on-going which has been demonstrated to significantly strengthen the experimental program while also improving accuracy of the computer models. Together these create a mutually beneficial relationship integral to meeting the overall program objective of examining the heat removal performance of the RCCS concept. This report serves as a summary of maintenance and experimental activities during the program’s fourth year of water-based operation. A planned six-month maintenance period began in August 2021, during which major inspections, repairs, cleaning, and installation of new instrumentation and data acquisition hardware were conducted. Most significantly, two heaters that faulted during Year-3 were repaired, allowing the facility to resume use of the full heated section area and full range of available electric power. The remainder of the year consisted of eight months of test operations, during which the facility logged 211 hours of active heating across one bake-out (following the maintenance period) and seven matrix tests; five classifieds as Accepted per NQA-1, one as Trending, and one as Failed. Testing began by performing two repeat cases to confirm expected facility response and behavior during both single- and two-phase flow conditions, ensuring no changes were introduced during the maintenance period that might have altered the thermal-hydraulic characteristics of the facility. In continuation of the power parametric series initiated in previous years, a high-power test case was then performed examining heat removal performance at a decay heat load equivalent to 2.4 MWt, full-scale, a level exceeding maximum design targets. Additional testing then introduced various blockage scenarios along the network piping, examining the effects of partial and complete blockages of the flow paths on the system behavior and heat removal performance. A study of static boiling tests directed at understanding the geysering two-phase instability was also conducted. The loop was filled only to the bottom of the tank outlet, creating an open loop configuration that prevents any natural circulation flow from occurring, and the heaters were powered on until the facility reached saturation conditions. Following, a series of quasi-steady-state conditions were introduced by adjusting the inventory level in the adiabatic chimney piping at decreasingly lower elevations above the heated region. A strong correlation of geysering characteristics and loop level was observed, with flow and temperature excursions decreasing in intensity, but increasing in frequency, as the fill were reduced to lower elevations along the chimney piping. Once the level fell very low in the chimney, at points near the top of the heated section, the system reached a stable state of continuous boiling without any occurrence of geysering eruptions. A final significant testing accomplishment this year was successful completion of an “accident scenario” test, whose operating conditions were based on a prototypic decay heat curve provided by Framatome and scaled for the NSTF. This test began by establishing steady-state, single-phase “normal operation” conditions, before simulating an accident trip where the availability of active cooling systems was lost. Loop temperatures gradually increased until reaching saturation and subsequent two-phase boiling flow. Over the course of an extended operational period along the defined decay heat curve, steam boil-off caused gradual but continued depletion of liquid inventory until reaching a critically low level causing flow stagnation and cessation of natural circulation heat removal. At this point, after nearly 72 hours of continuous operation, a cold refill was performed to replenish the system inventory and allow the facility to re-establish closed loop natural circulation flow and return to a safe operational state.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Closed-loop control of active nematic flows

Stabilizing and shaping autonomous flows of active fluids is a fundamental challenge and a prerequisite for applications. We embed a light-responsive microtubule-based nematic in a proportional-integral control loop that adjusts the applied light intensity in response to real-time measurements of the spatially averaged flow speed. The self-regulating hardware/software/wetware system maintains a target flow speed against external or internal perturbations, including protein aging and aggregation, sample-to-sample variability, and temperature variation. Varying the controller’s gains reveals antagonistic roles between feedback and intrinsic processes, leading to nontrivial dynamics observed in fluctuation spectra. In particular, oscillations emerge from the interplay between the controller, motor binding kinetics, and active hydrodynamic relaxation. Accounting for the underlying binding timescale, our coarse-grained model and nematohydrodynamics simulations corroborate these observations. This work provides insight into the coupled dynamics of controlled active matter, laying the foundation for spatiotemporal patterning of active stress to generate and stabilize new dynamical configurations.

Nishiyama, Katsu [Brandeis Univ., Waltham, MA (Uni↗

Closed-Loop Control of Active Nematic Flows

Stabilizing and shaping autonomous flows of active fluids is a fundamental challenge and a prerequisite for applications. We embed a light-responsive microtubule-based nematic in a proportional-integral control loop that adjusts the applied light intensity in response to real-time measurements of the spatially averaged flow speed. The self-regulating hardware-software-wetware system maintains a target flow speed against external or internal perturbations, including protein aging and aggregation, sample-to-sample variability, and temperature variation. Varying the controller’s gains reveals antagonistic roles between feedback and intrinsic processes, leading to nontrivial dynamics observed in fluctuation spectra. In particular, oscillations emerge from the interplay between the controller, motor binding kinetics, and active hydrodynamic relaxation. Accounting for the underlying binding timescale, our coarse-grained model and nematohydrodynamics simulations corroborate these observations. This work provides insight into the coupled dynamics of controlled active matter, laying the foundation for spatiotemporal patterning of active stress to generate and stabilize new dynamical configurations.

Active nematics↗

Final Scientific/Technical Report-FREE-piston Zero Emissions Refrigerator (FREEZER)

The FREE-piston Zero Emissions Refrigerator (FREEZER™) is a natural refrigerant Stirling-cycle cooler developed by AMSC in partnership with Heatcraft, targeted as a replacement refrigeration system for walk-in coolers or freezers found commonly in restaurants, convenience stores, supermarkets, etc. The FREEZER™, combined with a closed-loop CO2 heat-transfer system, had the goal to provides an efficient (Target COP = 1.4), zero ODP (Ozone Depletion Potential) and near zero GWP (Global Warming Potential) refrigeration solution with no synthetic, flammable, or toxic refrigerants. Other near zero GWP refrigeration systems do not exist at the scale and performance level of FREEZER. ARPA-E Continuation Funding enabled the design and fabrication of one Advanced Development Unit (ADU) cooler and two Field Test Unit (FTU) coolers, and a new revised Field Test Unit (new FTU). Heatcraft was to extensively test the various coolers at their facilities, which closely simulate real-world conditions. The original plan was to install and operate FREEZER FTUs alongside a traditional cooling solution at one or more customer locations to obtain data on direct performance comparisons with existing commercial refrigeration systems. Success in this FREEZER refinement and field-test project will establish the basis for a new class of environmentally friendly refrigeration systems that will revolutionize the industry. The hardware developed under the program is shown below in Figure 1. Five Stirling-cycle machines were built within the program, with a sixth cooler still under construction. The original DU and the ADU coolers met the performance target with a coefficient of performance (COP) of 1.2. The FTU was underperforming during the initial tuning of the free-piston Stirling cycle dynamics when there was a catastrophic failure of the fasteners on pressure boundary. This caused a pause to the program while the failure mechanism was investigated. The root cause was an inadequate flange design that allowed an excessive cyclic loading on the fasteners, leading to a fatigue failure. It was determined that existing FTU design could not be reasonably salvaged in a safe manner, and that fact, combined with the lower-than-expected performance of the new experimental heat exchanger modules lead to the design of the “new FTU” with a more conventional shell-and-tube heat exchanger design which should get close to the design target COP of 1.4, but have a higher overall machine cost. The program ran out of time before the fabrication of the new FTU was completed, but AMSC is still working on the cooler, with the majority of the parts fabricated, and hopes to have the unit under test sometime in early 2022, after which it will be shipped to Heatcraft for additional testing.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

FOCAL Campaign I: Advanced Wind Turbine Control Strategies

Campaign I of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aims to generate a dataset enabling the validation of aerodynamic performance of a scaled turbine mounted on a rigid tower in a fixed condition. The turbine considered in the FOCAL testing campaigns is the IEA-Wind 15MW Reference Wind Turbine. This scaled model is capable of simulating advanced blade-pitch control strategies in a high-quality wind field. The turbine is fully instrumented to record a variety of parameters in real time such as structural loads and dynamics. The test data considered was generated at the University of Maine's Harold Alfond Wind and Wave (W2) testing facility. The Load Cases (LC) considered in this testing campaign are as follows: LC 1.X - Constant wind and blade-pitch with varying rotor speeds LC 2.X - Constant wind and rotor speed with varying blade-pitch LC 3.X - Varying wind with active closed-loop control Detailed properties on the modeled system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaign I: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine. UMaine ASCC Report Number 23-40-1183. Details on the results of the verification and validation are found in the following reference: Mendoza, Nicole et al., "Verification and Validation of Model-Scale Turbine Performance and Control for the IEA Wind 15 MW Reference Wind Turbine," Energies, vol. 15, no. 20, 2022, https://doi.org/10.3390/en15207649.

17 WIND ENERGY↗

Evolution of dislocation loops in irradiated α-Uranium: An atomistically-informed cluster dynamics investigation

An atomistically-informed mean field cluster dynamics model has been developed to investigate the nucleation and growth of prismatic loops in irradiated a-Uranium. TEM analysis of neutron irradiated a-Uranium shows the evolution of self-interstitial atom and vacancy loops on (010) and (100) crystallographic planes, respectively, resulting in an anisotropic lattice swelling of its face-centered orthorhombic crystal. To provide model parameters, the crystallography of loops and the binding energy of point defects to these loops were studied using an angular dependent EAM potential and classical molecular dynamics (MD) simulations. Furthermore, using the bond-boost hyperdynamics method, the anisotropic diffusion of interstitials and vacancies in a-Uranium was investigated. Here, the mechanisms of point defect diffusion and the associated migration energies were reported and compared with previous DFT studies. The energetics and kinetic quantities mentioned above were used in the cluster dynamics model to predict the cluster density as a function of dose rate, dose and temperature and the results were compared to the reported neutron irradiation experiments. The model predictions reveal an accumulation of small sized vacancy loops along with a population of large and growing self-interstitial loops, which closely corresponds to the TEM observations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency

Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗