Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multiple building systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

CROCUS Tipping Bucket Rain Gauge Data from Argonne Deployable Mast Deployed at NEIU Carruthers Center for Inner City Studies (CCICS)

The Tipping Bucket Rain Gauge (TBRG) dataset contains data from a non-heated Met One 12-inch tipping bucket rain gauge that was mounted on the Argonne Deployable Mast (ADM). The ADM is a rapid deployable meteorological trailer that can be outfitted with instrumentation to measure urban heat island effects, urban flooding or urban flux measurements. During the urban flooding field campaign, the ADM was outfitted with multiple precipitation measurement systems, including the TBRG. This dataset contains one minute measurements for precipitation accumulation during the ADM's deployment at the Northeastern Illinois University (NEIU) Carruthers Center for Inner City Studies (CCICS) campus. These data are helpful for identifying periods of precipitation, leading to potential flooding. TBRGs can be used to validate optical rain gauge data and disdrometer data collected during the CROCUS urban flooding campaign. Data were collected at the CCICS building parking lot, located in the south side of Chicago, IL. The data is presented as daily NetCDF (.nc) files, each containing approximately 24 hours of observations. Files follow the naming convention of: the project (CROCUS), location (ADM-ccics), instrument name (tbrg), data level (raw, a1), and date (year, month, day). The NetCDF format can be accessed using common scientific software such as Python using xarray, netCDF4 or act-doe.

1-minute Precipitation Accumulation↗

Designing FAIR Workflows at OLCF: Building Scalable and Reusable Ecosystems for HPC Science

High Performance Computing (HPC) centers, such as the Oak Ridge Leadership Computing Facility (OLCF), provide advanced infrastructure that enables scientific research at extreme scale. These centers operate with unique hardware configurations, specialized software environments, and elevated security re quirements that differ substantially from what most users encounter on their local systems. As a result, users often develop customized digital artifacts that are tightly coupled to the specific configuration of a given HPC center. Although necessary, this practice can lead to significant duplication of effort as multiple users independently create similar solutions to common problems.

97 MATHEMATICS AND COMPUTING↗

Phonon-Mediated Quasiparticle Lifetime Renormalizations in Few-Layer Hexagonal Boron Nitride

Understanding the collective behavior of the quasiparticles in solid-state systems underpins the field of non-volatile electronics, including the opportunity to control many-body effects for well-desired physical phenomena and their applications. Hexagonal boron nitride (hBN) is a wide energy bandgap semiconductor, showing immense potential as a platform for lowdimensional device heterostructures. It is an inert dielectric used for gated devices, having a negligible orbital hybridization when placed in contact with other systems. Despite its inertness, we discover a large electron mass enhancement in few-layer hBN affecting the lifetime of the π-band states. We show that the renormalization is phonon-mediated and consistent with both single- and multiple-phonon scattering events. Our findings thus unveil a so-far unknown many-body state in a wide-bandgap insulator, having important implications for devices using hBN as one of their building blocks.

36 MATERIALS SCIENCE↗

Open Radiation Monitoring: Histogram Builder Module Design

The Open Radiation Monitoring Project seeks to develop and demonstrate a modular radiation detection architecture designed specifically for use in arms control treaty verification (ACTV) applications that will facilitate rapid development of trusted systems to meet the needs of potential future treaties. A modular architecture can be used to reduce more complex systems to a series of single purpose building blocks, thereby facilitating equipment inspection and in turn building trust in the equipment by all treaty parties. Furthermore, a modular architecture can be used to control data flow within the measurement system, reducing the risk of "hidden switches" and constraining the amount of sensitive information that could potentially be inadvertently leaked. This report details the first revision of a prototype circuit that will convert analog pulses directly into a histogrammed data set for further processing. The circuit was designed with both spectroscopy and multiplicity analysis in mind but can, in principle, be used to reduce any raw data stream into a histogram. The number of output channels is limited, and the histogram bin ranges are user configurable to allow for non-uniform and discontinuous bins, which makes it possible to restrict the information being passed down stream if desired. Pulse processing relies entirely on analog circuitry and non- programmable logic, which enables operation without the need for a central processor or other programmable control unit. The circuit remains untested under the Open Radiation Monitoring project due to the closure of the sponsoring program. However, further development and testing is scheduled to take place in support of a purpose-built trusted verification system development effort known as COGNIZANT, which demonstrates the potential benefit of developing a suite of modular trusted system components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of the Reliability of Passive Infrared (PIR) Occupancy Sensors for Residential Indoor Lighting

Solid-state lighting (SSL) technologies have penetrated the general illumination market in recent years, largely replacing conventional technologies such as incandescent and fluorescent lighting. Most of the initial excitement about light-emitting diode (LED) sources for SSL devices focused on their energy savings potential resulting from vast improvements in source efficiency and luminous efficacy compared with conventional illumination products. More recently, the focus has shifted toward other aspects of lighting application efficiency, namely intensity effectiveness and spectral efficiency, because of the ease of controlling both the light intensity of LEDs with drive voltage and the color properties of the LED-based illuminators. To capitalize on the energy savings of increased intensity effectiveness and spectral efficiency, a lighting control system (LCS) is often used. While the current penetration of LCSs is relatively modest, it is anticipated that lighting controls (i.e., connected lighting, controls and LED and conventional lighting) could have an installed penetration as higher as 46% by the year 2035, saving an additional 1.3 quads of energy. Despite the large energy savings that can be gained from using LCSs, standard test methods for evaluating sensors employed in LCSs and reliability data of the LCSs and their components are generally lacking. The National Electrical Manufacturers Association (NEMA) developed the only standard, NEMA WD 7-2011 (R2016), to test occupancy and motion sensor performance (herein referred to as “the NEMA protocol”). In a previous U.S. Department of Energy (DOE) effort, some concerns of the NEMA protocol were identified (e.g., strict height and weight limits on test subjects, large amounts of manual effort, sometimes inconsistent repeatability). During the current work, a consistent detection length test (DLT) and a Robotic Sensor Evaluation System (RoboSES) were developed to alleviate some of these concerns. RoboSES acts as a human surrogate by using thermal pads on a mannequin and a remote-controlled mobile base to test a sensor’s field of view (FOV). This report builds on the earlier DOE efforts to understand sensor technologies used in LCSs for general illumination. Specifically, this report describes the optimization of RoboSES, characterizes and establishes test methods to assess the reliability of multiple passive infrared (PIR) sensors, and reports the findings of robustness and reliability testing on two commercial PIR sensors intended for residential applications. The information presented in this report is gained from up to 4,000 hours (hrs) of accelerated stress tests (ASTs).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Advancing Geophysical Techniques to Image a Stratigraphic Hydrothermal Resource

Sedimentary-hosted geothermal energy systems are permeable structural, structural-stratigraphic, and/or stratigraphic horizons with sufficient temperature for direct use and/or electricity generation. Sedimentary-hosted (i.e., stratigraphic) geothermal reservoirs may be present in multiple locations across the central and eastern Great Basin of the USA, thereby constituting a potentially large base of untapped, economically accessible energy resources. Sandia National Laboratories has partnered with a multi disciplinary group of collaborators to evaluate a stratigraphic system in Steptoe Valley, Nevada using both established and novel geophysical imaging techniques. The goal of this study is to inform an optimized strategy for subsequent exploration and development of this resource and analogous ones. Building from prior Nevada Play Fairway Analysis (PFA), this team is primarily 1) collecting additional geophysical data, 2) employing novel joint geophysical inversion/modeling techniques to update existing 3D geologic models, and 3) integrating the geophysical results to produce a working, geologically constrained thermo-hydrological reservoir model. Prior PFA work highlights Steptoe Valley as a favorable resource basin that likely has both sedimentary and hydrothermal characteristics. However, there remains significant uncertainty on the nature and architecture of the resource(s) at depth, which increases the risk in exploratory drilling. Newly acquired gravity, magnetic, magnetotelluric, and controlled-source electromagnetic data products, in conjunction with new and preexisting geoscientific measurements and observations, are being integrated and evaluated for efficacy in understanding stratigraphic geothermal resources and mitigating exploration risk. Furthermore, the influence of hydrothermal activity on sedimentary-hosted reservoirs in favorable structural settings, and whether fault-controlled systems may locally enhance temperature and permeability in some deep stratigraphic reservoirs, will also be evaluated.

Geothermal, Sedimentary Heat, Geophysics, Seismic,↗

Development of a Unified Taxonomy for HVAC System Faults

Detecting and diagnosing HVAC faults is critical for maintaining building operation performance, reducing energy waste, and ensuring indoor comfort. An increasing deployment of commercial fault detection and diagnostics (FDD) software tools in commercial buildings in the past decade has significantly increased buildings’ operational reliability and reduced energy consumption. A massive amount of data has been generated by the FDD software tools. However, efficiently utilizing FDD data for ‘big data’ analytics, algorithm improvement, and other data-driven applications is challenging because the format and naming conventions of those data are very customized, unstructured, and hard to interpret. This paper presents the development of a unified taxonomy for HVAC faults. A taxonomy is an orderly classification of HVAC faults according to their characteristics and causal relations. The taxonomy includes fault categorization, physical hierarchy, fault library, relation model, and naming/tagging scheme. The taxonomy employs both a physical hierarchy of HVAC equipment and a cause-effect relationship model to reveal the root causes of faults in HVAC systems. A structured and standardized vocabulary library is developed to increase data representability and interpretability. The developed fault taxonomy can be used for HVAC system ‘big data’ analytics such as HVAC system fault prevalence analysis or the development of an HVAC FDD software standard. A common type of HVAC equipment-packaged rooftop unit (RTU) is used as an example to demonstrate the application of the developed fault taxonomy. Two RTU FDD software tools are used to show that after mapping FDD data according to the taxonomy, the meta-analysis of the multiple FDD reports is possible and efficient.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Natural Gas Community of the Future (Final Report)

Nicor Gas, a subsidiary of Southern Company Gas and its parent company Southern Company, is developing the concept of the Carbon-neutral, Affordable, Resilient, and Equitable Community ("CARE Community") to address the challenges of accessibility and affordability of grid-interactive efficient buildings in historically disadvantaged communities. The CARE Community is a new construction net-zero energy and carbon neutral residential neighborhood consisting of 50 homes with electricity and natural gas services in South Suburban Chicago, built as low-income affordable housing. The National Renewable Energy Laboratory (NREL) is assisting Southern Company to explore how energy efficiency, renewable technologies, and the reliability and resilience of natural gas can be combined and optimized in an islandable energy system as part of a broader effort to understand the role natural gas plays in future communities integrated with renewable energy and improved energy efficiency. The CARE Community will demonstrate how energy efficiency, distributed energy resources (DERs), and advanced controls can be combined with existing natural gas infrastructure to serve historically disadvantaged communities in a cold climate with low energy cost for affordable housing programs and enhanced resilience to withstand extreme weather. Homes will be a part of an islandable energy system, integrating multiple DER technologies such as solar panels, natural gas fuel cells, reciprocating natural gas engines, and battery storage. The CARE Community will provide a replicable template that affordable housing developers and energy companies can adopt throughout the United States. In this report, we present the design and modeling of the community and potential approaches for integrating DERs. We analyze and discuss annual simulations under normal operating conditions and week-long simulations under electric power grid outage conditions.

03 NATURAL GAS↗

The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on‐orbit close proximity operations

Abstract On‐orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on‐orbit assembly, repair, and astronaut assistance. Of these scenarios, on‐orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on‐orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free‐flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on‐orbit assembly and other scenarios require collision‐avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long‐horizon planning, accomplished using offline and online sampling‐based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information‐aware planning framework for on‐orbit reconfiguration model learning; and (3) connection with robust control tools to provide low‐level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on‐orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free‐flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free‐flyers will need to consider.

Robotics↗

Periplasmic biomineralization for semi-artificial photosynthesis

Semiconductor-based biointerfaces are typically established either on the surface of the plasma membrane or within the cytoplasm. In Gram-negative bacteria, the periplasmic space, characterized by its confinement and the presence of numerous enzymes and peptidoglycans, offers additional opportunities for biomineralization, allowing for nongenetic modulation interfaces. We demonstrate semiconductor nanocluster precipitation containing single- and multiple-metal elements within the periplasm, as observed through various electron- and x-ray-based imaging techniques. The periplasmic semiconductors are metastable and display defect-dominant fluorescent properties. Unexpectedly, the defect-rich (i.e., the low-grade) semiconductor nanoclusters produced in situ can still increase adenosine triphosphate levels and malate production when coupled with photosensitization. We expand the sustainability levels of the biohybrid system to include reducing heavy metals at the primary level, building living bioreactors at the secondary level, and creating semi-artificial photosynthesis at the tertiary level. The biomineralization-enabled periplasmic biohybrids have the potential to serve as defect-tolerant platforms for diverse sustainable applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Approximate Inverse Chain Preconditioner: Iteration Count Case Study for Spectral Support Solvers

As the growing availability of computational power slows, there has been an increasing reliance on algorithmic advances. However, faster algorithms alone will not necessarily bridge the gap in allowing computational scientists to study problems at the edge of scientific discovery in the next several decades. Often, it is necessary to simplify or precondition solvers to accelerate the study of large systems of linear equations commonly seen in a number of scientific fields. Preconditioning a problem to increase efficiency is often seen as the best approach; yet, preconditioners which are fast, smart, and efficient do not always exist. Following the progress of [1], we present a new preconditioner for symmetric diagonally dominant (SDD) systems of linear equations. These systems are common in certain PDEs, network science, and supervised learning among others. Based on spectral support graph theory, this new preconditioner builds off of the work of [2], computing and applying a V-cycle chain of approximate inverse matrices. This preconditioner approach is both algebraic in nature as well as hierarchically-constrained depending on the condition number of the system to be solved. Due to its generation of an Approximate Inverse Chain of matrices, we refer to this as the AIC preconditioner. We further accelerate the AIC preconditioner by utilizing precomputations to simplify setup and multiplications in the con-text of an iterative Krylov-subspace solver. While these iterative solvers can greatly reduce solution time, the number of iterations can grow large quickly in the absence of good preconditioners. Initial results for the AIC preconditioner have shown a very large reduction in iteration counts for SDD systems as compared to standard preconditioners such as Incomplete Cholesky (ICC) and Multigrid (MG). We further show significant reduction in iteration counts against the more advanced Combinatorial Multigrid (CMG) preconditioner. We have further developed no-fill sparsification techniques to ensure that the computational cost of applying the AIC preconditioner does not grow prohibitively large as the depth of the V-cycle grows for systems with larger condition numbers. Our numerical results have shown that these sparsifiers maintain the sparsity structure of our system while also displaying significant reductions in iteration counts.1 2

97 MATHEMATICS AND COMPUTING↗

Approximate Inverse Chain Preconditioner: Iteration Count Case Study for Spectral Support Solvers

As the growing availability of computational power slows, there has been an increasing reliance on algorithmic advances. However, faster algorithms alone will not necessarily bridge the gap in allowing computational scientists to study problems at the edge of scientific discovery in the next several decades. Often, it is necessary to simplify or precondition solvers to accelerate the study of large systems of linear equations commonly seen in a number of scientific fields. Preconditioning a problem to increase efficiency is often seen as the best approach; yet, preconditioners which are fast, smart, and efficient do not always exist. Following the progress of [1], we present a new preconditioner for symmetric diagonally dominant (SDD) systems of linear equations. These systems are common in certain PDEs, network science, and supervised learning among others. Based on spectral support graph theory, this new preconditioner builds off of the work of [2], computing and applying a V-cycle chain of approximate inverse matrices. This preconditioner approach is both algebraic in nature as well as hierarchically-constrained depending on the condition number of the system to be solved. Due to its generation of an Approximate Inverse Chain of matrices, we refer to this as the AIC preconditioner. We further accelerate the AIC preconditioner by utilizing precomputations to simplify setup and multiplications in the con-text of an iterative Krylov-subspace solver. While these iterative solvers can greatly reduce solution time, the number of iterations can grow large quickly in the absence of good preconditioners. Initial results for the AIC preconditioner have shown a very large reduction in iteration counts for SDD systems as compared to standard preconditioners such as Incomplete Cholesky (ICC) and Multigrid (MG). We further show significant reduction in iteration counts against the more advanced Combinatorial Multigrid (CMG) preconditioner. We have further developed no-fill sparsification techniques to ensure that the computational cost of applying the AIC preconditioner does not grow prohibitively large as the depth of the V-cycle grows for systems with larger condition numbers. Our numerical results have shown that these sparsifiers maintain the sparsity structure of our system while also displaying significant reductions in iteration counts.1 2

97 MATHEMATICS AND COMPUTING↗

Interpretation of multiple solutions in fully iterative GF2 and GW schemes using local analysis of two-particle density matrices

Due to the presence of non-linear equations, iterative Green’s function methods can result in multiple different solutions even for simple molecular systems. In contrast to the wave-function methods, a detailed and careful analysis of such molecular solutions was not performed before. In this work, we use two-particle density matrices to investigate local spin and charge correlators that quantify the charge resonance and covalent characters of these solutions. When applied within the unrestricted orbital set, spin correlators elucidate the broken symmetry of the solutions, containing necessary information for building effective magnetic Hamiltonians. Based on GW and GF2 calculations of simple molecules and transition metal complexes, we construct Heisenberg Hamiltonians, four-spin-four-center corrections, and biquadratic spin–spin interactions. These Hamiltonian parameterizations are compared to previous wave-function calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak

Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.

integrated data analysis↗

Modular Autonomous Experimentation for Biological Applications

The Modular Autonomous Research System (MARS) was created to address a key challenge in scientific discovery: experiments are often slow, require significant manual labor, and generate data that is not easily integrated across different tools. This limits how quickly scientists can explore new materials, processes, and chemical reactions. Our motivation was to design a system that makes research faster, more reliable, and adaptable by combining automation with artificial intelligence. By doing so, we aimed to reduce human error, accelerate discovery, and allow researchers to quickly test many possibilities that would otherwise take months or years. Our approach was to build a flexible platform that connects laboratory robots, measurement instruments, and a central data system, all guided by artificial intelligence. MARS integrates liquid handling robots, robotic arms, and plate readers with an intelligent decision-making system that chooses the most informative experiments to run next. This creates a closed loop where experiments are performed automatically, the data is analyzed in real time, and new conditions are immediately tested. Through this work, we demonstrated that MARS can carry out multiple experiments with little or no human intervention, adapt to different scientific problems, and handle uncertain or noisy measurements in a robust way. The results show that modular and intelligent automation can significantly accelerate the pace of discovery, providing a model for future self-driving laboratories. This approach addresses the growing scientific need for adaptable, data-driven research platforms that can keep up with the complexity and scale of modern science.

59 BASIC BIOLOGICAL SCIENCES↗

Game Theoretic Orchestration for Cooperation among Power Distribution System Applications

The evolving transformation with the proliferation of distributed energy resources and advanced metering, necessitates advanced distribution systems to integrate and orchestrate a large number of grid-edge devices while also serving multiple system-level objectives such as resilience, decarbonization, equity and other system mandates. The parallel deployment and control of resources towards achieving diverse objectives may lead to conflicts between applications that want to control overlapping sets of device setpoints, potentially leading to oscillatory behavior and suboptimal performance. This work aims at leveraging game theoretic framework to drive cooperative behavior among competitive applications. The work proposes a weighted-consensus based game design to facilitate conflict resolution through consensus-building iterations for modular platform. Simulation-based evaluation on a sample test system demonstrates the performance the proposed deconfliction strategy in resolving operational conflicts and achieving close-to-optimal trade off among the applications. Results also compare the proposed strategy with a distribution optimization approach and illustrate it effectiveness in diverse apps regardless of their design while also incentivizing apps with flexible design.

Advanced distribution operations, cooperation, app↗

Role of reinforcement learning for risk-based robust control of cyber-physical energy systems

Critical infrastructures such as cyber-physical energy systems (CPS-E) integrate information flow and physical operations that are vulnerable to natural and targeted failures. Safe, secure, and reliable operation and control of CPS-E is critical to ensure societal well-being and economic prosperity. Automated control is key for real-time operations and may be mathematically cast as a sequential decision-making problem under uncertainty. Emergence of data-driven techniques for decision making under uncertainty, such as reinforcement learning (RL), have led to promising advances for addressing sequential decision-making problems for risk-based robust CPS-E control. However, existing research challenges include understanding the applicability of RL methods across diverse CPS-E applications, addressing the effect of risk preferences across multiple RL methods, and development of open-source domain-aware simulation environments for RL experimentation within a CPS-E context. This article systematically analyzes the applicability of four types of RL methods (model-free, model-based, hybrid model-free and model-based, and hierarchical) for risk-based robust CPS-E control. Problem features and solution stability for the RL methods are also discussed. We demonstrate and compare the performance of multiple RL methods under different risk specifications (risk-averse, risk-neutral, and risk-seeking) through the development and application of an open-source simulation environment. Motivating numerical simulation examples include representative single-zone and multizone building control use cases. Finally, six key insights for future research and broader adoption of RL methods are identified, with specific emphasis on problem features, algorithmic explainability, and solution stability.

24 POWER TRANSMISSION AND DISTRIBUTION↗