Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Using Reinforcement Learning to Optimize Quantum Circuits in thePresence of Noise

Many quantum computing frameworks currently use noise aware algorithms for implementing quantum circuits which do not scale efficiently as the size of the hardware architecture increases. As we move towards devices which utilize more qubits, it becomes increasing more important to map quantum circuits in a way that uses resources efficiently as well as maximizes the reliability of the results of that circuit. However, as the hardware increases to the point where Quantum supremacy is attainable, it will infeasible for a brute-force algorithm to find the most optimal circuit layout for circuits of medium to large depth sizes. To this end, we will to rely on reinforcement learning (RL) as a method of building quantum circuits based on observations of the noise characteristics in its environment. In this work, we create a working reinforcement learning environment in which an agent is able to make action which will build the class of circuits which creates the GHZ state. In addition to this, we also get preliminary results of the performance of a Deep Q Neural Network, which initially does not perform as well as we believe it can. In the future, we want to improve the performance of the agent and potentially generalize this environment to more classes of circuits.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Redox Stability Controls the Cellular Uptake and Activity of Ruthenium-Based Inhibitors of the Mitochondrial Calcium Uniporter (MCU)

The mitochondrial calcium uniporter (MCU) is the ion channel that mediates Ca 2+ uptake in mitochondria. Inhibitors of the MCU are valuable as potential therapeutic agents and tools to study mitochondrial Ca 2+ . The best-known inhibitor of the MCU is the ruthenium compound Ru360. Although this compound is effective in permeabilized cells, it does not work in intact biological systems. We have recently reported the synthesis and characterization of Ru265, a complex that selectively inhibits the MCU in intact cells. In this work, the physical and biological properties of Ru265 and Ru360 are described in detail. Using atomic absorption spectroscopy and X-ray fluorescence imaging, we show that Ru265 is transported by organic cation transporter 3 (OCT3) and taken up more effectively than Ru360. As an explanation for the poor cell uptake of Ru360, we show that Ru360 is deactivated by biological reductants. These data highlight how structural modifications in metal complexes can have profound effects on their biological activities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗

Optimizing Long Term Hydrogen Fueling Infrastructure Plans on Freight Corridors for Heavy Duty Fuel Cell Electric Vehicles

The development of a future hydrogen energy economy will require the development of several hydrogen market and industry segments including a hydrogen based commercial freight transportation ecosystem. For a sustainable freight transportation ecosystem, the supporting fueling infrastructure and the associated vehicle powertrains making use of hydrogen fuel will need to be co-established. This paper develops a long-term plan for refueling infrastructure deployment using the OR-AGENT (Optimal Regional Architecture Generation for Electrified National Transportation) tool developed at the Oak Ridge National Laboratory, which has been used to optimize the hydrogen refueling infrastructure requirements on the I-75 corridor for heavy duty (HD) fuel cell electric commercial vehicles (FCEV). This constraint-based optimization model considers existing fueling locations, regional specific vehicle fuel economy and weight, vehicle origin and destination (OD), vehicle volume by class and infrastructure costs to characterize in-mission refueling requirements for a given freight corridor. The authors applied this framework to determine the ideal long term public access locations for hydrogen refueling (constrained by existing fueling stations and dispensing technology), the minimal viable cost to deploy sufficient hydrogen fuel dispensers, and associated equipment, to accommodate a growing population of hydrogen fuel cell trucks. So the framework discussed in this paper can be expanded and applied to additional electrified powertrains as well as a larger interstate system, expanded regional corridor, or other transportation networks.

08 HYDROGEN↗

Laboratory-Scale Coal-Derived Graphene Process (Final Report)

The Energy & Environmental Research Center (EERC) conducted a laboratory-scale coal-derived graphene (CDG) project focused on developing a technological process for making graphene from four U.S. domestic coal or coal wastes, including lignite from North Dakota, subbituminous coal from Wyoming, bituminous coal from Utah, and anthracite from Pennsylvania. The project was divided into two performance or budget periods (BPs), with BP1 comprising the up-front laboratory experiments to make graphene materials from coal beginning on May 1, 2020, to April 30, 2022. BP2 was conducted from May 1, 2022, to April 30, 2023, and was focused on analyzing the CDG process economic feasibility and the technical gaps for technological scale-up and commercialization. During this project, a few different coal-derived high-value products have been demonstrated, including graphite, graphene oxide (GO), reduced graphene oxide (rGO), and graphene quantum dots (GQDs). A new graphite microstructure was discovered and named “croissant graphite” because of the exterior morphological and textural resemblance to croissant food items sold in commercial groceries stores. The new graphite structure and the associated preparation from coal or coal waste feedstocks has been the subject of a U.S. patent application. The systematic experimental processes involving coal cleaning, upgrading, and conversion to high-value carbon products culminated into a developed upgraded coal-to-products (UCP) technology that is being pursued for potential fast-track commercialization, if funding is available. It is envisioned that commercialization of the UCP technology would increase consumption of U.S. domestic coals or coal wastes to make environmentally sustainable high-value products for the electronics industry, high-energy-storage applications, and clean energy technologies such as electric vehicle (EV) lithium-ion batteries (LIBs), for which graphite has become a critical mineral commodity. Croissant graphite microstructures, when observed by field emission scanning electron microscopy (FESEM), display wavy surface morphology and often grow from a base that is made of graphitized particles with honeycomb-like layers, which are believed to be graphene layers. While more studies are needed to fully ascertain the mechanisms of the croissant graphite microstructure formation, it is postulated that their growth may begin from curling of the graphene sheets into ribbon-like structures, and continuous growth and densification of the ribbon-like structures forms croissant microstructures. Additional studies are ongoing to evaluate the electrochemical performance of croissant graphite for LIB applications and to determine the experimental conditions necessary to tune on/off croissant formation so that it can be either optimized or suppressed depending on performance evaluation results. In addition to the discovery of croissant graphite, the graphitization process from the four coal ranks in general was successful. X-ray diffraction (XRD) analysis showed that the degree of graphitization (DoG) ranged from 12% to 80% in an early sample set, and further optimization on lignite coal produces a DoG of about 92%, which was spectacular to see as lignite is the lowest-rank coal. Thus, it is expected that the graphitization performance for higher-rank coals will be similar or better when optimized as well. The coal-derived graphite was used to make GO and rGO. Analytical characterization, e.g., by methods such as Raman spectroscopy, XRD, Fourier transform infrared (FTIR) spectroscopy and FESEM, showed that the sequence of converting the coal to graphite, exfoliating it to GO, and then chemically reducing the GO to rGO was successful. Although coal naturally contains aromatic compounds and some relatively small-sized condensed aromatic units, it does not contain graphene sheets. In the UCP process, the aromatic domains in the coals, particularly low-rank coals, are concentrated and condensed further into graphene sheets, which are ordered into a 3D stack during graphitization. The synthesized graphite is then unpacked by methods such as exfoliation to various graphene products. GQDs were synthesized from all four coal types, and their optical properties were demonstrated to be tunable by the coal precursor preprocessing treatments. In all four coal types, enhanced optical properties were observed for the produced GDQs with incremental improvements made to the coal precursors. GQDs produced from raw coal samples displayed lower ultraviolet–visible (UV–Vis) spectroscopy absorbance intensity compared to those obtained from cleaned and upgraded coal residues. The photoluminescence (PL) intensities also varied with pretreatment conditions and with the concentration of GQDs in aqueous solutions. GQDs obtained from anthracite show longer emission wavelengths and can be excited by visible light as opposed to GQDs derived from the other coal ranks. UV fluorescence 3D maps and spectra revealed that the emission wavelength at which the GQDs solutions display the highest intensity was slightly redshifted based on the coal precursor pretreatments. In low-rank coal (lignite and subbituminous) samples, two clusters were observed in the maps for GQDs, which may suggest that there are potentially two types of fluorophores in solution or two main size populations. The ability to tune the properties of GQDs based on processing methods can be exploited to make GQDs for various optical display or optoelectronics applications. The results also highlight the importance of removing coal-borne impurities to improve the quality of the coal precursor for preparation of graphene products. Coal and/or coal wastes preprocessing methods were developed and applied to clean and upgrade the coal precursors prior to graphitization and subsequent conversion to graphene products. The preprocessing methods involve high specific-gravity separations, mineral acid cleaning (no hydrofluoric acid), and subsequent upgrading by reducing the coal-borne heteroatom (nitrogen, sulfur, and oxygen) content using proprietary chemical agents. Analytical characterization revealed that the preprocessing steps were successful, with ash reductions that range from 38% to 80% and residual ash content that was below the 5 wt% initial target. Based on proximate and ultimate analysis, the heteroatom reduction reactions produced upgraded coal residues with the oxygen content reduced by 8% to 24%, with additional reductions in the nitrogen and sulfur contents. An initial assessment of the waste streams from the UCP process shows very small to negligible environmental impact due to CO 2 , NO x , and SO x because most process steps are performed under inert atmosphere with argon. Consequently, reactive oxygen environments that tend to create these species are avoided. The inorganic and potentially hazardous species are released into aqueous waste streams that are easy to handle for proper disposal. The liquid waste streams were found to contain low-level concentrations of rare-earth elements (REEs), which could be concentrated and recovered as value-added by-products. Additionally, the volatile and gaseous fractions from carbonization and heat treatment contain useful organic compounds that can also be recovered as potential valuable by-products. Thus, the UCP technology is considered an environmentally sustainable and promising emerging technology for making high-value products from coal and coal wastes, with potential additional value-added by-products. Analysis of potential markets for the coal-derived carbon products shows a strong demand in both niche market sectors and across a wide variety of other industrial sectors. Graphite is currently considered a critical mineral commodity that has a large and growing demand in the LIB industry for EV applications. Based on data from Fortune Business Insights (2022) and Marketwatch (2023) reports, the average global graphite market is projected to reach about 33 billion by 2028, growing at a compound annual growth rate (CAGR) of about 7%, with much of this growth expected to be in the LIB industry. GO and rGO have strong market potentials in various application areas, such as coatings for anticorrosion, anti-icing, and antimicrobial protection, thermal barriers, wear resistance, sensors, additive manufacturing such as 3D inks, and others. GQDs are the emerging key player in the bioimaging, photovoltaics, and light-emitting diodes (LEDs) applications, with the potential to replace traditional semiconductor quantum dots (SQDs), which are based on metallic systems that are more toxic and more expensive. Biomedical applications of GQDs are becoming more attractive because of low to no toxicity and extremely low cost compared to SQDs. The major challenges for scale-up and commercialization of coal-derived carbon products such as graphene vary from the inherent attributes of graphene itself to reluctance to accept graphene in new manufacturing processes because of the uncertainty of the unknown. The 2D nature of graphene materials with a thickness of one atom presents significant challenges to proper handling/processing, and process scale-up becomes difficult because it requires high-end, expensive equipment, even for routine handling and analysis for quality assurance and control. Pristine graphene can also be extremely difficult to work into other matrices, thus hindering downstream processibility, especially at large scale. Currently, the cost of graphene and graphene products is still high and presents an economic risk that tends to slow down investment in scaling up emerging technologies. The lack of a standard for graphene materials for quality assurance and quality control poses a great challenge not only for the markets but also for commercialization efforts. A first-look economic feasibility analysis of the UCP technology provided valuable information that suggests the UCP process would be feasible, especially when it is scaled to a pilot scale and could be more competitive at the full scale. Graphitization was found to be the most energy-consuming and most capital-intensive step in the overall process. In small laboratory- and bench-scale experiments, labor is a significant contributor to the total process costs. Although these energy, capital, and labor constraints contribute to a higher selling price for the product, a preliminary economic model suggests that the process would be feasible at large scale when the process is fully integrated, optimized, and automated.

01 COAL, LIGNITE, AND PEAT↗

Redox Stability Controls the Cellular Uptake and Activity of Ruthenium‐Based Inhibitors of the Mitochondrial Calcium Uniporter (MCU)

Abstract The mitochondrial calcium uniporter (MCU) is the ion channel that mediates Ca 2+ uptake in mitochondria. Inhibitors of the MCU are valuable as potential therapeutic agents and tools to study mitochondrial Ca 2+ . The best‐known inhibitor of the MCU is the ruthenium compound Ru360. Although this compound is effective in permeabilized cells, it does not work in intact biological systems. We have recently reported the synthesis and characterization of Ru265, a complex that selectively inhibits the MCU in intact cells. Here, the physical and biological properties of Ru265 and Ru360 are described in detail. Using atomic absorption spectroscopy and X‐ray fluorescence imaging, we show that Ru265 is transported by organic cation transporter 3 (OCT3) and taken up more effectively than Ru360. As an explanation for the poor cell uptake of Ru360, we show that Ru360 is deactivated by biological reductants. These data highlight how structural modifications in metal complexes can have profound effects on their biological activities.

Woods, Joshua J.↗

Facile microwave synthesis of zirconium metal-organic framework thin films on gold and silicon and application to sensor functionalization

Zirconium-based metal-organic frameworks, including UiO-66 and related frameworks, have become the focus of considerable research in the area of chemical warfare agent (CWA) decontamination. However, little work has been reported exploring these metal-organic frameworks (MOFs) for CWA sensing applications. For many sensing approaches, the growth of high-quality thin films of the active material is required, and thin film growth methods must be compatible with complex device architectures. Several approaches to synthesize thin films of UiO-66 have been described but many of these existing methods are complex or time consuming. In this work, we describe the development of a simple and rapid microwave assisted synthesis of oriented UiO-66 thin films on unmodified silicon (Si) and gold (Au) substrates. Thin films of UiO-66 and UiO-66-NH 2 can be grown in as little as 2 min on gold substrates and 30 min on Si substrates. The film morphology and orientation are characterized and the effects of reaction time and temperature on thin film growth on Au are investigated. Both reaction time and temperature impact the overgrowth of protruding discrete crystallites in the thin film layer but, surprisingly, no strong correlation is observed between film thickness and reaction time or temperature. We also briefly describe the synthesis of Zr/Ce solid solution thin films of UiO-66 on Au and report the first synthesis of a solid solution thin film MOF. Finally, we demonstrate the utility of the microwave method for the facile functionalization of two sensor architectures, plasmonic nanohole arrays and microresonators, with UiO-66 thin films.

36 MATERIALS SCIENCE↗

Circular olefin copolymers made de novo from ethylene and α-olefins

Ethylene/α-olefin copolymers are produced in huge scale and widely used, but their after-use disposal has caused plastic pollution problems. Their chemical inertness made chemical re/upcycling difficult. Ideally, PE materials should be made de novo to have a circular closed-loop lifecycle. However, synthesis of circular ethylene/α-olefin copolymers, including high-volume, linear low-density PE as well as high-value olefin elastomers and block copolymers, presents a particular challenge due to difficulties in introducing branches while simultaneously installing chemical recyclability and directly using industrial ethylene and α-olefin feedstocks. Here we show that coupling of industrial coordination copolymerization of ethylene and α-olefins with a designed functionalized chain-transfer agent, followed by modular assembly of the resulting AB telechelic polyolefin building blocks by polycondensation, affords a series of ester-linked PE-based copolymers. These new materials not only retain thermomechanical properties of PE-based materials but also exhibit full chemical circularity via simple transesterification and markedly enhanced adhesion to polar surfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Swing Contract-Based Valuation for Distributed Energy Resources in Transactive Energy Systems: A Reinforcement Learning Approach

With the proliferation of distributed energy resources (DERs) and power grids with high fractions of renewable energy, market constructs are evolving to allow DERs to participate in multiple possible markets, at different levels of grid hierarchy. The effective participation of DERs in market environments is aided by swing contract-based pricing mechanisms, whereby DERs have a two-part compensation structure – one for their reservation/commitment and another for performancedriven ex-post payment for their actual mobilization during dispatch. In this paper, we propose a reinforcement learningbased (Q-learning) approach that allows a rational DER agent to select the market it wants to participate in within a composite market environment where individual markets are coordinated by possibly different actors. The proposed Q-learning framework aids DERs in their self-valuation by implicitly maximizing their own payoff through market participation, assuming a swing contract-based compensation structure. We complement our work through simulation-based investigations where factors affecting the DER decision making process, such as parametric uncertainties in market (and grid) environments, are studied.

Naqvi, Syed Ahsan Raza↗

A microCT-based platform to quantify drug targeting

Abstract Background Heterotopic ossification (HO) is a frequent and debilitating complication of traumatic musculoskeletal injuries and orthopedic procedures. Prophylactic dosing of botulinum toxin type A (BTxA) holds potential as a novel treatment option if accurately distributed throughout soft-tissue volumes where protection is clinically desired. We developed a high-resolution, microcomputed tomography (microCT)-based imaging strategy to assess drug distribution and validated this platform by quantifying distribution achieved via a prototype delivery system versus a single-bolus injection. Methods We injected an iodine-containing contrast agent (iodixanol 320 mg I/mL) into dissected rabbit musculature followed by microCT imaging and analysis. To contrast the performance of distributed versus bolus injections, a three-dimensional (3D) 64-cm 3 -printed soft-tissue holder was developed. A centered 2-cm 3 volume of interest (VOI) was targeted with a single-bolus injection or an equal volume distributed injection delivered via a 3D-printed prototype. VOI drug coverage was quantified as a percentage of the VOI volume that was < 1.0 mm from the injected fluid. Results The microCT-based approach enabled high-resolution quantification of injection distribution within soft tissue. The distributed dosing prototype provided significantly greater tissue coverage of the targeted VOI (72 ± 3%, mean ± standard deviation) when compared to an equal volume bolus dose (43 ± 5%, p = 0.031) while also enhancing the precision of injection targeting. Conclusions A microCT-based imaging technique precisely quantifies drug distribution within a soft-tissue VOI, providing a path to overcome a barrier for clinical translation of prophylactic inhibition of HO by BTxA. Relevance statement This platform will facilitate rapid optimization of injection parameters for clinical devices used to effectively and safely inhibit the formation of heterotopic ossification. Key points • MicroCT provides high-resolution quantification of soft-tissue drug distribution. • Distributed dosing is required to maximize soft-tissue drug coverage. • Imaging platform will enable rapid screening of 3D-printed drug distribution prototypes. Graphical Abstract

Ausk, Brandon J. (ORCID:0000000335338303)↗

Evaluation of a high-throughput method for processing sponge-stick samples to detect viable, non-spore-forming biothreat agents

After a bioterrorism incident, surface sampling is often used to determine the extent of contamination and exposure, guiding decontamination efforts and decisions for re-occupancy of affected sites. The sponge-stick (SS) is a preferred and commonly used device for sample collection to detect both spore-forming and non-spore-forming biothreat agents from non-porous surfaces. Here, in this study, a recently developed high-throughput method (HTM) for processing SS samples to detect viable Bacillus anthracis spores was adapted for detection of non-spore-forming biothreat agents, Yersinia pestis and Francisella tularensis. The scalable HTM was used to process up to 20 SS samples simultaneously, compared to the current stomacher-based method which processes one SS at a time. Comparisons of the HTM and the stomacher-based method were statistically indistinguishable for most experiments (P > 0.05) with HTM recoveries of 37–60 % for Y. pestis inoculated at 102–103 cells/SS and held 48 h at 4 °C to mimic sample transport/storage. The HTM was integrated with Rapid Viability-Polymerase Chain Reaction (RV-PCR) analysis to detect viable Y. pestis in the presence of particulate contamination (Arizona Test Dust, ATD). This approach detected Y. pestis inoculated at 20 cells/SS and ATD did not impact detection (P > 0.05). F. tularensis showed significantly lower recoveries between no-hold time and 48-h hold time (4 °C, P < 0.05) using the HTM, which further testing showed could be due to toxicity of the neutralizing buffer used for SS pre-wetting. With modifications, this method could enhance throughput capacity while maintaining similar recovery efficiencies to current methods for other non-spore-forming bacterial pathogens.

Biological and medical sciences↗

Mucus-Inspired Tribology, a Sticky Yet Flowing Hydrogel

The mucus blanket can trap foreign particles before they enter the lungs, while at the same time, it flows up to remove these particles. This manifests the dual nature of mucus: sticky, on one hand, and fluid, on the other. Inspired by this function of mucus in the lungs, we designed a mucus simulant which emulates this dual nature. While many existing mucus simulants do not target bioadhesion particularly, poly(vinyl alcohol) (PVA)-based simulants make an exception. Despite their bioadhesion tendency, unlike mucus, they do not gelate. In this study, we added a physical cross-linking agent to PVA in order to add the gelation aspect and to better represent mucous properties. We show that the resultant mucus simulant develops into two regions: a highly sticky region near the surface of a foreign object (we used hydrophobized silicon to mimic the foreign object) and a fluid region far away from that surface. We show that the sticky part can slide past the less sticky part, while the foreign object is stuck to it. However, this mechanism changes with time. At short gelation times, this tendency to separate into two parts is enhanced and the foreign object remains stuck, while the rest of the gel flows. With time, the force required to allow the sticky part to slide over the fluid part is further reduced. However, if the gelation is allowed to proceed for even longer times without disturbance, the force required to slide the two parts past each other increases and the separation between the two parts is inhibited. The hydrogel becomes a sticky goo, which requires a higher force to move or unclog if placed in a duct (much like what happens with mucus in the tracheal duct). We explain the physics of our findings in terms of a competition between the tendency of the polymer to form a gel network and the tendency of the polymer to adsorb onto the foreign object.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Commodity Thermoplastic Elastomer-Enabled Templated Synthesis of Large-Pore Ordered Mesoporous Materials

Fabrication of ordered mesoporous materials (OMMs) has predominantly relied on templating-based methods. However, these methods are constrained by several limitations, especially the limited pore sizes attainable with commercially available surfactants used as structure-directing agents. To unlock the full potential of the OMMs, it is essential to develop synthetic strategies that facilitate the production of large-pore OMMs using scalable processes and cost-effective precursors. This work demonstrates the use of thermoplastic elastomer (TPE)-derived carbon replicas for synthesizing ordered mesoporous silica (OMS) and metal oxides (OMMOs) via precursor infiltration and template removal. The nanostructural evolution of the resulting inorganic materials was systematically investigated. Specifically, using tetraethyl orthosilicate (TEOS) as a silica precursor, this method can produce an OMS with relatively large pores. To establish the generalizability of this process, the fabrication approach was extended to other commercially available TPEs with varied chemical compositions and molecular weights while consistently resulting in ordered structures. Additionally, this synthetic strategy can be successfully applied to the production of OMMOs, including tin and titanium oxide matrix chemistries, yielding pore sizes of 16.0 and 19.2 nm, respectively. By developing a general method and using low-cost precursors, this work presents a scalable approach for fabricating large-pore OMMs with tunable pore textures and matrix chemistries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗

Safe Deep Reinforcement Learning for Robust Frequency and Voltage-Constrained Networked Microgrid Restoration

Here, this paper proposes a safe soft actor-critic reinforcement learning (RL) algorithm–based controller for networked microgrid restoration. It formulates the post black-start start as a finite-horizon constrained Markov decision process. The RL agent co-optimizes real and reactive power set-points for both grid-forming and grid-following inverters under explicit voltage and frequency constraints, while enforcing proper power sharing via the Mean Active Power Sharing Index (MPSI) and Mean Reactive Power Sharing Index (MQSI). Numerical results obtained on the IEEE 123-bus distribution system show that the proposed method achieves a mean voltage build-up time of 0.01 s without breaching the 5% sharing-violation budget under various load scenarios, considering MPSI and MQSI indices. These findings demonstrate that the proposed method yields fast and safe black-start schedules without resorting to heuristic penalties.

Selim, Alaa [Dartmouth College, Hanover, NH (Unite↗

BrickQA: Bridging the Semantic Gap in Building Operations with Dynamic Graph Exploration

While standardized ontologies like the Brick schema address data heterogeneity in Building Automation Systems (BAS), accessing this semantic data remains a challenge as domain experts often lack the expertise to formulate complex SPARQL queries. To bridge this gap, we present BrickQA, a Large Language Model (LLM)-based framework that translates natural language into executable SPARQL queries through structured query decomposition, dynamic schema exploration, and inline validation. BrickQA utilizes an iterative reasoning agent to actively navigate graph topology through dynamic exploration actions without requiring exhaustive context injection or model fine-tuning. This approach effectively mitigates hallucinations, particularly in large-scale building knowledge graphs. Empirical evaluation on BuildingQA, a standardized benchmark, demonstrates that BrickQA significantly outperforms ReAct baselines, delivering a 0.291–0.355 absolute F1 improvement while achieving 3 × –12.7 × higher token cost-efficiency. Beyond these metrics, the framework maintains structural fidelity across heterogeneous buildings and remains resilient to ambiguous queries without requiring site-specific fine-tuning. Furthermore, a case study on operational analytics validates the framework’s capability to handle temporal and aggregation constraints, effectively transforming abstract semantic models into actionable facility management insights.1

Ko, Yun-Dam↗

AI-Based Faster-Than-Real-Time Stability Assessment of Large Power Systems with Applications on WECC System

Achieving clean energy goals will require significant advances in regard to addressing the computational needs for next-generation renewable-dominated power grids. One critical obstacle that lies in the way of transitioning today’s power grid to a renewable-dominated power grid is the lack of a faster-than-real-time stability assessment technology for operating a fast-changing power grid. This paper proposes an artificial intelligence (AI) -based method that predicts the system’s stability margin information (e.g., the frequency nadir in the frequency stability assessment and the critical clearing time (CCT) value in the transient stability assessment) directly from the system operating conditions without performing the conventional time-consuming time-domain simulations over detailed dynamic models. Since the AI method shifts the majority of the computational burden to offline training, the online evaluation is extremely fast. This paper has tested the AI-based stability assessment method using multiple dispatch cases that are converted and tuned from actual dispatch cases of the Western Electricity Coordinating Council (WECC) system model with more than 20,000 buses. The results show that the AI-based method could accurately predict the stability margin of such a large power system in less than 0.2 milliseconds using the offline-trained AI agent. Therefore, the proposed method has great potential to achieve faster-than-real-time stability assessment for practical large power systems while preserving sufficient accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗