SEARCH · Engineering Papers

Results for “real time optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Control optimization for parametric Hamiltonians by pulse reconstruction

Optimal control techniques provide a means to tailor the control pulses required to generate customized quantum gates, which helps to improve the resilience of quantum simulations to gate errors and device noise. However, the significant amount of (classical) computation required to generate customized gates can quickly undermine the effectiveness of this approach, especially when pulse optimization needs to be iterated. We propose a method to reduce the computational time required to generate the control pulse for a Hamiltonian that is parametrically dependent on a time-varying quantity. We use simple interpolation schemes to accurately reconstruct the control pulses from a set of pulses obtained in advance for a discrete set of predetermined parameter values. We obtain a reconstruction with very high fidelity and a significant reduction in computational effort. We report the results of the application of the proposed method to device-level quantum simulations of the unitary (real) time evolution of two interacting neutrons based on superconducting qubits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Ultra-Low SWaP CO 2 Sensing for Demand Control Ventilation (Final Report)

In this project PARC and Energy ETC aimed to develop an ultra-low cost, size, weight, and power (SWaP) printed CO 2 sensor system for occupancy detection to enable Demand Control Ventilation (DCV) on a per-room basis. The CO 2 sensor technology is based on the temperature variation when CO 2 reversibly physisorbs to a highly conductive and high surface area sorbent surface, and is compatible with integration with PARC innovations in printed sensors and flexible electronics, for which PARC is a globally leading research center. The printed CO 2 sensor itself is designed to be compatible with PARC’s “peel-and-stick” platform of ultra-low power, low-cost, distributed sensors, and to facilitate real-time DCV based on overall indoor air quality (IAQ). Previously, PARC has developed flexible hybrid electronics (FHE) compatible materials to measure humidity, temperature, light, strain, and gases such as carbon monoxide, methane, ammonia, and hydrogen sulfide. Through this project, PARC developed FHE-compatible materials to measure CO 2 . Thus, with one <$15 FHE “peel-and-stick” based sensor node, a building management system (BMS) will be able to capture a complete picture of the indoor environment. This includes IAQ, light, temperature, and other comfort factors that impact building operations. Combined with optimized DCV, this low-cost sensor capability can be a key enabler of annual primary energy savings of ~ 0.3-0.4 Quad in commercial buildings while ensuring healthy IAQ. Energy ETC is a leader in supplier-agnostic BMS deployments and will design the commissioning and deployment procedures to maximize system interoperability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

High- and Mid-Fidelity Modeling Comparison for a Floating Marine Turbine System: Preprint

There is a lack of suitable numerical tools, particularly open-source tools, that can be used for designing and optimizing marine turbine systems. The National Renewable Energy Laboratory (NREL) has added features to their widely used mid-fidelity wind turbine modeling code, OpenFAST, to enable modeling of axial flow marine turbines. This necessitated the addition of several physical effects relevant to marine turbines that can be neglected for wind turbines. These include buoyant loads, added mass and inertia loads, wave-current superposition, and changes to the coordinate systems. This updated version of OpenFAST allows for the modeling of both fixed and floating marine turbine systems at a speed comparable to real time. While efficient for long simulations, large sets of load cases, and design studies, mid-fidelity codes cannot capture all of the potentially important physical phenomenon impacting marine turbine systems. High-fidelity computational fluid dynamics (CFD) simulations can capture more flow effects with fewer assumptions and provide detailed body pressure mapping and flow-field information. It is important to compare predictions between mid-fidelity and high-fidelity codes, both to verify the models and to understand the limitations. A floating marine turbine system designed by NREL was modeled both with OpenFAST and with the commercial CFD code, STARCCM+. The CFD model used a 3-D unsteady Reynolds-averaged Navier-Stokes solver for a volume-of-fluid numerical wave and current tank. The blade-resolved simulations used the sliding-interface technique for the spinning rotor and an overset grid to accommodate the rigid-body motion of the floating system. The mooring system was modelled with a custom coupling of the CFD solver with the open-source code, MoorDyn. This improves upon the existing quasi-static catenary solver in STARCCM+, which lacks seabed contact or line-to-line connections. Spatial and temporal convergence studies were conducted. The simulation results for a combined current and wave condition are compared between OpenFAST and CFD, highlighting the capabilities of the mid-fidelity code and identifying the areas where a high-fidelity approach is needed.

CFD↗

DOE OSTI2021

Absolute contrast estimation for soft X-ray photon fluctuation spectroscopy using a variational droplet model

Abstract X-ray photon fluctuation spectroscopy using a two-pulse mode at the Linac Coherent Light Source has great potential for the study of quantum fluctuations in materials as it allows for exploration of low-energy physics. However, the complexity of the data analysis and interpretation still prevent recovering real-time results during an experiment, and can even complicate post-analysis processes. This is particularly true for high-spatial resolution applications using CCDs with small pixels, which can decrease the photon mapping accuracy resulting from the large electron cloud generation at the detector. Droplet algorithms endeavor to restore accurate photon maps, but the results can be altered by their hyper-parameters. We present numerical modeling tools through extensive simulations that mimic previous x-ray photon fluctuation spectroscopy experiments. By modification of a fast droplet algorithm, our results demonstrate how to optimize the precise parameters that lift the intrinsic counting degeneracy impeding accuracy in extracting the speckle contrast. These results allow for an absolute determination of the summed contrast from multi-pulse x-ray speckle diffraction, the modus operandi by which the correlation time for spontaneous fluctuations can be measured.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2025

Spacetime pq theory for AC and DC electric power systems

The 50/60 Hz alternating current (AC) electric power has been the standard and most flexible energy source powering our modern societies for one and a half centuries since the war of the currents: AC versus direct current (DC). A reactive power concept that was introduced at the beginning of the AC power was very useful for circuit/system analysis, design, control, optimization, and ultimately for more efficient and stable generation, transmission, distribution, and consumption. The initial reactive power theory was based on single-phase sinusoidal AC power to capture inductive and capacitive power that yields to net-zero average power over one fundamental cycle. Soon it was expanded to non-sinusoidal AC power and finally to instantaneous three-phase AC power. However, these reactive power theories remain separate and limited to special cases and have never been consolidated and made valid to all cases. Today, more widespread adoption of power electronics and renewable energy is bringing back DC power into the electric grids. The reactive power concept has never been applied to DC power systems. There is no reactive power in DC power systems according to the existing reactive power theories. Do DC power systems really have no reactive power? Capacitors and inductors are widely used in DC just like in AC power systems. Are they not reactive power components? Why are they different from their AC counterparts? Furthermore, are batteries active or reactive power components? What about active devices like power converters (or inverters) with AC (or DC) on one side and DC (or AC) on the other? Do they generate or consume reactive power? Finally, what about AC and DC hybrid power systems? How to define reactive power in such a complex power system that has a multitude of loads, buses, and sources? Is there reactive power between any two loads, any two buses, or any two sources in a power system and what is the total reactive power in such a complex power system as a whole? As the motivation and goal of this paper to answer the above basic questions, to unify the existing AC reactive power theories and to ultimately provide theoretical and insightful guidance for system analysis, design, control, efficiency, optimization, and operation of complex power systems, a concept of spacetime (both spatial and temporal) active and reactive power (pq) theory—the spatiotemporal aspect of active and reactive power—is developed for both AC and DC power systems. The theoretical definitions and physical meanings of the spacetime reactive power will be developed, and real applications and thought experiments/cases/exercises will be explored and discussed. The developed mathematics to define the active (or real) and reactive (or imaginary) power— p and q respectively by dot (scalar) and cross (vector) products of multi-dimension spacetime vectors and time-space mapping principle/law can have some fundamental implications as well.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

A Novel, Low-Cost, Portable Device for Counterfeit and Noncompliant Refrigerant Detection

The increasing prevalence of counterfeit refrigerants presents significant risks to Heating, Ventilation, Air Conditioning, and Refrigeration (HVACR) systems, including compromised equipment performance, safety hazards, and environmental non-compliance. This report details the development of a novel, cost-effective, and portable detection device designed to accurately identify counterfeit refrigerants. The device utilizes a controlled gas sampling and analysis system within a sealed chamber, ensuring precise measurements while maintaining safety through a purging mechanism. The system features a high-sensitivity sensor integrated with an onboard control module that analyzes gas composition in real-time, providing users with clear visual indicators for refrigerant authenticity. Laboratory validation demonstrated the device’s high accuracy (exceeding 95%) in detecting unauthorized refrigerant blends. Key advantages include affordability, ease of use, rapid response time, and compatibility with a wide range of refrigerants. This solution supports compliance with regulatory frameworks such as the AIM Act, enhances safety in HVACR operations, and mitigates the risks associated with counterfeit refrigerants. Future developments will focus on expanding refrigerant detection capabilities, integrating machine learning for enhanced accuracy, implementing cost-reduction strategies to improve accessibility and market adoption, and optimizing system packaging for enhanced field portability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Synchronous Machine Governor Upgrade

Conventional generation sources play a critical role in the stability and reliability of the electrical grid, particularly as we transition towards more renewable energy sources. To understand and accurately emulate their behavior for optimizing grid operations and ensuring seamless integration with renewable technologies, it is essential to better emulate the grid- and plant-level impacts of conventional generation sources, such as natural gas (NG) driven heat recovery steam generators (HRSGs) and combustion turbines (CTs). Therefore, a governor model is developed in a programmable logic controller (PLC) to investigate the performance of the conventional generator under various dynamic operating conditions and to identify the impact on grid stability in a controlled environment. The governor model aims to enable the hardware-in-the-loop (HIL) based emulation of these conventional generation sources using the existing 2 MVA synchronous machine/generator that is driven by a flexible 2.5 MW variable speed drive. This setup will allow us to replicate the dynamic characteristics and response behaviors of NG-driven HRSGs and CTs. The controls for the emulated conventional plants follow the industry standard and are adjustable, ensuring they accurately reflect the operational capabilities and limitations of real-world systems. These controls include load-following capabilities, ramp rates, startup and shutdown sequences, and emissions characteristics. By incorporating these adjustable controls, we aim to capture the nuanced impacts of conventional generation, such as their ability to provide ancillary services like frequency regulation, voltage support, and spinning reserve. In this report, we simulate two types of dynamic operations: grid-connected and islanding. For each dynamic operation, representative starting sequences are tested, including turbine purge, ignition, speed ramping up, generator excitation and synchronizing, and breaker close. The HIL based tests provides insights for field deployment, specifically the high-fidelity governor model provides results to predict the potential stability and reliability risk and suggest possible integration measures (e.g., generation and load balancing, tuning of governor control parameters). Ultimately, this enhanced emulation capability will be integrated into our Advanced Research on Integrated Energy Systems (ARIES), enabling us to conduct comprehensive studies on the interactions between conventional and renewable energy sources. By better understanding these interactions, we can develop strategies to optimize the overall performance and reliability of the grid. This will support the deployment of advanced grid management techniques, such as demand response, grid-forming inverters, and energy storage systems. The main contributions are summarized as follows: (1) This report introduces a PLC-based governor model for gas turbines. This model accurately simulates the dynamic behavior of conventional generation sources under various operational scenarios; (2) The model is integrated with an HIL testbed that includes a 2.5 MW variable speed drive and a 2 MVA synchronous machine. This setup enables realistic, real-time emulation of conventional power plants, particularly NG driven HRSGs and CTs; (3) The developed model is adaptable to various gas turbine configurations and allows for precise control over parameters such as MW ramp rates. This flexibility makes it a valuable tool for future research and industry collaboration; and (4) By incorporating the model into the National Renewable Energy Laboratory's Advanced Research on Integrated Energy Systems, the report lays the groundwork for future studies on interactions between conventional and renewable energy sources, enhancing the ability to develop advanced grid management strategies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

A Forward-Looking Dataset of EV Managed Charging Resource and Costs

This presentation summarizes a high-resolution, forward-looking dataset of EV adoption, EV charging, and managed charging resource. Vehicle-level data are grounded in current adoption and charging patterns, and ~200,000 real-world vehicle-weeks of travel data covering all on-road segments (i.e., light-duty, transit and school buses, local, regional and long-haul medium- and heavy-duty). The data, which include multiple charging profiles per vehicle to bound flexibility, are then processed and aggregated to describe baseline charging and charge management resource by county, hour, year, scenario, and vehicle type. Coupled with one of four scenarios of how EV managed charging costs might evolve over time, the dataset enables a power sector capacity expansion model to select cost-optimal quantities of EV managed charging and supply-side resources to reliably satisfy demand. Five integration strategies: Baseline, Daytime and Flat (passive), Flex (active), and Stress (anti-strategy), illustrate how baseline charging and flexibility potential changes with EVSE build-out and charging preferences.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Simulation Evaluation of a Large-Scale Implementation of Virtual-Phase Link-Based Model Predictive Control

Traffic congestion is a serious problem in the US, and traffic signal control is one of the effective solutions to congestion. Previous research on model predictive control (MPC)-based traffic signal control showed substantial benefits over conventional methods. This study focused on implementing MPC over a large-scale network with complex intersections and the impact of cycle length, network size, and imperfect state estimation on performances. This study implemented a virtual phase link (VPL)-based model predictive control method which used the number of vehicles in each VPL as input state variables and was suitable for National Electrical Manufacturing Association (NEMA) ring-barrier control. To test the impact of network size, the performance of distributed MPC (36 intersections in the network are divided into five subnetworks) was compared with that of MPC over the full network for a set of cycle lengths. To test the impact of imperfect state estimation, we synthetically infused estimation error and developed two scenarios, MPC-error and MPC-error narrow, which had higher and lower estimation errors, respectively. The performance of these MPC methods was compared with that of the existing time-of-day (TOD) method and an offline method that used Webster's method for split and MULTIBAND for cycle length and offset optimization. Trajectory and linkwise signal performance measures were collected from the simulation to evaluate performance. The distributed MPC method with perfect state estimation had the lowest delay and highest energy efficiency of all the methods. The performance of MPC decreased as the prediction inaccuracy increased. MPC-error had 7% and 11% more delay than MPC-error narrow in the morning and evening peaks, respectively. Overall, simulation results suggest that even with imperfect state estimation, MPC methods will outperform offline methods significantly.

large-scale simulation↗

DOE OSTI2021

O3BNN-R: An Out-Of-Order Architecture for High-Performance and Regularized BNN Inference

Binarized Neural Networks (BNN) have drawn tremendous attention due to significantly reduced computational complexity and memory demand. They have especially shown great potential in cost- and power-restricted domains, such as IoT and smart edge-devices, where reaching a certain accuracy bar is often sufficient, and real-time is highly desired.In this work, we demonstrate that the highly-condensed BNN model can be shrunk significantly further by dynamically pruning irregular redundant edges. Based on two new observations on BNN-specific properties, an out-of-order (OoO) architecture – O3BNN-R, can curtail edge evaluation in cases where the binary output of a neuron can be determined early. Similar to Instruction-Level-Parallelism(ILP), these fine-grained, irregular, runtime pruning opportunities are traditionally presumed to be difficult to exploit. In order to increase the pruning opportunities, we also optimize the training process by adding 2 regularization items in the loss function (1) for pooling pruning and (2) for threshold pruning. We evaluate our design on an FPGA platform using three well-known networks, including VggNet-16, AlexNet for ImageNet, and a VGG-like network for Cifar-10.

Geng, Tong↗

DOE OSTI2025

Evaluation of the Energy, Hygrothermal, and Thermal Capacity Performance of Cross-Laminated Timber

Cross-laminated timber (CLT) construction is gaining momentum in the US because it offers multiple advantages over traditional construction methods. Benefits that have received the most attention focus on constructability, the environment, and protection (e.g., blast resistance), although CLT construction is likely to offer other benefits, as well. Still, these have not been studied at length because such evaluations are costly, requiring long-term assessments in an actual building and specialized technical knowledge. Among the possible benefits, CLT construction likely provides a higher-performing building envelope. Using CLT panels to enclose a building means fewer joints in the opaque envelope than what is required in traditional stick-framed construction. Fewer joints mean fewer locations where the air- and water-resistive barrier (WRB) could be compromised; thus, a CLT building enclosure may require less maintenance and have a longer lifespan than a traditionally built structure because of fewer air and water leaks. In addition, CLT’s thermal mass moderates indoor temperatures, allowing the heating, ventilation, and air conditioning (HVAC) system to operate more efficiently during peak hours, reducing operational energy consumption throughout the lifetime of the CLT building (Salonvaara et al., 2022). Furthermore, more stable indoor temperatures can increase occupant comfort. The CLT’s thermal mass can also reduce energy costs by adjusting to utility time-of-use pricing without affecting occupant comfort. The ability of CLT buildings to bridge periods without HVAC operation prepares them for future grid interaction and provides a certain level of resilience against power outages. Researchers have attempted to quantify these benefits; however, their work is based on simplified simulations with numerous assumptions. To correctly understand the benefits, an actual building must be monitored. Therefore, information needs to be gathered on indoor and outdoor temperatures, HVAC energy consumption, thermostat setpoints, temperatures, and thermal transport in CLT components to comprehend how these parameters are affected by the CLT’s thermal mass. These data are needed to reduce the number of assumptions and calibrate simulation models to optimize HVAC controls to minimize overall energy consumption, reduce energy use and higher fees during peak demand, and maintain occupant comfort. Additionally, the calibrated simulation model allows the optimization exercise to be repeated in various US climates. Potential benefits can be tailored to buildings in various locations, and decisions can be made on where CLT construction could be most advantageous. Furthermore, monitoring and simulation results are needed to evaluate the durability of the CLT structures in different climates. This project’s researchers gathered information to help understand and quantify the benefits of CLT buildings concerning operational energy, moderated indoor temperatures, and comfort; the dynamic operation to provide grid services; and resilience in times of power outage. Through the corroboration of simulation models with real-world measurements, this study paves the way for extrapolating findings to other climatic zones and building typologies, thereby broadening the understanding of CLT’s multifaceted benefits and reinforcing its position as a material of choice in sustainable construction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

A Quantum-Inspired Tensor Network Algorithm for Constrained Combinatorial Optimization Problems

Combinatorial optimization is of general interest for both theoretical study and real-world applications. Fast-developing quantum algorithms provide a different perspective on solving combinatorial optimization problems. In this paper, we propose a quantum-inspired tensor-network-based algorithm for general locally constrained combinatorial optimization problems. Our algorithm constructs a Hamiltonian for the problem of interest, effectively mapping it to a quantum problem, then encodes the constraints directly into a tensor network state and solves the optimal solution by evolving the system to the ground state of the Hamiltonian. We demonstrate our algorithm with the open-pit mining problem, which results in a quadratic asymptotic time complexity. Our numerical results show the effectiveness of this construction and potential applications in further studies for general combinatorial optimization problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Progress of Tripwire: Multi-Modal Distributed Sensing for Repository Verification

This project is developing and demonstrating a multi-modal sensor system, TRIPWIRE, for containment verification in inaccessible radiological and nuclear waste repositories. The TRIPWIRE system will continuously monitor ionizing radiation and electromagnetic fields in the vicinity of emplaced nuclear materials buried in a repository, reporting on disturbances with a real-time alarm control station. The system will use long-length scintillating fiber bundles (SFBs) to perform area radiation monitoring; these will be coupled to kilometer-scale multimodal optical communication fibers – all light sensors and electronic components used with this system will be located above ground. Electromagnetic fields, and changes in local dielectric conditions caused by intrusion and soil movement, will be monitored using commercial grade, ported "leaky" coaxial cables (PCCs), with control electronics also located above ground. This paper documents the results of the simulations and modeling efforts that have helped identify the optimal placement of the SFBs. Additionally, the paper includes the current progress on the multi-modal SFB-PCC system, including the fabrication of long-length (>3-m) fibers and their coupling to optical fibers.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

DOE OSTI2022

Progress of Tripwire: Multi-modal Distributed Sensing for Repository Verification

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

DOE OSTI2025

An explicit, energy-conserving particle-in-cell scheme

We present an explicit temporal discretization of particle-in-cell schemes for the non-relativistic Vlasov equation that results in exact energy conservation when combined with an appropriate spatial discretization. The scheme is inspired by a simple, second-order explicit scheme that conserves energy exactly in the Eulerian context. We show that direct translation to particle-in-cell does not result in strict conservation, but derive a simple correction based on an analytically solvable optimization problem that recovers conservation. While this optimization problem is not guaranteed to have a real solution for every particle, we provide a correction that makes imaginary values extremely rare and still admits $\mathcal{O}$(10 –12 ) fractional errors in energy for practical simulation parameters. We present the scheme in both electrostatic – where we use the Ampère formulation – and electromagnetic contexts. With an electromagnetic field solve, the field update is most naturally linearly implicit, but the more computationally intensive particle update remains fully explicit. Here, we also show how the scheme can be extended to use the fully explicit leapfrog and pseudospectral analytic time-domain (PSATD) field solvers. The scheme is tested on standard kinetic plasma problems, confirming its conservation properties.

Energy conservation↗

DOE OSTI2021

Experimental decoy-state Bennett-Brassard 1984 quantum key distribution through a turbulent channel

In free-space quantum key distribution (QKD) in turbulent conditions, scattering and beam wandering cause intensity fluctuations which decrease the detected signal-to-noise ratio. This effect can be mitigated by rejecting received bits when the channel's transmittance is below a threshold. Thus, the overall error rate is reduced and the secure key rate increases despite the deletion of bits. In this work, we implement recently proposed selection methods focusing on the prefixed-threshold real-time selection (P-RTS) where a cutoff can be chosen prior to data collection and independently of the transmittance distribution. We perform finite-size decoy-state Bennett-Brassard 1984 QKD in a laboratory setting where we simulate the atmospheric turbulence using an acousto-optical modulator. We show that P-RTS can yield considerably higher secure key rates for a wide range of the atmospheric channel parameters. In addition, we evaluate the performance of the P-RTS method for a realistically finite sample size. We demonstrate that a near-optimal selection threshold can be predetermined even with imperfect knowledge of the channel transmittance distribution parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

FIRE: A Failure-Adaptive RL Framework for Edge Computing Migrations

In edge computing, users' service profiles are migrated between edge servers due to user mobility. Reinforcement Learning (RL) frameworks have been proposed to do so, often trained on simulated data. However, existing RL frameworks overlook occasional server failures, which although rare, impact latency-sensitive applications like AR/VR and real- time obstacle detection. These rare failures, being not adequately represented in historical training data, pose a challenge for data-driven RL algorithms. We introduce FIRE, a framework that adapts to rare events by training a RL policy in an edge computing digital twin environment. We propose FIRE-ImRE, an importance sampling-based Q-learning algorithm, which samples rare events proportionally to their impact on the value function. FIRE considers delay, migration, failure, and backup placement costs across individual and shared service profiles. We prove FIRE-ImRE's boundedness and convergence to optimality. Next, we introduce novel deep Q-learning (FIRE-ImDQL) and actor critic (FIRE-ImACRE) versions of our algorithm to enhance scalability. Here, we extend our framework to accommodate users with varying risk tolerances of rare failure events. Through trace-driven experiments, we show that FIRE reduces edge computing costs compared to vanilla RL and the greedy baseline in the event of failures.

Edge computing↗