Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distribution adaptation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The EGS Collab Project – Stimulations at Two Depths

The EGS Collab project, supported by the US Department of Energy, is performing intensively monitored rock stimulation and flow tests at the 10-m scale in an underground research laboratory to address challenges in implementing enhanced geothermal systems (EGS). Data and observations from the field tests are compared to simulations to understand processes and build confidence in numerical modeling of the processes. We have completed Experiment 1 (of 3), which examined hydraulic fracturing in a well-characterized underground fractured phyllite test bed at a depth of approximately 1.5 km at the Sanford Underground Research Facility (SURF) in Lead, South Dakota. Testbed characterization included fracture mapping, borehole acoustic and optical televiewers, full waveform sonic, conductivity, resistivity, temperature, campaign p- and s-wave investigations and electrical resistance tomography. Borehole geophysical techniques including passive seismic, continuous active source seismic monitoring, electrical resistance tomography, fiber-based distributed strain, distributed temperature, and distributed acoustic monitoring, were used to carefully monitor stimulation events and flow tests. More than a dozen stimulations and nearly one year of flow tests were performed. Quality data and detailed observations were collected and analyzed during stimulation and water flow tests using ambient temperature and chilled water. We achieved adaptive control of the tests using real-time monitoring and rapid dissemination of data and near-real-time simulation. More detailed numerical simulation was performed to answer key experimental design questions, forecast fracture propagation trajectories and extents, and analyze and evaluate results. Data are freely available from the Geothermal Data Repository. Experiment 2 examines the potential for hydraulic shearing in amphibolite at a depth of about 1.25 km at SURF. This site has a different set of stress and fracture conditions than Experiment 1. The Experiment 2 testbed consists of nine subhorizontal boreholes configured in two fans of two boreholes which surround the testbed and contain grouted-in electrical resistance tomography, seismic sensors, active seismic sources and distributed fiber sensors. A “five-spot” set of test wells that extends from a custom mined alcove includes an injection well and four production/monitoring wells. The testbed was characterized geophysically and hydrologically, and three stimulations have been performed using the Step-Rate Injection Method for Fracture In-Situ Properties (SIMFIP) tool to measure strains, and a new strain quantifying tool (downhole robotic strain analysis tool -DORSA) was deployed in a monitoring hole during stimulation. Real-time data were broadcast during stimulations to allow real-time response to arising issues.

EGS Collab, Enhanced Geothermal Systems, EGS, fiel↗
DOE OSTI2023

Bayesian-Motivated Probabilistic Model of Hurricane-Induced Multimechanism Flood Hazards

Multimechanism floods (MMFs) are caused by the simultaneous occurrence of more than one flood mechanism such as storm surge, precipitation, tides, and waves. MMFs can lead to more severe or differing impacts than single-mechanism floods. As a result, comprehensive risk assessments require the ability to assess the multivariate probabilistic behaviors of hazards from MMFs. Here this study introduces a novel Bayesian-motivated approach for the probabilistic assessment of hurricane-induced hazards from the combination of the surge, precipitation, tides, and river antecedent flow. A Bayesian network (BN) is developed to capture the physical (conditional) relationship between variables and facilitate the generation of a hazard curve for river discharge that captures the contributions from multiple flood drivers. A case study located along the Delaware River is used to illustrate the proposed approach. Five computationally efficient representative predictive models are developed to estimate the conditional distributions required for the BN as a means of demonstrating the overall framework. The predictive models used in this study act as placeholders and can be replaced with more sophisticated and high-fidelity models depending on the desired accuracy level. While the predictive models are intended to be representative and illustrative, the model performance is evaluated using three historical storms that affected the area. Overall, the proposed framework is shown to be transparent, effective, and adaptable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

FY 2026 Midyear Report: Seismic Monitoring of Underground Vibration Sources Using Distributed Acoustic Sensing and Seismometers

Safeguards-relevant temporal changes in underground facilities can be observed using geophysical monitoring techniques. Seismic waves, in particular, provide valuable insights into subsurface activities and can serve as an important tool for detecting anomalous events that may indicate containment breaches at geological repositories. This midyear report summarizes ongoing efforts to automatically and rapidly detect and locate anomalous vibration signals that could be indicative of potential containment breaches. Previous work during FY25 focused on compiling continuous seismic datasets from two underground sites and developing a database of continuous waveforms and ground-truth event data derived from multiple sensing modalities. Building on this foundation, we are adapting anomaly detection and geolocation algorithms to explore methods for monitoring underground activities using two relatively low-maintenance sensing technologies: a dense surface geophone array deployed at the Pleasant Gap mine in Pennsylvania, and a three-dimensional fiber-optic cable array for distributed acoustic sensing (DAS) installed in the subsurface at the Sanford Underground Research Facility (SURF) in South Dakota. This report summarizes work conducted during the first two quarters of FY26, during which we refined a dynamic power spectral density (PSD)-based detector, applied it independently to each geophone station, and then combined the per‑station detections with density-based spatial clustering of applications with noise (DBSCAN) to cluster events and produce spatial maps over a nine‑day interval. In addition, we outline plans for a field trial at the Waste Isolation Pilot Plant (WIPP) in New Mexico to compare traditional seismic monitoring approaches with DAS techniques and to evaluate the benefits of combined data analysis. Activities during the past two quarters have included the preparation and submission of a Field Test Plan to WIPP for approval, as well as submission to headquarters for review and feedback.

58 GEOSCIENCES↗
DOE OSTI2021

Distributed Solar Adoption in Orlando: A Household-Level Model for Distribution Resource Planning

Potential for rooftop solar in Florida is massive (47% of retail sales, 3rd overall nationally), yet adoption lags (12th nationally). A 2018 Florida Public Service Commission ruling authorizing solar third-party ownership (leasing) has substantially increased attention on distributed solar in the state. The city of Orlando has committed to a 100% clean-energy target by 2050 and deployment of solar and storage are expected to contribute significantly to reaching the goal. Deployment of customer-adopted solar, unlike utility-procured solar, is uncertain, but known to be spatially correlated with demographic factors and existing adoption. We develop a new method to adapt NREL's dGen model in order to represent building-level agents in adoption forecasts for the Orlando Utility Commission (OUC) service territory. Using the agent-based model we develop projections of solar adoption, subject to scenarios varying future solar costs and valuation, and aggregate adoption predictions by OUC distribution feeder. We find substantial spatial heterogeneity in the projected level of adoption by OUC distribution feeder. For instance, 25% of all projected adoption through 2050 would be concentrated on just 5% of feeders and 88% of projected adoption on 50% of feeders. Because of the uncertainty in adoption, bottoms-up solar adoption forecasting methods at the household-level are integral to long-term resource planning by anticipating system needs as customers increasingly adopt distributed solar, storage, electric vehicles, and other distributed energy resources.

14 SOLAR ENERGY↗
DOE OSTI2022

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗
DOE OSTI2022

Accelerating error correction in tomographic reconstruction

Abstract Spurred by recent advances in detector technology and X-ray optics, upgrades to scanning-probe-based tomographic imaging have led to an exponential growth in the amount and complexity of experimental data and have created a clear opportunity for tomographic imaging to approach single-atom sensitivity. The improved spatial resolution, however, is highly susceptible to systematic and random experimental errors, such as center of rotation drifts, which may lead to imaging artifacts and prevent reliable data extraction. Here, we present a model-based approach that simultaneously optimizes the reconstructed specimen and sinogram alignment as a single optimization problem for tomographic reconstruction with center of rotation error correction. Our algorithm utilizes an adaptive regularizer that is dynamically adjusted at each alternating iteration step. Furthermore, we describe its implementation in a software package targeting high-throughput workflows for execution on distributed-memory clusters. We demonstrate the performance of our solver on large-scale synthetic problems and show that it is robust to a wide range of noise and experimental drifts with near-ideal throughput.

Ali, Sajid (ORCID:0000000321864636)↗
DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Modeling and Calibration of Supplier Selection Problem in Freight Agent-Based Simulations

Freight transportation modeling often struggles with data limitations, especially in accurately representing complex supplier selection processes and their impact on network flows. This research addresses this critical gap by developing a large-scale, calibrated agent-based model for supplier selection, complemented by a probabilistic heuristic for international shipments. Our approach integrates trade relationships between industry sectors, transportation costs, and a supplier-rating model adapted from existing literature. The model’s core objective is to minimize the discrepancy between modeled and observed commodity flows while ensuring a close match to regional shipping distance distributions. Implemented and tested across four major U.S. metropolitan areas—Atlanta, Chicago, Dallas–Fort Worth, and Los Angeles—the model demonstrates high fidelity in replicating observed freight patterns. Key findings reveal consistent alignment with national shipping distance trends and highlight significant spatial variations in commodity trade assignments and demand across the study regions. This behaviorally informed and transport-sensitive framework is designed to approximate real-world decision making, providing a robust tool for policymakers and planners to evaluate targeted interventions, assess infrastructure investments, and enhance supply chain resilience in the face of disruptions.

Ismael, Abdelrahman (ORCID:0000000303712110)↗
DOE OSTI2023

Calibration of the ProtoDUNE Horizontal-Drift position reconstruction using a laser system

Forthcoming in the next decade of neutrino physics advancements is the construction of the Deep Underground Neutrino Experiment (DUNE), a long baseline neutrino oscillation experiment which has the potential to answer fundamental questions such as why there is more matter than antimatter in the universe, and ultimately why we exist at all. A prototype of this experiment, ProtoDUNE, sits in a charged particle test beam at the European Organization for Nuclear Research (CERN) and uses Liquid Argon time projection chambers to image interactions of these particles. ProtoDUNE Single-Phase (ProtoDUNESP) had positively charged hadrons as well as positrons in its initial 2018 beam data run. Because ProtoDUNE is a surface-based time projection chamber, it experiences a constant influx of cosmic rays. These cosmic rays ionize the liquid argon within the detector, resulting in an accumulation of slow moving positive ions towards the cathode. This local charge distribution results in electric field non uniformities, which can have a significant effect on the accuracy of the event reconstruction. This paper outlines a monte carlo simulation study which adapts methodology from the MicroBooNE experiment, another neutrino oscillation experiment, to derive electric field correction maps which can correct for distortions of the electric field within the detector. These correction maps accurately estimate the electric field throughout the detector volume and correct for uncertainties in reconstructed event data enabling for physics discoveries.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Polar Bear™ – Innovative Capture of Storage Tank Vapors

Polar Bear™ is a patented technology developed by the Energy & Environmental Research Center (EERC) to capture storage tank vapors and eliminate methane emissions from upstream oil- and gas-producing facilities. Sparked by early commercial investment, the EERC licensed the technology and extended the intellectual property to storage tanks. Polar Bear™ is uniquely engineered and adapted to individual lower-producing facilities where there is otherwise no economic alternative for capturing tank vapors. A high number of small producing oil and gas wells are distributed across the country. The aggregate contributes to a significant volume of emissions. Because of the lack of economy of scale, gas volumes from these facilities are typically not recovered and contribute to methane emissions. Polar Bear™ provides a fit-for-purpose compression solution that addresses cost by reducing complexity with respect to conventional vapor recovery units and eliminating oil changes. Unique to Polar Bear™ is the capability to separate oxygenated gas from storage tank vapors. Storage tanks are designed to “breathe,” allowing gas to enter and escape during internal level and temperature changes. This infiltration of air into the tank headspace imparts undesirable oxygen content with respect to pipeline gathering. Polar Bear™ separates the vapor stream, allowing oxygen-rich gas to be used as fuel on-site while recovering the liquids-rich portion of the gas where oxygen content is minimized. A prototype system was tested to verify process models, evaluate operational performance, and advance the technology readiness level from 5 to 6. Results provide a good match between experimental measurements and process models, indicating the models are useful for future scale-up and field design. Various mixtures of nitrogen and liquefied petroleum gas were tested to understand the mass balance of nitrogen and how it relates to the potential control of oxygen content. Findings indicate that less than 2000 ppm of oxygen is likely to remain in the liquid portion of the gas in field applications. The research and development prepare the technology for field implementation to eliminate routine and fugitive methane emissions from storage tanks.

02 PETROLEUM↗
DOE OSTI2021

Shortest Microlensing Event with a Bound Planet: KMT-2016-BLG-2605

With a planet–host mass ratio q = 0.012 ± 0.001, KMT-2016-BLG-2605 has the shortest Einstein timescale, t {sub E} = 3.41 ± 0.13 days, of any planetary microlensing event to date. This prompts us to examine the full sample of seven short (t {sub E} < 7 days) planetary events with good q measurements. We find that six have clustered Einstein radii θ {sub E} = 115 ± 20 μas and lens–source relative proper motions μ {sub rel} ≃ 9.5 ± 2.5 mas yr{sup -1}. For the seventh, these two quantities could not be measured. These distributions are consistent with a Galactic bulge population of very low mass (VLM) hosts near the hydrogen-burning limit. This conjecture could be verified by imaging at first adaptive optics light on next-generation (30 m) telescopes. Based on a preliminary assessment of the sample, “planetary” companions (i.e., below the deuterium-burning limit) are divided into “genuine planets,” formed in their disks by core accretion, and VLM brown dwarfs, which form like stars. We discuss techniques for expanding the sample, which include taking account of the peculiar “anomaly-dominated” morphology of the KMT-2016-BLG-2605 light curve.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Analysis of Three Body Decays in Quasi-Real Photoproduction

This thesis presents preliminary measurements of the moments of angular distribution for the K?K+ mesonic final state using a quasi-real, linearly polarised photon. Two of the main points of focus for this analysis were the development of the formalism for photoproduced vector-pseudoscalar decay and the tools by which the analysis was carried out. The formalism described how the moments of angular distribution could be extracted from the angular decay variables, and how they related to resonance decays in terms of partial waves. In extracting the moments, it was found that adapted Markov Chain Monte Carlo (MCMC) methods proved to be more effective in terms of extracting results from the data compared to the sole use of gradient descent based fitting algorithms. These measurements are complementary to other decay channels and production mechanisms, with the global aim of probing the existence of exotic mesons. Data from this analysis was taken by the CLAS collaboration at the Thomas Jefferson National Accelerator Facility (JLab) by scattering from a liquid hydrogen target using a 10.6 GeV electron. This work was done within the MesonEx program at CLAS12 that aims to map the spectrum of mesons, and in doing so, gain a greater understanding of Quantum ChromoDynamics (QCD) and the strong force.

Wishart, Robert↗
DOE OSTI2021

Thermomechanical Microstructural Predictions of Fracture Nucleation of Zircaloy-4 Alloys With δ and ε Hydride Distributions

Abstract A crystalline dislocation-density formulation that was incorporated with a nonlinear finite-element (FE) method was utilized to understand and to predict the thermomechanical behavior of an hexagonal closest packed (h.c.p.) zircaloy system with hydrides with either face-centered cubic (f.c.c.) or body-centered cubic (b.c.c.) hydrides. This formulation was then used with a recently developed fracture methodology that is adapted for finite inelastic strains and multiphase crystalline systems to understand how different microstructurally based fracture modes nucleate and propagate. The interrelated microstructural characteristics of the different crystalline hydride and matrix phases with the necessary orientation relationships (ORs) have been represented, such that a detailed physical understanding of fracture nucleation and propagation can be predicted for the simultaneous thermomechanical failure modes of hydride populations and the matrix. The effects of volume fraction, morphology, crystalline structure, and orientation and distribution of the hydrides on simultaneous and multiple fracture modes were investigated for radial, circumferential, and mixed distributions. Another key aspect was accounting for temperatures changes due to the effects of thermal conduction and dissipated plastic work and their collective effects on fracture. For hydrided aggregates subjected to high temperatures, thermal softening resulted in higher ductility due to increased dislocation-density activity, which led to higher shear strain accumulation and inhibited crack nucleation and growth. The predictions provide validated insights into why circumferential hydrides are more fracture-resistant than radial hydrides for different volume fractions and thermomechanical loading conditions.

Engineering↗
DOE OSTI2022

Operational Resilience of Nuclear-Renewable Integrated-Energy Microgrids

The increasing prevalence and severity of wildfires, severe storms, and cyberattacks is driving the introduction of numerous microgrids to improve resilience locally. While distributed energy resources (DERs), such as small-scale wind and solar photovoltaics with storage, will be major components in future microgrids, today, the majority of microgrids are backed up with fossil-fuel-based generators. Small modular reactors (SMRs) can form synergistic mix with DERs due to their ability to provide baseload and flexible power. The heat produced by SMRs can also fulfill the heating needs of microgrid consumers. This paper discusses an operational scheme based on distributed control of flexible power assets to strengthen the operational resilience of SMR-DER integrated-energy microgrids. A framework is developed to assess the operational resilience of SMR-DER microgrids in terms of system adaptive real-power capacity quantified as a response area metric (RAM). Month-long simulation results are shown with a microgrid developed in a modified Institute of Electrical and Electronics Engineers (IEEE)-30 bus system. The RAM values calculated along the operational simulation reflect the system resilience in real time and can be used to supervise the microgrid operation and reactor’s autonomous control.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Customizable adaptive regularization techniques for B-spline modeling

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model regularization (i.e., smoothing) has traditionally been used to minimize these oscillations; unfortunately, it is sometimes impossible to sufficiently remove unwanted artifacts without smoothing away key features of the data set. In this article, we present a method of model regularization that preserves significant features of a data set while minimizing artificial oscillations. Our method varies the strength of a smoothing parameter throughout the domain automatically, removing artifacts in poorly-constrained regions while leaving other regions unchanged. Further, the proposed method selectively incorporates regularization terms based on first and second derivatives to maintain model accuracy while minimizing numerical artifacts. The behavior of our method is validated on a collection of two- and three-dimensional data sets produced by scientific simulations. In addition, a key tuning parameter is highlighted and the effects of this parameter are presented in detail. This paper is an extension of our previous conference paper at the 2022 International Conference on Computational Science (ICCS) (Lenz et al., 2022).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deep learning inversion of gravity data for detection of CO 2 plumes in overlying aquifers

In this work, we developed an effective U-Net based deep learning (DL) model for inversion of surface gravity data on a rectangular grid to predict 2-D high-resolution subsurface CO 2 distribution along a vertical cross-section due to CO 2 leakage through a wellbore within a deep CO 2 storage reservoir. We used synthetic data to model two types of CO 2 leakage scenarios: one CO 2 plume in a shallow aquifer (single plume case), and two plumes present at different depths (double plume case). The 3-D synthetic plume samples were created by sampling among predetermined CO 2 plume depths, saturations, and volumes. The corresponding surface gravity data on a rectangular grid were generated by a 3-D forward model. The U-Net model detected 72% of single-plume samples, and one or both plumes in 75% of double-plume samples. Most of the undetected single plumes have small gravity field strengths below the typical noise level of 5 μGal. This model generated reproducible, reliable predictions with acceptable errors and demonstrated improved spatial resolution over the conventional least-squares inversion. In contrast to the conventional least-squares inversion, which often overestimates the size of its target and underestimates its density, this U-Net model accurately delineated the boundary of a target. Furthermore, this DL inversion detected deep, small, or low saturation CO 2 plumes that are often more difficult to resolve with conventional gravity inversion methods. We note the limitations of this feasibility study, including the use of synthetic data with regular CO 2 plume shapes, and the prediction of a 2-D plume cross-section rather than the full 3-D plume, as well, we recognize the lower detection fraction for double-plume scenarios. Nevertheless, this study demonstrates that DL gravity inversion is a promising and potentially superior method to conventional least-squares inversion. Our U-Net based deep learning inversion approach may be adapted for inversion of other types of geophysical data. DL inversion can facilitate near real-time monitoring of geologic carbon sequestration to provide site operators with prompt information about subsurface CO 2 distribution for risk management and mitigation.

58 GEOSCIENCES↗
DOE OSTI2025

Deep Reinforcement Learning for Distribution System Operations: A Tutorial and Survey

Here, the rapid evolution of modern electric power distribution systems into complex networks of interconnected active devices, distributed generation (DG), and storage poses increasing difficulties for system operators. The large-scale integration of distributed energy resources (DERs) and the rapid exchange of measurement data via communication networks present major opportunities for advancing grid operations but also introduce greater uncertainty, higher data dimensionality, more complex network and device models, and challenging control and optimization problems. Deep reinforcement learning (DRL) algorithms are promising in addressing these challenges. However, they have not been effectively adapted for power systems applications, requiring extensive customization for implementation and evaluation. This has resulted in reproducibility challenges and a steep learning curve for researchers new to applying DRL algorithms to the power systems domain. To bridge these gaps, this tutorial aims to serve as a valuable resource for researchers interested in exploring learning-based algorithms to operate active power distribution networks. Specifically, this work presents a generalized process for translating sequential decision-making problems in power distribution systems into Markov decision process (MDP) formulations, illustrated through concrete grid service examples. Additionally, we introduce a simple environment design strategy to develop and evaluate example DRL algorithms for distribution system applications, complete with an included code repository to guide users through environment construction.

24 POWER TRANSMISSION AND DISTRIBUTION↗