Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “applied computing → operations research”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Accelerating Discovery to Deployment: Argonne's Materials Engineering Research Facility (MERF) and Its Role in Scaling Materials Technologies for Water and Resource Solutions

The U.S. Department of Energy (DOE) national laboratories represent a unique class of government‐owned, contractor‐operated research institutions dedicated to conducting research and development (R&D) related activities that address national priorities, supporting and advancing the DOE mission. They play a vital role in sustaining U.S. innovation capacity, stewarding the nation's technical base, and nurturing science and technologies. In this perspective, we highlight the processing science and scaleup capabilities of the Materials Engineering Research Facility (MERF) at DOE's Argonne National Laboratory to demonstrate how DOE National Laboratories bridge fundamental science and applied technology development to accelerate deployment. Case studies are presented on selective membranes for critical mineral recovery, sensors for per‐ and polyfluoroalkyl substances (PFAS) detection, surface functionalization via atomic layer deposition (ALD) and sequential infiltration synthesis (SIS), and lithium recovery from battery recycling waste streams using a novel electrodialysis process. These examples underscore MERF's role in translating innovative technologies into practical solutions for renewable water and critical resource recovery, which also leverage Argonne's analytical and computational capabilities. This perspective also outlines mechanisms for collaborating with the DOE national laboratories to strengthen partnerships across government, the national laboratories, academia, and industry.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Analysis of MHD stability and active mode control on KSTAR for high confinement, disruption-free plasma

Long-pulse plasma operation at high normalized beta, $β_N$, above the $\textit{n}$= 1 ideal MHD no-wall stability limit in KSTAR is presently limited by tearing instabilities rather than resistive wall modes. H-mode plasma operation during the recent KSTAR device campaign produced discharges having strong $\textit{m/n}$= 2/1 tearing instabilities at $β_N$ lower than the ideal MHD no-wall beta limit. The unstable tearing mode consequently reduced plasma confinement and toroidal plasma rotation significantly. We report the experiment confirmed that an extended duration of electron cyclotron heating (ECH) at the initial phase of the discharge plays a critical role in mode destabilization. To study destabilizing mechanisms that affect the mode growth, the stability of the observed tearing modes from plasmas with significantly different $β_N$ is computed by using the resistive DCON code and the M3D-C 1 code. Equilibrium reconstructions that include constraints from internal profile diagnostics, and computed fast particle pressure are used as input for reliable computation of stability. The classical tearing stability index, Δ', from resistive DCON is computed to be unstable when the island is fully saturated with large amplitude, while the unstable mode is not computed by M3D-C 1 . The modified Rutherford equation (MRE) describing the evolution of the island width has been constructed for KSTAR plasmas by using plasma parameters computed by the TRANSP code. The MRE model estimates a saturated island width corresponding to ~10% of the plasma minor radius for equilibrium at high $β_N$ 3 having a stable Δ' from the resistive DCON. In preparation for long-pulse plasma operation at higher beta utilizing increased plasma heating power, a resistive wall mode (RWM) active feedback control algorithm has been completed and enabled on KSTAR. To accurately determine the $\textit{n}$= 1component produced by RWMs, an algorithm has been developed that includes magnetic sensor compensation of the prompt applied field and the field from the induced current on the passive conductors. Use of multiple toroidal sensor arrays is enabled by modifying the sensor toroidal angles assumed in mode decomposition to include the effect of varied mode helicities in the outboard region where the mode measurement is made. This analysis on stability, transport, and control provides the required foundation for disruption prediction and avoidance research on KSTAR.

resistive wall mode (RWM)↗
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2021

Analysis of the SBP-SAT Stabilization for Finite Element Methods Part II: Entropy Stability

In the hyperbolic research community, there exists the strong belief that a continuous Galerkin scheme is notoriously unstable and additional stabilization terms have to be added to guarantee stability. In the first part of the series, the application of simultaneous approximation terms for linear problems is investigated where the boundary conditions are imposed weakly. By applying this technique, the authors demonstrate that a pure continuous Galerkin scheme is indeed linearly stable if the boundary conditions are imposed in the correct way. In this work, we extend this investigation to the nonlinear case and focus on entropy conservation. Here, by switching to entropy variables, we provide an estimation of the boundary operators also for nonlinear problems, that guarantee conservation. In numerical simulations, we verify our theoretical analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Topical Group on Application and Industry Community Engagement Frontier Snowmass 2021 (Summary Report)

HEP community leads and operates cutting-edge experiments for the DOE Office of Science which have challenging sensing, data processing, and computing requirements that far surpass typical industrial applications. To make necessary progress in the energy, material, and fundamental sciences, development of novel technologies is often required to enable these advanced detector and accelerator programs. Our capabilities include efficient co-design, which is a prerequisite to enable the deployment of advanced techniques in a scientific setting where development spans from rapid prototyping to robust and reliable production scale. This applies across the design spectrum from the low level fabrication techniques to the high level software development. It underpins the requirement for a holistic approach of innovation that accelerates the cycle of technology development and deployment. The challenges set by the next generation of experiments requires a collaborative approach between academia, industry and national labs. Just a single stakeholder will be unable to deliver the technologies required for the success of the scientific goals. Tools and techniques developed for High Energy Physics (HEP) research can accelerate scientific discovery more broadly across DOE Office of Science and other federal initiatives and also benefit industry applications.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Summertime Post-Cold-Frontal Marine Stratocumulus Transition Processes over the Eastern North Atlantic

Abstract Marine boundary layer (MBL) cloud morphology associated with two summertime cold fronts over the eastern North Atlantic (ENA) is investigated using high-resolution simulations from the Weather Research and Forecasting (WRF) Model and observations from the Atmospheric Radiation Measurement (ARM) ENA Climate Research Facility. Lagrangian trajectories are used to study the evolution of post-cold-frontal MBL clouds from solid stratocumulus to broken cumulus. Clouds within specified domains in the vicinity of transitions are classified according to their degree of decoupling, and cloud-base and cloud-top breakup processes are evaluated. The Lagrangian derivative of the surface latent heat flux is found to be strongly correlated with that of the cloud fraction at cloud base in the simulations. Cloud-top entrainment instability (CTEI) is shown to operate only in the decoupled MBL. A new indicator of inversion strength at cloud top that employs the vertical gradients of equivalent potential temperature and saturation equivalent potential temperature, which can be computed directly from soundings, is proposed as an alternative to CTEI. Overall, results suggest that the deepening–warming hypothesis suggested by Bretherton and Wyant explains many of the characteristics of the summertime postfrontal MBL evolution of cloud structure over the ENA, thereby widening the phase space over which the hypothesis may be applied. A subset of the deepening–warming hypothesis involving warming initially dominating over moistening is proposed. It is postulated that changes in climate change–induced modifications in cold-frontal structure over the ENA may be accompanied by coincident changes in the location and timing of MBL cloud transitions in the post-cold-frontal environment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Probabilistic Risk Assessment Research Needs and Activities

Probabilistic risk assessments (PRAs) have benefitted the safe operation of the U.S. reactor fleet over many decades. Risk insights from these PRAs have provided information from many different perspectives, from what is most important to maintain at a facility to a better understanding of how to address new information regarding safety issues. The methods and tools that have supported the creation and enhancement of PRA models were established through multiple decades of research, from the 1970s starting with the WASH-1400 Reactor Safety Study through comprehensive plant-specific models in use today. Because PRA models are being used to support such a diverse array of plant decisions, they are now being applied to analyze an increasing number and diverse set of aspects of the plant, which are well beyond the initial efforts envisioned in the 1970s. These demands on PRA methods and tools have led to challenges in terms of further expansion of the use of PRA and raised the potential for future research into how to address these challenges to ensure continued nuclear safety. In addition to the PRA needs, the domain of computer science has led to advances in computational approaches that may serve to help nuclear power plant PRA applications. These newer technologies have great potential to improve the effectiveness and economics of PRA and are being considered for exploration of potential benefits to the PRA and nuclear-power communities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Typology for Characterizing Human Action in MultiSector Dynamics Models

The role of individual and collective human agency is increasingly recognized as a prominent and arguably paramount determinant in shaping the behavior, trajectory, and vulnerability of multisector systems. This human influence operates at multiple scales: from short-term (hourly to daily) to long-term (annually to centennial) timescales, and from the local to the global, pushing systems towards either desirable or undesirable outcomes. However, the effort to represent human systems in multisector models has been fragmented across philosophical, methodological, and disciplinary lines. To cohere insights across diverse modeling approaches, we present a new typology for classifying how human actors are represented in the broad suite of coupled human-natural system models that are applied in MultiSector Dynamics (MSD) research. The typology conceptualizes a “sector” as a system-of-systems that includes a diverse group of human actors, defined across individual to collective social levels, involved in governing, provisioning, and utilizing products, goods, or services towards some human end. We trace the salient features of modeled representations of human systems by organizing the typology around three key questions: 1) Who are the modeled actors in MSD systems? 2) What are their modeled actions? 3) How and for what purpose are these actors and actions operationalized in a computational model? The typology is used to critically examine existing models and chart the frontier of future human systems modeling for MSD research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Solving Seismic Wave Equations on Variable Velocity Models With Fourier Neural Operator

Here, in the study of subsurface seismic imaging, solving the acoustic wave equation is a pivotal component in existing models. The advancement of deep learning (DL) enables solving partial differential equations (PDEs), including wave equations, by applying neural networks to identify the mapping between the inputs and the solution. This approach can be faster than traditional numerical methods when numerous instances are to be solved. Previous works that concentrate on solving the wave equation by neural networks consider either a single velocity model or multiple simple velocity models, which is restricted in practice. Instead, inspired by the idea of operator learning, this work leverages the Fourier neural operator (FNO) to effectively learn the frequency domain seismic wavefields under the context of variable velocity models. We also propose a new framework paralleled FNO (PFNO) for efficiently training the FNO-based solver given multiple source locations and frequencies. Numerical experiments demonstrate the high accuracy of both FNO and PFNO with complicated velocity models in the OpenFWI datasets. Furthermore, the cross-dataset generalization test verifies that PFNO adapts to out-of-distribution velocity models. Finally, PFNO admits higher computational efficiency on large-scale testing datasets than the traditional finite-difference method. The aforementioned advantages endow the FNO-based solver with the potential to build powerful models for research on seismic waves.

58 GEOSCIENCES↗
DOE OSTI2025

Benchmark of numerical modeling approaches on the systematic performance evaluation of wave energy converters

Different numerical modeling methods have been developed and applied to evaluate a variety of performance indicators of wave energy converters (WECs), including the power performance, structural loads, levelized cost of energy, etc. Based on the modeling fidelity, the commonly used numerical modeling approaches can be classified as linear modeling, weakly nonlinear modeling and fully nonlinear modeling approaches. Each method differs in accuracy and computational efficiency, making them suitable for different stages of WEC design. However, the selection of modeling approach could significantly impact evaluation outcomes. For instance, simplified linear models may underestimate structural loads or overestimate energy production in some operational conditions, potentially leading to less cost-effective designs. Given the widespread utilization of these models, it is essential to understand the uncertainties brought by them in performance evaluations. This work is dedicated to benchmarking different linear-potential-flow-based numerical models for evaluating the systematic performance of WECs. Three representative numerical modeling approaches are considered in this work, including linear frequency-domain modeling, statistically linearized spectral-domain modeling and Cummins equation-based nonlinear time-domain modeling. A generic point absorber WEC is considered as the research reference in this work, and different sea sites are taken into account. The numerical models are utilized to predict critical performance indicators, including power performance, the annual energy production, the capacity factor, the levelized cost of energy and the PTO fatigue loads. By comparing the results, this work identifies the uncertainties associated with different modeling approaches in evaluating WEC performance.

Fatigue↗
DOE OSTI2022

Parallel-in-Time Integration for Nonlinear Hyperbolic Problems (Final Report)

The work for the subcontract was situated in the area of parallel-in-time integration for hyperbolic partial differential equations (PDEs). Parallel-in-time integration is an active area of research due to its ability to enable faster numerical simulations for applications throughout many areas of science. Over the past two decades, much progress has been made in this area; however, this progress has largely been limited to diffusion-dominated PDEs, with some recent success in scalar linear hyperbolic PDEs. Given the ubiquity of numerical simulations of hyperbolic PDEs throughout the sciences, in particular, nonlinear hyperbolic systems, there is a strong need to develop efficient parallel-in-time techniques for hyperbolic problems beyond simple scalar and linear cases, which is the main topic of this subcontract. The main focus of the work was to further develop and perfect coarse-grid operators for the Multigrid Reduction-inTime (MGRIT) method applied to hyperbolic PDEs that were recently proposed in PhD thesis, based on a modified semi-Lagrangian approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

National User Resource for Biological Accelerator Mass Spectrometry (Final Report)

The National User Resource for Biological Accelerator Mass Spectrometry (User Resource) will provide isotopic analysis (primarily radiocarbon or 14C) by accelerator mass spectrometry (AMS) for NIH- funded researchers across the United States and will be the only User Resource of its type in the United States. The User Resource will provide measurement capability and expertise to a research community that requires highly sensitive, quantitative isotope analyses. Since commissioning a new accelerator mass spectrometer in June 2014, we have measured over 4000 samples a year for collaborators and service users. The User Resource will enable us to continue to meet these research needs, as well as provide for new users whose research programs would benefit from AMS as a measurement tool. The User Resource’s forte will be ultra-high sensitivity quantitation of radiocarbon and selected other radioisotopes for research studies where isotopes are required. Radioisotope labeling studies have been and will continue to be an important tool for addressing many complex biomedical science problems. AMS is a specialized and unique type of mass spectrometry that provides absolute quantitation of radiocarbon and other relevant radioisotopes with extreme sensitivity, having limits of detection in real samples on the order of a few attomol/mg of sample at measurement precisions of ~3%. It is the only instrumental method capable of quantifying radioisotope-labeled agents routinely in real-world samples with such precision and sensitivity. The sensitivity of AMS allows for the quantification of radiolabeled metabolites in extremely complex matrices of cells and organisms at very low concentrations and in small samples. AMS allows studies to be conducted without perturbing metabolism leading to more relevant quantification of metabolic rates and pathways. In addition, it enables quantification of pharmacokinetic and metabolic properties of toxicants at environmentally relevant concentrations in model systems as well as the ability to quantify pharmacokinetics and other molecular endpoints directly in humans. Such quantitative assessments can 1) improve risk assessment for toxicants, 2) address safety and efficacy considerations for therapeutic entities, 3) deepen understanding of xenobiotic and intermediary metabolism, 4) help understand the interactions between critical molecular pathways, and 5) improve efforts to model and predict various metabolic and biological states. These capabilities have been applied in a number of areas including research in carcinogenesis, toxicology, nutrition, pharmacology/drug development and basic biological science. As a NIGMS National Resource the National User Resource for Biological Accelerator Mass Spectrometry will help NIH funded scientists achieve a deeper understanding of the etiology of human health concerns by (1) enabling the quantification of pharmacokinetics and other molecular endpoints directly in humans; (2) offering the ability to conduct quantitative studies using biologics such as proteins or lipids, and thereby reducing the amount of radioisotope usage in biomedical labs; and (3) enabling more relevant studies of metabolic pathways in health and disease through the use of much lower, more biologically-relevant, concentrations of metabolic substrates in cells and intact organisms. Such studies support NIGMS’s basic biomedical research areas that contribute to the understanding of fundamental cellular and physiological principles and enable research supported by the Biophysics, Biomedical Technology, and Computational Biosciences (BBCB); Genetics and Molecular, Cellular, and Developmental Biology (GMCDB); Pharmacology, Physiology, Biological Chemistry (PPBC) and Training, Workforce Development, and Diversity (TWD) Divisions. Over the next five years, our goals are to: 1. Improve the efficiency of operation for AMS measurements through installation of new interfaces to our AMS systems, technical modifications to improve gas accepting ion source efficiency and upgrading our data analysis software for improved ease of use and data reporting. 2. Increase the accessibility and visibility of ultra-sensitive 14C measurements for the biomedical research community by training of new investigators and expanding our national user base. 3. Provide high throughput, ultra-sensitive 14C analysis for the NIGMS and NIH user community.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

A hybrid porous model for full reactor core scale CFD investigation of a prismatic HTGR

Three-dimensional (3-D) Computational Fluid Dynamics (CFD) analysis of a whole nuclear reactor core is a tremendous challenge due to the large geometric volume and complex structures. Here, this research presents a hybrid porous (HP) model to simplify a prismatic High Temperature Gas-cooled Reactor (HTGR) core, so 3-D CFD investigation can be performed on a full reactor core scale. In the HP model, the prototypic small coolant channels in the nuclear fuel blocks are lumped together to form multiple equivalent large coolant channels, and then the porous medium flow model is applied to each of them. Therefore, heat transfer in fuel blocks is computed by a hybrid combination of solid energy and porous flow energy equations. The similarity between the HP model and prototypic model is achieved by deriving the porous flow permeability, inertial resistance factor, and artificial thermophysical properties. Compared with the widely used whole porous (WP) flow model, the HP model preserves more realistic geometric structures, and therefore more accurate physical processes. The General Atomics' Modular High Temperature Gas-cooled Reactor (MHTGR) design was chosen as a prototype to demonstrate the methodology. Simulations were performed using the prototypic CFD model and HP model at steady-state forced circulation, steady-state natural circulation, and transient conditions that correspond to normal operation, extended period of pressurized cool down, and short-term transients after reactor shutdown, respectively. The comparison shows good agreement between the HP model and prototypic model in the maximum fuel temperature, average solid temperature, and helium flow rate, which demonstrates the potential applicability of the HP model for a full reactor core scale simulation in the future. As a benefit, the HP model reduces the mesh quantity by a factor of 50 from a prototypic model. Correspondingly, the computation time was reduced by a factor of at least 30.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Materials and Approaches for Mitigation of SOFC Cathode Degradation in SOFC Power Systems

Perovskites such as doped lanthanum manganite and cobaltite have been used successfully as a cathode material in SOFC power systems operating between 700-1000°C. The electrodes, however, remain prone to degradation in presence of Cr containing gas atmosphere under systems operating conditions. Cathode in SOFCs is considered as one of the largest contributors of electrochemical performance degradations, leading to significant increase in ohmic and non-ohmic losses as well as interfacial compound formation. These degradations are mostly irreversible due to permanent changes to chemical and morphological alterations in the electrodes, resulting in the blockage of triple phase boundary (TPB) sites and decrease in oxygen reduction reactions (ORR). Fundamental mechanistic understanding has been developed to elucidate the reaction pathways of electrode poisoning in electronically conducting electrodes (LSM) as well as mixed ionic and electronically conducting electrodes (LSCF). The overall goal of this program has been identification and development of cost effective solutions to mitigate electrode degradations under “real world” systems operating conditions. The overall technological innovations and impact from this work are: The research provides an understanding of the degradation mechanism and cost-effective approaches for implementation in SOFC systems; Develop mitigation processes utilizing low cost getters using conventional synthesis and fabrication route; Develop tailored high surface area powders and coatings for high Cr capture capacity under systems operating conditions; >Developed computational models to understand mechanistic behavior; Experimentally measure rate of Cr evaporation from chromia and alumina forming alloys under SOFC operating conditions; Developed conditions to minimize Cr evaporation from balance-of-plant alloys; This innovation will support the development of getter platform to capture both intrinsic and extrinsic impurities present in air; and, Applications under wide operating temperature range (500-900°C) as well for wide high-temperature electrochemical systems (SOFC, SOEC, and OTM). The work has been successfully developed, validated experimentally and implemented. Successful technology transfer of this knowledge with industrial partners has been accomplished and the getters have been independently tested and validated under their systems operating conditions. The innovation will also find application in related high temperature electrochemical systems such as OTM and SOEC for the prevention of Cr assisted performance degradation. The proposed approach for Cr capture can also be applied to oxy-combustion and other advanced combustion techniques for the reduction of Cr vapor in the exhaust gas stream. This fundamental knowledge gained also has led to the path forward for developing advanced getters for capturing more than one contaminant in air.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2026

Oakland University Cybersecurity Center (Final Scientific/Technical Report)

This report summarizes the outcomes of Award DE-CR0000023, “Oakland University Cybersecurity Center,” a 31-month project funded by the U.S. Department of Energy Office of Cybersecurity, Energy Security, and Emergency Response (CESER). The project addressed cybersecurity risks facing small and medium-sized manufacturers (SMMs) transitioning to Industry 4.0. The project integrated customer discovery, applied research, and cybersecurity training development. A total of 51 cybersecurity assessments identified significant gaps in baseline practices, incident response, and workforce capability. Research efforts produced a scalable mitigation framework tailored to SMM environments, and workforce analysis identified persistent talent gaps. Eight cybersecurity training modules were developed and deployed via Oakland University’s Professional and Continuing Education (PACE) platform. All objectives were completed, with 98.93% federal budget utilization and cost share exceeding requirements. The project establishes a scalable model for strengthening cybersecurity resilience and workforce capacity across U.S. manufacturing supply chains.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Deep Reinforcement Learning for Distribution System Operations: A Tutorial and Survey

Here, the rapid evolution of modern electric power distribution systems into complex networks of interconnected active devices, distributed generation (DG), and storage poses increasing difficulties for system operators. The large-scale integration of distributed energy resources (DERs) and the rapid exchange of measurement data via communication networks present major opportunities for advancing grid operations but also introduce greater uncertainty, higher data dimensionality, more complex network and device models, and challenging control and optimization problems. Deep reinforcement learning (DRL) algorithms are promising in addressing these challenges. However, they have not been effectively adapted for power systems applications, requiring extensive customization for implementation and evaluation. This has resulted in reproducibility challenges and a steep learning curve for researchers new to applying DRL algorithms to the power systems domain. To bridge these gaps, this tutorial aims to serve as a valuable resource for researchers interested in exploring learning-based algorithms to operate active power distribution networks. Specifically, this work presents a generalized process for translating sequential decision-making problems in power distribution systems into Markov decision process (MDP) formulations, illustrated through concrete grid service examples. Additionally, we introduce a simple environment design strategy to develop and evaluate example DRL algorithms for distribution system applications, complete with an included code repository to guide users through environment construction.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗