Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network partition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

143 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Exploring Sources of Surface Bias in HRRR Using New York State Mesonet

In recent years, there has been increasing demand for applications of short-term forecasting of renewable energy potential and assessments of the likelihood of extreme weather events using the High-Resolution Rapid Refresh (HRRR) model. Examining the biases in the newest version of HRRR is necessary to promote further model development. Using data from one of the most comprehensive and dense monitoring networks, New York State Mesonet (NYSM), we evaluate the HRRR version 3 meteorological fields for an entire year. In this work, the land-atmosphere-cloud coupling system is evaluated as an integrated whole. We investigate the physical processes influencing the soil hydrological balance and the thermodynamic interactions, from surface fluxes up to the level of boundary layer convection from both temporal (seasonal and diurnal) and spatial perspectives. Results show that the model 2 m temperature and humidity biases are seasonally dependent, with warm and dry bias present during the warm season, and an extreme nocturnal cold bias in winter. The summer warm bias includes both a land-surface-induced bias and a cloud-induced bias. Inaccurate representation of energy partition and soil hydrological process across different land use types as well as a hydrological bias in describing spring snowmelt are identified as the main source of the land-surface-induced bias. A feedback loop linking cloud presence, flux changes, and temperature contributes to the cloud-induced bias. The positive solar radiation bias increases from clear sky to overcast sky conditions. The most significant bias occurs during overcast and thick cloud conditions associated with frontal passage and thunderstorms.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A Participation Factor-Based Approach for Defining the EMT Model Boundary for Power System Simulations with Inverter-Based Resources

The increasing penetration of inverter-based resources (IBRs) introduces new challenges to power system simulations, particularly with the emergence of fast electromagnetic transient (EMT) dynamics and sub-synchronous oscillations (SSO) that require time-consuming EMT simulations. To reduce the time cost for simulating a large-scale power grid with IBRs, this paper proposes a novel participation factor-based approach for defining a critical zone for detailed EMT modeling and simulations, which includes the IBRs, synchronous generators, and the network components participating significantly in simulated contingencies. Both model-based and response-based methods are introduced for the estimation of participation factors (PFs). The case study on the 240-bus Western Electricity Coordinating Council (WECC) system demonstrates that the EMT zone determined by the proposed approach can effectively capture power system dynamics involving IBRs.

EMT simulation↗
DOE OSTI2025

GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism

Graph neural networks (GNNs), an emerging class of machine learning models for graphs, have gained popularity for their superior performance in various graph analytical tasks. Mini-batch training is commonly used to train GNNs on large graphs, and data parallelism is the standard approach to scale mini-batch training across multiple GPUs. Data parallel approaches contain redundant work as subgraphs sampled by different GPUs contain significant overlap. To address this issue, we introduce a hybrid parallel mini-batch training paradigm called Split parallelism. Split parallelism avoids redundant work by splitting the sampling, loading, and training of each mini-batch across multiple GPUs. Split parallelism, however, introduces communication overheads that can be more than the savings from removing redundant work. We further present a lightweight partitioning algorithm that probabilistically minimizes these overheads. We implement spllit parllelism in GSplit and show that it outperforms state-of-the-art mini-batch training systems like DGL, Quiver, and P3.

Lim, Seung-Hwan [ORNL] (ORCID:0000000194616866)↗
DOE OSTI2025

Gap-filled methane and carbon dioxide fluxes across two ecosystem states at the US-OWC AmeriFlux site (2015−2016, 2020−2022)

This dataset contains gap-filled measurements of methane flux (FCH4), net ecosystem CO2 exchange (NEE) partitioned into gross primary productivity (GPP) and ecosystem respiration (RE), as well as latent heat flux (LE) from a Great Lakes coastal freshwater wetland at the US-OWC AmeriFlux site. The dataset covers the peak growing seasons (June−September) of 2015−2016, dominated by Typha spp., and 2020−2022, characterized by floating-leaved species (lotus and water lily). These data were generated to investigate how rising water levels and vegetation shifts influence CH4 and CO2 fluxes across two distinct ecosystem states in this wetland. The dataset, provided in CSV format, includes half-hourly gap-filled flux data from June to September for 2015, 2016, 2020, 2021, and 2022. The gap-filled data refers to measurements where missing values due to instrument issues or quality control were filled using artificial neural networks (ANNs).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

DFSynthesizer: Dataflow-based Synthesis of Spiking Neural Networks to Neuromorphic Hardware

Spiking Neural Networks (SNNs) are an emerging computation model that uses event-driven activation and bio-inspired learning algorithms. SNN-based machine learning programs are typically executed on tile-based neuromorphic hardware platforms, where each tile consists of a computation unit called a crossbar, which maps neurons and synapses of the program. However, synthesizing such programs on an off-the-shelf neuromorphic hardware is challenging. This is because of the inherent resource and latency limitations of the hardware, which impact both model performance, e.g., accuracy, and hardware performance, e.g., throughput. We propose DFSynthesizer, an end-to-end framework for synthesizing SNN-based machine learning programs to neuromorphic hardware. The proposed framework works in four steps. First, it analyzes a machine learning program and generates SNN workload using representative data. Second, it partitions the SNN workload and generates clusters that fit on crossbars of the target neuromorphic hardware. Third, it exploits the rich semantics of the Synchronous Dataflow Graph (SDFG) to represent a clustered SNN program, allowing for performance analysis in terms of key hardware constraints such as number of crossbars, dimension of each crossbar, buffer space on tiles, and tile communication bandwidth. Finally, it uses a novel scheduling algorithm to execute clusters on crossbars of the hardware, guaranteeing hardware performance. We evaluate DFSynthesizer with 10 commonly used machine learning programs. Our results demonstrate that DFSynthesizer provides a much tighter performance guarantee compared to current mapping approaches.

Computer Science↗
DOE OSTI2024

A Full-Stack Exploration of Language-Based Parallelism in Fortran 2023

This poster explores native parallel features in Fortran 2023 through the lens of supporting applications with libraries, compilers, and parallel runtimes. The language revision informally named Fortran 2008 introduced parallelism in the form of Single Program Multiple Data (SPMD) execution with two broad feature sets: (1) loop-level parallelism via do concurrent and (2) a Partitioned Global Address Space (PGAS) comprised of distributed “coarray” data structures. Fortran’s native parallelism has demonstrated high performance [1] and reduced the burden of inserting what sometimes amounts to more directives than code. Several compilers support both feature sets, typically by translating do concurrent into serial do loops annotated by parallel directives and by translating SPMD/PGAS features into direct calls to a communication library. Our research focuses primarily on two questions: (1) can the compiler’s parallel runtime library be developed in the language being compiled (Fortran) and (2) can we define an interface to the runtime that liberates compilers from being hardwired to one runtime and vice versa. We are answering these questions by developing the Parallel Runtime Interface for Fortran (PRIF) [2] and the Co-Array Fortran Framework of Efficient Interfaces to Network Environments (Caffeine) [3]. Caffeine is initially targeting adoption by LLVM Flang, a new open-source Fortran compiler developed by a broad community in industry, academia, and government labs. We are also exploring the use of these features in Inference-Engine, a deep learning library designed to facilitate neural network training and inference for high-performance computing applications written in modern Fortran.

Rasmussen, Katherine↗
DOE OSTI2025

A distributed voltage inference framework for cyber-physical attacks detection and localization in active distribution grids

The transition to active distribution grids with real-time monitoring and control depends on the proliferation of advanced communication networks and devices. This paradigm shift towards a cyber-physical architecture also introduces new vulnerabilities for adversaries to exploit and launch sophisticated cyber-physical attacks targeting grid observability. Current research highlights the challenges in distinguishing attacks on voltage phasor or nodal injection measurements and isolating multi-source attack locations in a multiphase distribution grid. The attack detection and localization methods in literature face accuracy issues, applications across diverse attack scenarios, or scalability limits. Here, to bridge these gaps, this paper proposes a distributed Voltage Inference framework for real-time detection and localization of cyber-physical attacks, addressing scalability, adaptability, and accuracy challenges in state-of-the-art methods. The proposed methodology leverages the distributed nature of the Voltage Inference framework through a two-step process of prediction and correction, together with a tractable graph partitioning approach, providing a reliable solution to identify compromised measurement sources and facilitate isolation. Extensive testing on IEEE 13 and 123-node distribution feeders underscores the algorithm’s efficacy, enhancing the security and resilience of active distribution grids against evolving cyber threats. Additionally, Hardware-in-the-Loop (HIL) implementation validates the proposed strategy’s practical applicability in real-world scenarios.

active distribution grids↗
DOE OSTI2026

Cave-based chronology of valley incision in the glaciated Northern Carpathians

While glaciers leave a mark on mountain landscapes, the importance of glacial erosion in mountains at a global scale remains insufficiently constrained despite over a century of research aimed at quantifying the rates and magnitudes of such erosion. Measuring rates of landscape change across the Quaternary in repeatedly glaciated mountain landscapes requires the ability to accurately partition the relative role of glacial versus fluvial processes in forming relief; however, the modification of landforms by surface erosion hinders quantification of process rates over the last few million years. This study presents 32 paired 26 Al and 10 Be cosmogenic nuclide burial ages from allochthonous, quartz-bearing sediment deposited within a paleophreatic karst system in the northern Carpathians. These data quantify Pliocene-to-present timing of valley incision and karst system reactivation, as well as erosion rates over time. Post-burial, muon production-correction yields 24 fully resolved ages, six minimum ages, and two unresolvable ages. Burial ages are interpreted to document the tempo of valley incision via phreatic passage formation and reveal that ∼80% of current valley relief (∼700 m) had developed by approximately 1.6 Ma. Paleoerosion rates derived from this dataset suggest little change in the processes generating sediment washed into the karst networks since the Pliocene. These results suggest that river incision dominated relief creation in Carpathian valleys that bear the imprint of glaciation. Our findings suggest the importance of investigating other mid-latitude mountainous regions worldwide to determine if they have similar erosion and topographic histories.

Carpathians↗
DOE OSTI2023

A Methodology for Estimating the Energy and Moisture Budget of the Convective Boundary Layer Using Continuous Ground-Based Infrared Spectrometer Observations

Abstract Land–atmosphere interactions play a critical role in both the atmospheric water and energy cycles. Changes in soil moisture and vegetation alter the partitioning of surface water and energy fluxes, influencing diurnal evolution of the planetary boundary layer (PBL). The mixing-diagram framework has proven useful in understanding the evolution of the heat and moisture budget within the convective boundary layer (CBL). We demonstrate that observations from the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site provide all of the needed inputs needed for the mixing-diagram framework, allowing us to quantify the impact from the surface fluxes, advection, radiative heating, encroachment, and entrainment on the evolution of the CBL. Profiles of temperature and humidity retrieved from the ground-based infrared spectrometer [Atmospheric Emitted Radiance Interferometer (AERI)] are a critical component in this analysis. Large-eddy simulation results demonstrate that mean mixed-layer values derived are shown to be critical to close the energy and moisture budgets. A novel approach demonstrated here is the use of network of AERIs and Doppler lidars to quantify the advective fluxes of heat and moisture. The framework enables the estimation of the entrainment fluxes as a residual, providing a way to observe the entrainment fluxes without using multiple lidar systems. The high temporal resolution of the AERI observations enables the morning, midday, and afternoon evolution of the CBL to be quantified. This work provides a new way to use observations in this framework to evaluate weather and climate models. Significance Statement The energy and moisture budget of the planetary boundary layer (PBL) is influenced by multiple sources, and accurately representing this evolution in numerical models is critical for weather forecasts and climate predictions. The mixing-diagram approach, driven by profiling observations as illustrated here, provides a powerful way to quantify the contributions from each of these sources. In particular, the energy and moisture mixed into the PBL from above the PBL can be determined accurately from ground-based remote sensors using this approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Contact-dependent growth inhibition (CDI) systems deploy a large family of polymorphic ionophoric toxins for inter-bacterial competition

Contact-dependent growth inhibition (CDI) is a widespread form of inter-bacterial competition mediated by CdiA effector proteins. CdiA is presented on the inhibitor cell surface and delivers its toxic C-terminal region (CdiA-CT) into neighboring bacteria upon contact. Inhibitor cells also produce CdiI immunity proteins, which neutralize CdiA-CT toxins to prevent auto-inhibition. Here, we describe a diverse group of CDI ionophore toxins that dissipate the transmembrane potential in target bacteria. These CdiA-CT toxins are composed of two distinct domains based on AlphaFold2 modeling. The C-terminal ionophore domains are all predicted to form five-helix bundles capable of spanning the cell membrane. The N-terminal "entry" domains are variable in structure and appear to hijack different integral membrane proteins to promote toxin assembly into the lipid bilayer. The CDI ionophores deployed by E. coli isolates partition into six major groups based on their entry domain structures. Comparative sequence analyses led to the identification of receptor proteins for ionophore toxins from groups 1 & 3 (AcrB), group 2 (SecY) and groups 4 (YciB). Using forward genetic approaches, we identify novel receptors for the group 5 and 6 ionophores. Group 5 exploits homologous putrescine import proteins encoded by puuP and plaP, and group 6 toxins recognize di/tripeptide transporters encoded by paralogous dtpA and dtpB genes. Finally, we find that the ionophore domains exhibit significant intra-group sequence variation, particularly at positions that are predicted to interact with CdiI. Accordingly, the corresponding immunity proteins are also highly polymorphic, typically sharing only ~30% sequence identity with members of the same group. Competition experiments confirm that the immunity proteins are specific for their cognate ionophores and provide no protection against other toxins from the same group. The specificity of this protein interaction network provides a mechanism for self/nonself discrimination between E. coli isolates.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Efficient shallow Ritz method for 1D diffusion problems

This paper studies the shallow Ritz method for solving the one-dimensional diffusion problem. It is shown that the shallow Ritz method improves the order of approximation dramatically for non-smooth problems. To realize this optimal or nearly optimal order of the shallow Ritz approximation, we develop a damped block Newton (dBN) method that alternates between updates of the linear and non-linear parameters. Per each iteration, the linear and the non-linear parameters are updated by exact inversion and one step of a modified, damped Newton method applied to a reduced non-linear system, respectively. The computational cost of each dBN iteration is $\mathcal{O}$(n). Starting with the non-linear parameters as a uniform partition of the interval, numerical experiments show that the dBN is capable of efficiently moving mesh points to nearly optimal locations. In conclusion, to improve the efficiency of the dBN further, we propose an adaptive damped block Newton (AdBN) method by combining the dBN with the adaptive neuron enhancement (ANE) method [28].

Diffusion problems↗
DOE OSTI2024

Privacy-Preserving Control of Partitioned Energy Resources

Distributed energy resources are an increasingly important part of the electric grid. We examine the problem of partitioning a distributed energy resource among many users while providing privacy to them. In this model, clients can send requests to a server, the server can verify that the requests are valid and aggregate them, but it cannot see the actual values in the requests. Without privacy, each user is forced to reveal their daily schedule or energy use. Energy resources add a novel challenge that prior systems do not address: they require verifying limits on private power (a rate over time) and energy (a sum) values. Furthermore, the cryptographic mechanisms must run on embedded energy control systems. We describe Weft, a novel cryptographic system that verifies both power (rate) and energy (integral) constraints on private client values and aggregates them. The key insight behind the approach is to rely on additively homomorphic secret shares, which allows servers to compute sums from rates. We present 3 cryptographic proof systems with different system trade-off for embedded systems: bit-splitting proofs minimize memory use, sorting proofs minimize computation, and commitment proofs minimize network communication. Using bit-splitting proofs, it takes an IoT client using a CortexM microcontroller 4 minutes of compute time to privately control its share of an energy resource for a day at 20s granularity.

Laufer, Evan↗
DOE OSTI2022

A Multistage Stochastic Transmission Expansion Algorithm for Wide-Area Planning under Uncertainty

The overall objective for this project was to develop and demonstrate a set of methods for solving the transmission investment problem for a large network considering many possible scenarios of future conditions and multiple decision points when investments can be made. Project sub-objectives achieved this goal through a succession of extending the methods to apply to problems with increasing complexity or additional features, including the number of decision points, whether generation and transmission are co-optimized, and whether AC or DC power flow is used. A transmission model was developed for the Western Electric Coordinating Council (WECC) region, the high-voltage transmission system that serves the western third of the continental U.S. Using a dataset provided by WECC and by researchers from John Hopkins University, we have validated and demonstrated the model and used it to compare the new method for solving multi-stage stochastic transmission planning to several state-of-the-art techniques. The project has resulted in several key outcomes and achievements: The covariance-based method for choosing a small set of hours to represent short-term variability has superior performance in terms of accuracy to existing methods, including K-means clustering and Importance Sampling; The combined partitioning method for long-term uncertainty with the nested clustering approach for choosing representative hours for each long-term group has superior accuracy for equivalent computational effort compared with existing methods; Using the partitioning/clustering method combined with Sample Average Approximation provides both statistical bounds on the quality of the solution and at the same time, a complete investment plan for all contingencies in the full uncertainty set; no existing methods can provide both at the same time; The method is demonstrated to work well for choosing both transmission and generation investments; A variant on the method allows for both scenario selection and simultaneous correction for the error from the DC power flow approximation to provide a tractable method for AC power flow-based transmission planning under uncertainty; The method applied to the WECC case study demonstrates the additional value to the system operator and the consumer of identifying flexible investment options in the near-term decisions. In particular, the case study exhibits significant option value in postponing some transmission additions that appear useful but in some long-term system states create new congestion problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Identification of genetic interactions with priB links the PriA/PriB DNA replication restart pathway to double-strand DNA break repair in Escherichia coli

Collisions between DNA replication complexes (replisomes) and impediments such as damaged DNA or proteins tightly bound to the chromosome lead to premature dissociation of replisomes at least once per cell cycle in Escherichia coli. Left unrepaired, these events produce incompletely replicated chromosomes that cannot be properly partitioned into daughter cells. DNA replication restart, the process that reloads replisomes at prematurely terminated sites, is therefore essential in E. coli and other bacteria. Three replication restart pathways have been identified in E. coli: PriA/PriB, PriA/PriC, and PriC/Rep. A limited number of genetic interactions between replication restart and other genome maintenance pathways have been defined, but a systematic study placing replication restart reactions in a broader cellular context has not been performed. We have utilized transposon-insertion sequencing to identify new genetic interactions between DNA replication restart pathways and other cellular systems. Known genetic interactors with the priB replication restart gene (uniquely involved in the PriA/PriB pathway) were confirmed and several novel priB interactions were discovered. Targeted genetic and imaging-based experiments with priB and its genetic partners revealed significant double-strand DNA break accumulation in strains with mutations in dam, rep, rdgC, lexA, or polA. Modulating the activity of the RecA recombinase partially suppressed the detrimental effects of rdgC or lexA mutations in ΔpriB cells. Taken together, our results highlight roles for several genes in double-strand DNA break homeostasis and define a genetic network that facilitates DNA repair/processing upstream of PriA/PriB-mediated DNA replication restart in E. coli.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Heterosynaptic plasticity in biomembrane memristors controlled by pH

Abstract In biology, heterosynaptic plasticity maintains homeostasis in synaptic inputs during associative learning and memory, and initiates long-term changes in synaptic strengths that nonspecifically modulate different synapse types. In bioinspired neuromorphic circuits, heterosynaptic plasticity may be used to extend the functionality of two-terminal, biomimetic memristors. In this article, we explore how changes in the pH of droplet interface bilayer aqueous solutions modulate the memristive responses of a lipid bilayer membrane in the pH range 4.97–7.40. Surprisingly, we did not find conclusive evidence for pH-dependent shifts in the voltage thresholds ( V* ) needed for alamethicin ion channel formation in the membrane. However, we did observe a clear modulation in the dynamics of pore formation with pH in time-dependent, pulsed voltage experiments. Moreover, at the same voltage, lowering the pH resulted in higher steady-state currents because of increased numbers of conductive peptide ion channels in the membrane. This was due to increased partitioning of alamethicin monomers into the membrane at pH 4.97, which is below the pKa (~5.3–5.7) of carboxylate groups on the glutamate residues of the peptide, making the monomers more hydrophobic. Neutralization of the negative charges on these residues, under acidic conditions, increased the concentration of peptide monomers in the membrane, shifting the equilibrium concentrations of peptide aggregate assemblies in the membrane to favor greater numbers of larger, increasingly more conductive pores. It also increased the relaxation time constants for pore formation and decay, and enhanced short-term facilitation and depression of the switching characteristics of the device. Modulating these thresholds globally and independently of alamethicin concentration and applied voltage will enable the assembly of neuromorphic computational circuitry with enhanced functionality. Impact statement We describe how to use pH as a modulatory “interneuron” that changes the voltage-dependent memristance of alamethicin ion channels in lipid bilayers by changing the structure and dynamical properties of the bilayer. Having the ability to independently control the threshold levels for pore conduction from voltage or ion channel concentration enables additional levels of programmability in a neuromorphic system. In this article, we note that barriers to conduction from membrane-bound ion channels can be lowered by reducing solution pH, resulting in higher currents, and enhanced short-term learning behavior in the form of paired-pulse facilitation. Tuning threshold values with environmental variables, such as pH, provide additional training and learning algorithms that can be used to elicit complex functionality within spiking neural networks. Graphical abstract

36 MATERIALS SCIENCE↗
DOE OSTI2023

Elucidating the speciation of extracted lanthanides by diglycolamides

Many studies over the past few decades have been devoted to addressing the application of diglycolamides (DGAs) for hydrometallurgical-based, f-element separations. Work to date has shown the molecular structure of a DGA derivative can have a significant impact on intra-lanthanide partitioning patterns. More recent studies have pushed towards probing the structure function relationship of the lanthanide-DGA complex to enable the design of more efficient lanthanide separation systems. Spectroscopic techniques, such as UV–Visible, Fourier Transformed Infrared Spectroscopy (FT-IR), Nuclear Magnetic Resonance (NMR), and Extended X-ray Absorption Fine Structure (EXAFS), provide information regarding the inner-sphere coordination of a given lanthanide-DGA complex. Scattering techniques, such as Dynamic Light Scattering (DLS), Small-Angle X-ray Scattering (SAXS), and Small-Angle Neutron Scattering (SANS), address nanoscale structures including aggregate sizes and morphology. Here, this review assesses the current state-of-knowledge regarding lanthanide-DGA hydrometallurgical (i.e., solvent extraction systems) interrogated using spectroscopic and scattering techniques to characterize the extracted Ln 3+ DGA species. Of particular interest to this review is the impact of varied diluents, inclusion and variation of phase modifiers, and DGA derivatization on system characteristics. While there has been extensive literature on the application of DGAs for f-element separations, the literature lacks a collective assessment of the speciation of Ln 3+ in the organic phase. This review provides new insights into the field of DGA separations, explicitly with an application to intra-lanthanide separations. Specifically, this review illustrates the importance of both the co-extraction anion (Cl - , NO 3 - , or ClO 4 - ) as it pertains to both the aggregate size and Ln 3+ distribution coefficient. It is evident the ability of the anion to disrupt the hydrogen bonding network limits both aggregate size and distribution coefficients according to the Hoffmeister series. This suggests the importance of the large, softer anions with a low charge-to-surface area ratio on encouraging hydrogen bond interactions. In addition, the co-extracted cation (H + vs Na + ) is important for mitigating transfer of Ln 3+ from the aqueous to the organic phase through extensive hydrogen bonding networks. These networks are responsible for forming supramolecular aggregates where a change in morphology is observed with increasing concentrations of H + and/or Ln 3+ in the organic phase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Final Report)

The AGGREGATE project team successfully developed and validated various modules for outage management. Brief summaries of each module are provided to showcase their strength for outage management and restoration for a distribution system with a high penetration of connected distribution energy resources (DERs). In recent years, inverter-based DERs have been widely deployed in distribution system. A most of behind-the-meter (BTM) solar power generation is not visible to the utility. The data-driven DER and load estimation modules are using machine learning (ML) and artificial intelligence (AI) to manage this issue, which provides an opportunity for distribution system operators (DSOs) to operate systems and make decisions in real-time for a distribution system with a high penetration of DERs deployed. Also, the estimated DER and true load can be further leveraged in network aggregation and cold-load pick up estimation for reducing the computing complexity and providing for fast restoration. After load demand and DER power generations have been estimated, the information will support topology and state estimation (SE). The topology estimation module demonstrated the viability of mixed integer linear programming (MILP) formulation to estimate the most likely operational radial topology and outage sections using power flow measurements, historical/estimated load and DERs data and smart meter ping measurements. Formulation includes continuous (power flow, load and DERs data) and binary measurements (smart meter ping measurements) in a single formulation. Errors in continuous data and binary data are modeled as normal distribution and Bernoulli distribution, respectively. In the future distribution grid, the power injection from controllable DERs will be essential for efficient and resilient grid operation. However, determining the optimal DER injections and restoration actions is dependent on knowledge of the system states. State estimation (SE), already the cornerstone of transmission energy management systems, will become commonplace in distribution management systems as more measurements become available from deployment of automated metering infrastructure (AMI). Observability analysis is the first step in SE, as it determines the sufficiency of the available measurements for accurately estimating the current system states. A new type of pseudo-measurement called a Correlational Measurement (CM) is introduced in this module, to enhance the observability of the system to enable more accurate SE. CMs encapsulate knowledge of correlation between demand patterns for similar classes of loads as well as injection patterns for same-technology renewable DERs. During grid contingency scenarios, DERs have been traditionally disconnected, without any fault ride-through capabilities. However, with new regulations and better technology, it is feasible for these resources to contribute to the grid’s restoration after an adverse event and hence enhance resilience. The controllability module proposes a two-step restoration scheme for the power system restoration process by leveraging additional degrees of freedom in power electronics interfaced DERs for mitigating voltage problems. In a resilience mode without the utility system, the distribution grid relies on DERs to serve critical load. In such a severe event with multiple faults on the distribution feeders, actuation of various protective devices (PDs) divides the distribution system into electrical islands. The undetected actuated PDs due to fault current contributions from DERs can delay the restoration process, thereby reducing the system resilience. The Advanced Outage Management (AOM) and the Advanced Feeder Restoration (AFR) modules developed in this project provide improved system resilience with multiple DERs. AOM identifies the faulted sections and actuated PDs in a distribution system with DERs by incorporating smart meter data. The most credible outage scenario including fault locations, PD actuations, and fault indicator (FI) failures is identified by a set of binary integer linear programming incorporating hypotheses. The AFR module serves to restore a distribution system with available energy resources taking into consideration the availability of utility sources and DERs. By partitioning the system into islands, critical load will be served with the available generation resources within islands based on the solution of a MILP. When the utility systems become available, the optimal path will be determined by a spanning tree search algorithm that reconnects these islands back to substations and restores the remaining load. The transmission and distribution (T&D) co-simulation module was used to validate the effect of a control action performed on the distribution side assets as it propagates to the transmission side. This ensures that the control action performed results in a feasible operating point on both the transmission and the distribution system. In addition to validation, the team used the T&D co-simulation module to demonstrate how distribution system assets can be used to mitigate issues on the transmission system. Specifically, the team demonstrated that appropriate switching operations on the distribution side can alleviate the line overload condition on the transmission side without causing new operational constraint violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗