Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex simulations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Qubit Lattice Algorithms Based on the Schrödinger-Dirac Representation of Maxwell Equations and Their Extensions

It is well known that Maxwell equations can be expressed in a unitary Schrodinger-Dirac representation for homogeneous media. However, difficulties arise when considering inhomogeneous media. A Dyson map points to a unitary field qubit basis, but the standard qubit lattice algorithm of interleaved unitary collision-stream operators must be augmented by some sparse non-unitary potential operators that recover the derivatives on the refractive indices. Here, the effect of the steepness of these derivatives on two-dimensional scattering is examined with simulations showing quite complex wavefronts emitted due to transmissions/reflections within the dielectric objects. Maxwell equations are extended to handle dissipation using Kraus operators. Then, our theoretical algorithms are extended to these open quantum systems. A quantum circuit diagram is presented as well as estimates on the required number of quantum gates for implementation on a quantum computer.

2D electromagnetic scattering↗
DOE OSTI2024

How microscopic epistasis and clonal interference shape the fitness trajectory in a spin glass model of microbial long-term evolution

The adaptive dynamics of evolving microbial populations takes place on a complex fitness landscape generated by epistatic interactions. The population generically consists of multiple competing strains, a phenomenon known as clonal interference. Microscopic epistasis and clonal interference are central aspects of evolution in microbes, but their combined effects on the functional form of the population’s mean fitness are poorly understood. Here, we develop a computational method that resolves the full microscopic complexity of a simulated evolving population subject to a standard serial dilution protocol. Through extensive numerical experimentation, we find that stronger microscopic epistasis gives rise to fitness trajectories with slower growth independent of the number of competing strains, which we quantify with power-law fits and understand mechanistically via a random walk model that neglects dynamical correlations between genes. We show that increasing the level of clonal interference leads to fitness trajectories with faster growth (in functional form) without microscopic epistasis, but leaves the rate of growth invariant when epistasis is sufficiently strong, indicating that the role of clonal interference depends intimately on the underlying fitness landscape. The simulation package for this work may be found at https://github.com/nmboffi/spin_glass_evodyn .

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

How microscopic epistasis and clonal interference shape the fitness trajectory in a spin glass model of microbial long-term evolution

The adaptive dynamics of evolving microbial populations takes place on a complex fitness landscape generated by epistatic interactions. The population generically consists of multiple competing strains, a phenomenon known as clonal interference. Microscopic epistasis and clonal interference are central aspects of evolution in microbes, but their combined effects on the functional form of the population’s mean fitness are poorly understood. Here, we develop a computational method that resolves the full microscopic complexity of a simulated evolving population subject to a standard serial dilution protocol. Through extensive numerical experimentation, we find that stronger microscopic epistasis gives rise to fitness trajectories with slower growth independent of the number of competing strains, which we quantify with power-law fits and understand mechanistically via a random walk model that neglects dynamical correlations between genes. We show that increasing the level of clonal interference leads to fitness trajectories with faster growth (in functional form) without microscopic epistasis, but leaves the rate of growth invariant when epistasis is sufficiently strong, indicating that the role of clonal interference depends intimately on the underlying fitness landscape. The simulation package for this work may be found at https://github.com/nmboffi/spin_glass_evodyn .

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Visualization of Jet Impingement and Ignition in a Piston-Cylinder Chamber

The transportation sector accounts for almost a third of the United States energy consumption. We are developing predictive simulations of the complex in-cylinder processes of internal combustion engines to improve performance and decrease pollutant emissions. Using volume rendering, we provide a first look at the jet impingement and ignition inside a piston-cylinder chamber. Through the visualization, we were able to construct a complete 3D picture of the jet impingement on the piston-bowl walls leading to the formation of pockets of auto-ignition of fuel-air mixture. These auto-ignition pockets subsequently lead to flame stabilization releasing the chemical energy for conversion to useful work. A detailed physical picture of flame stabilization as provided by the visualization techniques presented in this study help in the design next-generation internal combustion engines.

91 SC - Advanced Scientific Computing Reseach (ASC↗
DOE OSTI2023

Qubit Lattice Algorithms based on the Schrodinger-Dirac representation of Maxwell Equations and their Extensions

It is well known that Maxwell equations can be expressed in a unitary Schrodinger-Dirac representation for homogeneous media. However, difficulties arise when considering inhomoge- neous media. A Dyson map points to a unitary field qubit basis, but the standard qubit lattice algorithm of interleaved unitary collision-stream operators must be augmented by some sparse non-unitary potential operators that recover the derivatives on the refractive indices. The effect of the steepness of these derivatives on two dimensional scattering is examined with simulations showing quite complex wavefronts emitted due to transmissions/reflections within the dielectric objects. Maxwell equations are extended to handle dissipation using Kraus operators. Then, our theoretical algorithms are extended to these open quantum systems. A quantum circuit diagram is presented as well as estimates on the required number of quantum gates for implementation on a quantum computer.

Vahala, George↗
DOE OSTI2020

Efficient Mesofluidic Separation of Large Particles in nuclear slurries - 20408

Efficient and effective particle separation is essential to cleanup of many nuclear wastes. For example, particle separation may be used to accelerate settle-decant bottlenecks that limit the throughput necessary to achieve the U.S. Department of Energy waste cleanup mission in a timely manner. Particle separation may be used to protect downstream processing equipment from pulses of solids that may be encountered near (within a few feet of) liquid-solid interfaces during waste transfer operations, thereby preventing work stoppages. Effective particle separation may permit efficient sludge washing. These are only a few of the ways in which particle separation is important. Yet, efficient and effective particle separation in nuclear processing environments remains challenging. For example, settle-decant operations permit larger and heavier particles to settle, leaving smaller, lighter particles suspended. However, settle-decant operations are slow, convection currents may resuspend solids, hindered settling of multicomponent slurries remains incompletely understood, and predictive models for settling in graduated cylinders fail to match limited observations of settling in large waste tanks. Additionally, pumping operations can cause turbulent resuspension of particles when the pump intake is close to the settled solids layer. Filtration techniques that use membranes or partially permeable barriers retain larger particles, permitting smaller particles to permeate. However, filters, including dead-end filtration, are prone to clogging and caking, operate at elevated pressures due to minimal void volume, and increase in pressure during operations, which require more control systems. Therefore, the need for high throughput particle separation techniques that operate with modest pressure drops persists. A novel mesofluidic separator presents the opportunity to effectively and efficiently accelerate the waste cleanup mission. The separator separates large particles from process streams across a broad range of particle sizes and has no moving parts or media to replace, regenerate, or clean. This separator design has an unusually large void volume, permitting operation at much higher flow rates (and lower pressures) than traditional filtration (e.g., dead-end filtration). Industrial-scale flow rates have been demonstrated. In performance testing, mesofluidic separators operate at might flow rates (>90 gpm (0.0006 m{sup 3}/s) in piping 3 inches (0.08 m) in diameter; Re>10{sup 5}), with modest pressure drop (∼25 psi (170 KPa) in testing). In complex, aggregating waste simulants, the separator loses <25% of flow projected over months without back pulsing or chemical cleaning. Mesofluidic separation presents infrastructure advantages, reduces risk, and provides mission impact. Infrastructure advantages include implementation within existing transfer systems, plug and play without facility modifications to safety systems, and operation at low pressures. The separator is flexible in location, may be positioned within or outside of waste tanks, and may replace or augment dead-end and cross-flow filters. Mesofluidic separation reduces risk by minimizing waste (no media to replace or regenerate and no cleaning chemicals to handle and dispose) and by minimizing filter change-out consistent with as low as reasonably achievable (ALARA) exposure to workers. The potential mission impact of these separators is substantial. The separator has potential to support, simplify, and accelerate in-farm transfers and waste feed delivery. Furthermore, the separator can free up settling and holding tanks in the Direct Feed Low-Activity Waste (DFLAW) mission by reducing or eliminating post-transfer settling and wait times with the potential to free up 1 Mgal (4000 m{sup 3}) of double-shell tank space. This paper quantitatively compares mesofluidic separation to dead-end filtration, discusses scale-up results, and considers the separator's potential to efficiently and effectively reduce the long-term environmental ability of particulate-rich nuclear wastes. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Multi-Fidelity Modeling and Control for Building Temperature Control

The ability to control energy loads such as a building's heating, ventilation, and air conditioning (HVAC) system can help facilitate increased penetration of variable renewable energy sources into the electric grid. To be able to control these HVAC systems more effectively, detailed simulations of the corresponding building physics is becoming increasingly important. These detailed simulations can be complex, nonlinear, and can require immense computational power when used in an advanced control method such as model predictive control (MPC), prompting the need to explore less computationally intensive strategies. In this work, a multi-fidelity approach is proposed to combine samples from a complex, high-fidelity model with a simple, low-fidelity model within the MPC control loop. More specifically, the parameters of a reduced-order, linear building model are periodically updated with knowledge from its high-fidelity counterpart - an EnergyPlus model - in an online fashion using a Gaussian Process surrogate model. Hence, highly accurate predictions of current and future conditions in a building are maintained with a substantially reduced computational burden compared to using the high-fidelity models alone. In other words, this linear parameter varying model preserves the low computational requirements of a low-order linear model while accurately modeling a building's dynamics. This allows a building controller to take highly informed actions without requiring a large computational budget.

building modeling↗
DOE OSTI2025

Cosmological Constraints from Full-Scale Clustering and Galaxy-Galaxy Lensing with DESI DR1

We present constraints on cosmic structure growth from the analysis of galaxy clustering and galaxy-galaxy lensing with galaxies from the Dark Energy Spectroscopic Instrument (DESI) Data Release 1. We analyze four samples drawn from the Bright Galaxy Survey (BGS) and the Luminous Red Galaxy (LRG) target classes. Projected galaxy clustering measurements from DESI are supplemented with lensing measurements from the Dark Energy Survey (DES), the Kilo-Degree Survey (KiDS), and the Hyper Suprime-Cam (HSC) survey around the same targets. Our method relies on a simulation-based modeling framework using the AbacusSummit simulations and a complex halo occupation distribution model that incorporates assembly bias. We analyze scales down to $0.4 \, h^{-1} \, \mathrm{Mpc}$ for clustering and $2.5 \, h^{-1} \, \mathrm{Mpc}$ for lensing, leading to stringent constraints on $S_8 = σ_8 \sqrt{Ω_\mathrm{m} / 0.3}$ and $Ω_\mathrm{m}$ when fixing other cosmological parameters to those preferred by the CMB. We find $S_8 = 0.794 \pm 0.023$ and $Ω_\mathrm{m} = 0.295 \pm 0.012$ when using lensing measurements from DES and KiDS. Similarly, for HSC, we find $S_8 = 0.793 \pm 0.017$ and $Ω_\mathrm{m} = 0.303 \pm 0.010$ when assuming the best-fit photometric redshift offset suggested by the HSC collaboration. Overall, our results are in good agreement with other results in the literature while continuing to highlight the constraining power of non-linear scales.

Lange, Johannes U. [American U.] (ORCID:0000000224↗
DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗
DOE OSTI2026

Convective Biases in the US DOE Global Storm‐Resolving Model: Insights From Regionally Refined Simulations During the CACTI Campaign

Accurately simulating convective processes in complex terrain remains a critical challenge for global storm-resolving models (GSRMs). This study systematically evaluates moist convective biases in the Regionally Refined Mesh configuration of the U.S. Department of Energy Simple Cloud-Resolving E3SM Atmosphere Model (RRM-SCREAM) using comprehensive observations and large-eddy simulations from the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) campaign in the mountainous area of central Argentina. Comparisons of simulations with high-resolution observations and reanalysis data indicate that RRM-SCREAM effectively captures large-scale meteorological patterns, including regional atmospheric gradients and diurnal variability. However, RRM-SCREAM disproportionately produces smaller precipitation clusters referred to as “popcorn convection,” and exaggerated rainfall intensities compared to observations and reference models. Detailed examination of a representative orographic shallow-to-deep convective transition case shows that RRM-SCREAM delays initial shallow convection growth due to lower-tropospheric dryness and sustained convective inhibition, but once triggered, deep convection becomes overly vigorous with excessively strong vertical velocities and elevated cloud ice content, linked to a thermodynamic structure characterized by suppressed low-level moistening and excessive upper-level moisture retention. Our results highlight specific deficiencies in the model representation of convective vertical velocity, cloud microphysical processes, and convective precipitation organization within RRM-SCREAM. Addressing these biases is essential for improving the predictions of convective clouds and precipitation in the global high-resolution atmospheric models.

Su, Tianning [Lawrence Livermore National Laborato↗
DOE OSTI2020

Role of the Terrestrial Biosphere in Atmospheric Chemistry and Climate

The terrestrial biosphere–atmosphere interface provides a key chemical, biological, and physical lower boundary for the atmosphere. The presence of vegetation itself modifies the physical boundary, or the biogeophysical aspects of the system, by controlling important climate drivers such as soil moisture, light environment, and temperature. The leaf surface area of the terrestrial biosphere provides additional surface area for emissions, and it can be up to 55% of the total Earth’s surface area during the boreal summer. Vegetation also influences the biogeochemical aspects of the system by emitting a broad suite of reactive trace gases such as biogenic volatile organic compound (BVOC) emissions and climate-relevant primary biological aerosol particles (PBAP). Many of these emissions are a function of meteorological and climatological conditions at the surface, including temperature, light environment, soil moisture, and winds. Once emitted, they can be processed in the troposphere through a suite of chemical reactions. BVOC can contribute to the formation of ozone and secondary organic aerosols (SOA), and PBAP can rupture to form smaller particles with climatic relevance. These emissions and subsequent aerosol products can influence atmospheric processes that affect the surface climate, such as the attenuation of radiation, the formation of greenhouse gases such as ozone that can feedback to surface air temperature, and the alteration of clouds and subsequent precipitation. These atmospheric changes can then feedback to the land surface and emissions themselves, creating positive or negative feedback loops that can dampen or amplify the emission response. For the dominant BVOC isoprene, the feedback response to temperature can be positive or negative depending on ambient temperatures that drive isoprene emissions. The feedback response to soil moisture and precipitation can be positive, negative, or uncoupled depending on the moisture content of the soil and the total atmospheric aerosol loading. For light, the isoprene response can be positive or negative depending on the role of diffuse light. Overall, these feedbacks highlight the dynamical response of the biosphere to changing atmospheric conditions across a range of time scales, from minutes for trace gases and aerosols, to months for phenological changes, to years for land cover and land use change. Here, the dynamic aspect of this system requires us to understand, simulate, and predict the complex feedbacks between the biosphere and atmosphere and understand their role in the simulation and understanding of climate and global change. From the observational perspective, these feedbacks are challenging to identify in observations, and predictive modeling tools provide a crucial link for understanding how these feedbacks will change under warming climate scenarios.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Emulator of PR‐DNS: Accelerating Dynamical Fields With Neural Operators in Particle‐Resolved Direct Numerical Simulation

Abstract Particle‐resolved direct numerical simulations (PR‐DNS) play an increasing role in investigating aerosol‐cloud‐turbulence interactions at the most fundamental level of processes. However, the high computational cost associated with high resolution simulations poses considerable challenges for large domain or long duration simulation using PR‐DNS. To address these issues, here we present an emulator of the complex physics‐based PR‐DNS developed by use of the data‐driven Fourier Neural Operator (FNO) method. The effectiveness of the method is showcased by presenting turbulence and temperature fields in a two‐dimensional space. The results demonstrate high accuracy at various resolutions and the emulator is two orders of magnitude cheaper in terms of computational demand compared to the physics‐based PR‐DNS model. Furthermore, the FNO emulator exhibits strong generalization capabilities for different initial conditions and ultra‐high‐resolution without the need to retrain models. These findings highlight the potential of the FNO method as a promising tool to simulate complex fluid dynamics problems with high accuracy, computational efficiency, and generalization capabilities, enhancing our understanding of the aerosol‐cloud‐precipitation system.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

NREL: Working Towards a Superlab 2.0 With ESnet and Other National Laboratories

We can currently link models and simulations across the national laboratory complex, but imagine connecting these models with equipment, devices, and scientists so they can work together as if side by side instead of thousands of miles apart. In a future like this, researchers could run experiments that leverage thousands of devices to model the millions of devices that make up our increasingly complex energy systems. With such resources, labs could simulate, for example, the electric grid of California and validate control strategies to best serve critical loads during outages caused by wildfires. The National Renewable Energy Laboratory's (NREL's) Advanced Research on Integrated Energy Systems (ARIES) platform is making that vision a reality, one step at a time.

ARIES↗
DOE OSTI2023

Investigation on Tuning Power–Frequency Droop for Improved Grid–Forming Inverter and Synchronous Generator Transient Load Sharing

Poor transient load sharing has been observed during the parallel operation of synchronous generators (SGs) and droop-controlled grid-forming (GFM) inverter-based resources (IBRs) in islanded microgrids. This can result in overcurrent protections, causing the inverters to trip, which leads to the collapse of voltage and frequency. In this article, small-signal analysis supported by electromagnetic transients (EMTs) simulation is performed on a detailed model of a microgrid containing IBRs and an SG to identify underdamped modes and their sensitivities to the power–frequency (P-F) droop parameter. Further EMT simulation of a more complex microgrid model with multiple GFM IBRs and SGs is performed to determine whether trends identified from the modal analysis extend to cases where the number of SGs in operation may vary. The objective is to investigate the effectiveness of tuning this parameter to reduce the likelihood of overcurrents in response to load and generation disturbances. The work uncovers both fast and slow modes of concern. Primarily, the findings show that increasing the P-F droop value improves the damping of the slower mode while degrading the damping of the faster mode, leading to an upper limit on the damping improvement of the GFM IBR output current. In EMT simulations of the more complex microgrid, the greatest damping improvement still exhibits significant maximum overshoot. Furthermore, the optimal value of the P-F droop parameter is sensitive to the number of SGs in operation. The conclusion is that tuning the P-F droop parameter is not an effective means to avoid the overcurrent tripping of GFM IBRs during response to large load or generation disturbances when operating in parallel to SGs in islanded microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Complex-Valued Intermolecular Coupling Enables Directional Exciton Transport in Excitonic Circuits

Molecular systems capable of directing the flow of excitons are key to the development and optimization of optoelectronic materials. The transport of excitons across multiple molecules is governed by an intermolecular electronic coupling network. In this article, we consider the effects of complex-valued intermolecular electronic coupling on exciton transport. Here, we present a molecular motif capable of generating complex-valued coupling under excitation with circularly polarized light. We use theoretical modeling and simulation to illustrate how complex coupling can be leveraged to drive the rotational flux of excitons in cyclic molecular networks and direct the exciton population in branched molecular networks.

chromophores↗
DOE OSTI2024

Single-Molecule Detection of the Encounter and Productive Electron Transfer Complexes of a Photosynthetic Reaction Center

Small, diffusible redox proteins play an essential role in electron transfer (ET) in respiration and photosynthesis, sustaining life on Earth by shuttling electrons between membrane-bound complexes via finely tuned and reversible interactions. Ensemble kinetic studies show transient ET complexes form in two distinct stages: an “encounter” complex largely mediated by electrostatic interactions, which subsequently, through subtle reorganization of the binding interface, forms a “productive” ET complex stabilized by additional hydrophobic interactions around the redox-active cofactors. Here, using single-molecule force spectroscopy (SMFS) we dissected the transient ET complexes formed between the photosynthetic reaction center-light harvesting complex 1 (RC-LH1) of Rhodobacter sphaeroides and its native electron donor cytochrome c 2 (cyt c 2 ). Importantly, SMFS resolves the distribution of interaction forces into low (~150 pN) and high (~330 pN) components, with the former more susceptible to salt concentration and to alteration of key charged residues on the RC. Thus, the low force component is suggested to reflect the contribution of electrostatic interactions in forming the initial encounter complex, whereas the high force component reflects the additional stabilization provided by hydrophobic interactions to the productive ET complex. Employing molecular dynamics simulations, we resolve five intermediate states that comprise the encounter, productive ET and leaving complexes, predicting a weak interaction between cyt c 2 and the LH1 ring near the RC-L subunit that could lie along the exit path for oxidized cyt c 2 . The multimodal nature of the interactions of ET complexes captured here may have wider implications for ET in all domains of life.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

lasy v0.1

Lasy is a Python library that facilitates numerical simulations of the interaction of complex laser pulses with plasmas. More specifically, lasy offers many ways to define complex laser pulses (e.g. from commonly-known analytical formulas, from experimental measurements, etc.) and then computes and saves the corresponding laser field in a standardized file. This file can then be read by external plasma simulation codes, that will then simulate the interaction between the complex laser pulse and a plasma. Lasy is useful for instance for numerical simulations of plasma-based particle accelerators, plasma-based laser amplification, etc. Lasy avoids having to duplicate the code that defines complex laser pulses in each plasma simulation codes, and instead provides a trusted, centralized implementation.

Lehe, Remi↗
DOE OSTI2021

Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems

The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.

DER integration↗