Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TAN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Understanding Mixed Precision GEMM with MPGemmFI: Insights into Fault Resilience

Emerging deep learning workloads urgently need fast general matrix multiplication (GEMM). Thus, one of the critical features of machine-learning-specific accelerators such as NVIDIA Tensor Cores, AMD Matrix Cores, and Google TPUs is the support of mixed-precision enabled GEMM. For DNN models, lower-precision FP data formats and computation offer acceptable correctness but significant performance, area, and memory footprint improvement. While promising, the mixed-precision computation on error resilience remains unexplored. To this end, we develop a fault injection framework that systematically injects fault into the mixed-precision computation results. We investigate how the faults affect the accuracy of machine learning applications. Based on the characteristics of error resilience, we offer lightweight error detection and correction solutions that significantly improve the overall model accuracy by 75% if the models experience hardware faults. The solutions can be efficiently integrated into the accelerator's pipelines.

Fang, Bo↗

ML-CGRA: An Integrated Compilation Framework to Enable Efficient Machine Learning Acceleration on CGRAs

Coarse-Grained Reconfigurable Arrays (CGRAs) can achieve higher energy-efficiency than general-purpose processors and accelerators or fine-grained reconfigurable devices, while maintaining adaptability to different computational patterns. CGRAs have shown some success as a platform to accelerate machine learning (ML) thanks to their flexibility, which allows them to support new models not considered by fixed accelerators. However, current solutions for CGRAs employ low level instruction-based compiler approaches and lack specialized compilation infrastructures from high-level ML frameworks that could leverage semantic information from the models, limiting the ability to efficiently map them on the recon- figurable substrate. This paper proposes ML-CGRA, an integrated compilation framework based on the MLIR infrastructure that en- ables efficient ML acceleration on CGRAs. ML-CGRA provides an end-to-end solution for mapping ML models on CGRAs that out- performs conventional approaches by 3.15× and 6.02 × on 4×4 and 8×8 CGRAs, respectively.

machine learning↗

Region-Based Stability Analysis of Resilient Distribution Systems with Hybrid Grid-Forming and Grid-Following Inverters

In this paper, distribution system stability considering mixed grid-forming (GFM) and grid-following (GFL) inverters is discussed. A holistic small-signal model of the distribution feeder accommodating both GFM and GFL inverters is derived. In contrast to conventional point-by-point stability analysis, a region-based stability assessment approach is proposed and implemented to evaluate small-signal system stability with both GFM and GFL controls. Furthermore, to enhance the computational efficiency, an Artificial Intelligence (AI) assisted Kernel Ridge Regression (KRR) approach is developed to obtain the stability region boundary. Therefore, with the derived stability region, the impact of critical parameters on system stability is intuitively shown, and more importantly, the relationship between the maximum penetration level and the corresponding feasible range of the selected control parameters can be quantified. The proposed approach has been validated using MATLAB/Simulink.

grid-following↗

Small-Signal Stability Support from Dynamically Configurable Grid-Forming/Following Inverters for Distribution Systems

The growth of inverter-based resources (IBRs) in modern power systems can challenge system stability since they do not natively provide inertia, prompting a need to develop new methods to address the potential instabilities. In this paper, a dynamically configurable grid-forming (GFM) and grid-following (GFL) control is proposed, which enables inverters to flexibly transition to support system needs. The operation mode transition between GFM and GFL controls is adopted as an additional degree of control flexibility to adjust the small-signal stability margin. In addition, a holistic and detailed small-signal model for a distribution feeder that captures the dynamics from both synchronous generators (SGs) and IBRs is also derived and used to evaluate the effectiveness of the proposed GFM/GFL controls to augment the system small-signal stability margin. Case studies with varying levels of IBRs were implemented in MATLAB/Simulink to demonstrate the effectiveness of the proposed approach.

grid-following control↗

Quantitative Small-Signal Stability Analysis of Grid-Forming Inverters in Large-Scale Power Systems

In this paper, the challenges induced by the integration of inverter-based resources (IBRs) into existing power systems are discussed. Although the grid-forming (GFM) control has been used to enhance system performance in multiple sections of electric power systems (e.g., transmission and distribution systems, microgrids, among others), the coupling mechanism between GFM inverter and various types of other components in modern power systems should be clearly explored. Existing analyses mainly focus on qualitative investigations that verify the effectiveness of deploying GFM inverters for stability enhancement. A holistic system-level quantitative analysis is still missing to verify the detailed benefits of GFM inverters and their interactions with other generation units (e.g., synchronous generators [SGs], conventional grid-following [GFL] inverters, synchronous condensers, among others). To fill in the technical gaps, a holistic small-signal model of the entire system with both rotating generation units and IBRs is established along with the customized power flow analysis for varying steady-state operating points. Further, a quantitative method is proposed to identify the impacts of GFM inverters on system performance with an emphasis on a quantifiable stability margin and a complete modal analysis at the system level. Finally, a realistic test system is used to verify the proposed approach.

grid-following↗

Quantitative Trade-Off in Distributed Secondary Control for Autonomous AC Microgrids

In this paper, we propose to quantify the trade-off between voltage regulation and reactive power sharing in autonomous AC microgrids with distributed secondary control. It is known that voltage regulation and reactive power sharing in droop-controlled autonomous AC microgrids are two conflicting control objectives that present a natural trade-off between voltage regulation towards the voltage magnitude reference and reactive power sharing accuracy. This trade-off is commonly shown qualitatively without sufficient quantification. In this work, to quantify the trade-off between the two objectives, we focus on distributed secondary control and utilize regression and polynomial surface fitting to identify the requisite parameter area to satisfy the predefined error bands for voltage magnitude regulation and reactive power sharing. Extensive case studies are presented to validate the proposed method.

autonomous AC microgrids↗

Small-Signal Stability Constrained Optimal Power Flow of Inverter-Dominated Power Systems with Flexible Operation Mode Selection

Given the intermittence and low inertia nature of inverter-based resources (IBRs), modern power systems with high penetration of IBRs challenge the conventional optimal power flow (OPF) analysis and the system may experience unexpected failures if stability constraints are not incorporated. This study proposes a small-signal stability-constrained OPF (SSSC-OPF) with flexible operation mode selection between grid-forming (GFM) and grid-following (GFL) modes for IBRs to address these challenges. The approach aims to maintain system stability with a sufficient stability margin while minimizing operation costs. The effectiveness of the proposed method is validated through extensive case studies on the IEEE 14-bus system. The results demonstrate that the proposed method is able to support system-level power flow analysis, reduce generation costs, and ensure stability under various disturbances.

grid-following↗

Visualization of the Oscillatory Dynamics of an Island Power System

In this work, we discuss the design of visualizations for understanding the complex oscillatory dynamics of an island power system with renewable generation sources after the loss of a large oil power plant. As more renewable generation sources are added to power systems, the oscillatory dynamics will change, which requires new visualization techniques to determine causes and strategies to avoid unwanted behaviors in the future. Our approach integrates geographic views, time-series plots, and novel oscillatory-trajectory curves, providing unique insights into the interdependent oscillatory behaviors of multiple state variables and generators over time. By enabling multi-node and multivariate comparisons over time, users can qualitatively determine drivers of oscillations and differences in generator dynamics, which is not possible with other commonly used visualization techniques.

inverters↗

A Framework for Neural Network Inference on FPGA-Centric SmartNICs

FPGA-based SmartNICs offer great potential to significantly improve the performance of high-performance computing and warehouse data processing by tightly coupling support for reconfigurable data-intensive computation with cross-node communication, thereby mitigating the von Neumann bottleneck. Existing work, however, has been generally been limited in that it assumes an accelerator model where kernels are offloaded to SmartNICs, but most control tasks are left to the CPUs. This leads to frequent waiting, inferior performance, and scaling challenges. In this work, we propose a new distributive data-centric computing framework, named FCsN, for reconfigurable SmartNIC-based systems. Through a lightweight task circulation execution model and its implementation architecture, FCsN allows the complete detaching of kernel execution, control logic, system scheduling, and network communication to the SmarNICs. This boosts performance by: (i) avoiding the control dependency with CPUs and (ii) supporting streaming kernel execution and network communication at line rate and in a very fine-grained manner. We demonstrate the efficiency and flexibility of FCsN using various types of neural network applications including graph neural networks; as these last are both irregular and data intensive they offer an especially robust demonstration. Evaluations using commonly-used neural network models and graph datasets show that a system with the support of FCsN can achieve, on average, 144 speedups over the MPI-based standard CPU baselines.

Guo, Anqi↗

DRIPS: Dynamic Rebalancing of Pipelined Streaming Applications on CGRAs

Coarse-grained reconfigurable arrays (CGRAs) provide higher flexibility than application-specific integrated circuits (ASICs) and higher efficiency than fine-grained reconfigurable devices such as Field Programmable Gate Arrays (FPGAs). However, CGRAs are generally designed to support offloading of a single kernel. While their design, based on communicating functional units, appears to naturally suit data streaming applications composed of multiple cooperating kernels, current approaches only statically partition the resources across application kernels. However, emerging streaming applications at the edge (scientific instruments, sensor networks, network processing) perform much more than digital signal processing and often are data and input dependent. This leads to extremely variable kernel execution times, severely impacting the throughput of the entire pipeline if resources are only statically allocated. Therefore, in this paper, we propose DRIPS — a coarse-grained, dynamically, and partially reconfigurable array for data-dependent streaming applications. We present a unified compiler framework to facilitate the mapping of a given streaming application onto the DRIPS CGRA architecture. The experimental results show that DRIPS achieves an average throughput improvement of 1.46$\times$ across a set of representative applications over a statically partitioned solution. The additional area overhead to enable dynamic rebalancing consumes 16.34% of the entire area for a 5x5 CGRA prototype.

Tan, Cheng↗

A Survey: Handling Irregularities in Neural Network Acceleration with FPGAs

In the last decade, Artificial Intelligence (AI) through Deep Neural Networks (DNNs) has penetrated virtually every aspect of science, technology, and business. Many types of DNNs have been and continue to be developed, including Convolutional Neural Networks (CNNs), Recurrent Neural Net- works (RNNs), and Graph Neural Networks (GNNs). The overall problem for all of these Neural Networks (NNs) is that their target applications generally pose stringent constraints on latency and throughput, while also having strict accuracy requirements. There have been many previous efforts in creating hardware to accelerate NNs. The problem designers face is that optimal NN models typically have significant irregularities, making them hardware-unfriendly. In this paper, we first define the problems in NN acceleration by characterizing common irregularities in NN processing into 4 types; then we summarize the existing works that handle the four types of irregularities efficiently using hardware, especially FPGAs; finally, we provide a new vision of next-generation FPGA-based NN acceleration: that the emerging heterogeneity in the next-generation FPGAs is the key to achieving higher performance.

Geng, Tong↗

Automated Generation of Integrated Digital and Spiking Neuromorphic Machine Learning Accelerators

The growing numbers of application areas for artificial intelligence (AI) methods have led to an explosion of domain-specific accelerators that could support every new machine learning (ML) algorithm advancement, clearly highlighting the need for a capability to quickly and automatically transition from algorithm definition to hardware implementation and explore design space along a variety of SWaP (size, weight and Power). The software defined architectures (SODA) synthesizer implements a compiler-based modular infrastructure for the end-to-end generation of machine learning accelerators from high-level frameworks to hardware description language. At the same time, neuromorphic computing, by mimicking how the brain operates, promises to perform artificial intelligence tasks at efficiencies orders of magnitude higher than the current conventional tensor-processing based accelerators, as demonstrated by a variety of specialized designs leveraging Spiking Neural Networks (SNNs). Nevertheless, the mapping of an artificial neural network (ANN) to solutions supporting SNNs is still a non-trivial and very device-specific task, and completely lack the possibility to design hybrid systems that integrate conventional and spiking neural models. In this paper we discuss the support for such an integrated generation leveraging the SODA Synthesizer framework and its modular structure. In particular, we present a new MLIR dialect (part of the SODA frontend) that allows expressing spiking neural network features (e.g., available resources, spiking sequences, analog signal reading, etc.) and illustrate how it enables mapping to Spiking Neurons and deployment to the related specialized hardware (which, in the digital domain, could be generated through the other existing layers of the SODA Synthesizer). We then discuss the opportunities for even deeper integration afforded by the hardware compilation infrastructure, providing a path towards the generation of complex heterogeneous artificial intelligence systems.

Curzel, Serena↗

VecPAC: A Vectorizable and Precision-Aware CGRA

This paper proposes VecPAC -- a vectorizable and precision-aware coarse-grained reconfigurable array (CGRA) design. VecPAC integrates CGRA tiles with scalar functional units and specialized tiles with vector functional units that can trade off the number of vector lanes for the accuracy of the computation. We discuss the architecture design and present the related compilation framework. The experimental evaluation on a set of applications from three different domains (embedded, machine learning, and high-performance computing) shows that the hybrid design of VecPAC outperforms CGRAs with only scalar functional units by 1.48x, while providing higher scalability.

Tan, Cheng↗

DynPaC: Coarse-Grained, Dynamic, and Partially Reconfigurable Array for Streaming Applications

Coarse-grained reconfigurable arrays (CGRAs) provide higher flexibility than application-specific integrated circuits (ASICs) and higher efficiency than fine-grained reconfigurable devices such as Field Programmable Gate Arrays (FPGAs). However, CGRAs are generally designed to support offloading of a single kernel. While their design, based on communicating functional units, appears to naturally suit streaming applications composed of multiple cooperating kernels, current approaches only statically partition the resources across kernels. However, streaming applications often are data-dependent, leading to variable kernel execution times depending on the input data and impacting the throughput of the entire pipeline if resources are statically allocated. Therefore, in this paper, we discuss the design of DynPaC — a coarse-grained, dynamically, and partially reconfigurable array for data-dependent streaming applications. We discuss the required software and hardware components to manage partial dynamic reconfiguration. We demonstrate that by supporting partial dynamic reconfiguration, we can obtain an average speedup of 1.44X for a representative set of applications w.r.t. static partitioning, with a limited area overhead (6.4% of the entire chip).

Tan, Cheng↗

Comparative Small-Signal Stability Analysis of Grid-Forming and Grid-Following Inverters in Low-Inertia Power Systems: Preprint

Inverter-based resources (IBRs) are gradually replacing conventional fossil energy in modern power systems, which could make the system susceptible due to insufficient inertia, especially when moving towards a 100% inverter-based power grid. Grid-forming (GFM) and grid-following (GFL) controls are two common inverter control algorithms. However, the corresponding stability issues along with a comparative study on low-inertia power systems should still be investigated. This paper focuses on small-signal stability and conducts a comprehensive analysis of GFM and GFL controls, with emphases on the interactions between synchronous generators and IBRs. The detailed modeling of GFM and GFL inverters, and synchronous generators (SGs) are established. The coupling mechanism of IBRs and SGs is then conducted through participation factor analysis. The impacts of critical parameters on system stability are finally identified. The theoretical analyses are validated through time-domain simulation in MATLAB/Simulink.

grid-following↗

A Participation Factor-Based Approach for Defining the EMT Model Boundary for Power System Simulations with Inverter-Based Resources

The increasing penetration of inverter-based resources (IBRs) introduces new challenges to power system simulations, particularly with the emergence of fast electromagnetic transient (EMT) dynamics and sub-synchronous oscillations (SSO) that require time-consuming EMT simulations. To reduce the time cost for simulating a large-scale power grid with IBRs, this paper proposes a novel participation factor-based approach for defining a critical zone for detailed EMT modeling and simulations, which includes the IBRs, synchronous generators, and the network components participating significantly in simulated contingencies. Both model-based and response-based methods are introduced for the estimation of participation factors (PFs). The case study on the 240-bus Western Electricity Coordinating Council (WECC) system demonstrates that the EMT zone determined by the proposed approach can effectively capture power system dynamics involving IBRs.

EMT simulation↗

The Recent Improvements of the SNS Extraction Kicker Power Supplies

A total of 14 extraction kickers., with one as the hot spare., are in service to extract protons out of the storage ring at the SNS. The jitter issue and the short lifetime of the switches were resolved after the thyratrons were replaced with solid state switches in 2018. This paper discusses the recent improvements. Two thyristor switches suffered overheating damage in separate incidents. One was due to the oil pump failure and the other was the result of a disconnected oil hose. An ultrasonic flow meter and a fiber optic temperature monitoring system have been installed for each extraction kicker power supply. The flow meter continuously monitors the entire tank oil flow. The temperature monitor detects the thyristor switch real-time temperatures in three locations. Fault thresholds are selected so that the thyristor switches are protected from overheating damage. Alarms are configured to alert staff to take actions before faults occur. In addition., the cause of an intermittent misfire issue was identified, and the solution was implemented. Lastly., a future oscilloscope upgrade and an oil level sensor are discussed.

Tan, Yugang↗

The Upgrade of the SNS Extraction Kicker Power Supplies for the Proton Power Upgrade

The Proton Power Upgrade (PPU) project at the Spallation Neutron Source (SNS) aims to enhance the linear accelerator's power output from 1.4 to 2.8 megawatts. A critical focus lies on upgrading the Extraction Kicker Power Supplies to handle the amplified beam power. The existing capacitor charging power supplies lacked the capability to charge the Blumlein-type Pulse Forming Network (PFN) to the required 40 kV at a repetition rate of 60 Hz. To address this limitation, an initial solution involving the use of a resonant charging circuit was proposed. However, a challenge arose with a self-firing issue in the thyristor switch, which proved unsolvable within the given timeframe. Facing a critical decision point in the project, an alternative approach was explored: integrating a supplementary power supply to enhance the overall power capacity. This solution was tested and ultimately chosen as the path forward. To accommodate the additional power supply, the power distribution system had to undergo upgrades. Throughout this endeavor, a comprehensive examination of the system took place, with meticulous identification of key components. This paper delves into the technical challenges encountered during the process and the corresponding solutions that were implemented.

Tan, Yugang [ORNL] (ORCID:0000000155968252)↗