Engineering Papers⌕ Search

Engineering topics

Liu, Hang

Publications and source records attributed to Liu, Hang.

25 records · Page 2

Accelerating Transformer-based Deep Learning Models on FPGAs using Column Balanced Block Pruning

Although Transformer-based language representations achieve state-of-the-art accuracy on various natural language processing (NLP) tasks, the large model size has been challenging the resource constrained computing platforms. Weight pruning, as a popular and effective technique in reducing the number of weight parameters and accelerating the Transformer, has been investigated on GPUs. However, the Transformer acceleration using weight pruning on field-programmable gate array (FPGAs) remains unexplored. This paper investigates the column balanced block-wise pruning on Transformer and designs an FPGA acceleration engine to customize the balanced blockwise matrix multiplication. We implement the Transformer model with proper hardware scheduling, and the experiments show that the Transformer inference on FPGA achieves 10.35 ms latency with the batch size of 32, which is 10.96 × speed up comparing to CPU platform and 2.08 × speed up comparing to GPU platform.

Peng, Hongwu↗

Trust: Triangle Counting Reloaded on GPUs

Triangle counting is a building block for a wide range of graph applications. Here, traditional wisdom suggests that i) hashing is not suitable for triangle counting, ii) edge-centric triangle counting beats vertex-centric design, and iii) communication-free and workload balanced graph partitioning is a grand challenge for triangle counting. On the contrary, we advocate that i) hashing can help the key operations for scalable triangle counting on Graphics Processing Units (GPUs), i.e., list intersection and graph partitioning, ii) vertex-centric option reduces both hash table construction cost and memory consumption, which is limited on GPUs. In addition, iii) we exploit graph and workload collaborative, and hash-based 2D partitioning to scale vertex-centric triangle counting over 1,000 GPUs with sustained scalability. In this work, we present TRUST, which performs triangle counting with the hash operation and vertex-centric paradigm. To the best of our knowledge, TRUST is the first work that achieves over one trillion Traversed Edges Per Second (TEPS) rate for triangle counting.

97 MATHEMATICS AND COMPUTING↗

Turning on Visible-Light Photocatalytic C-H Oxidation over Metal-Organic Frameworks by Introducing Metal-to-Cluster Charge Transfer

The tailorable structure and electronic structure of metal–organic frameworks (MOFs) greatly facilitate their modulated light harvesting, redox power, and consequently photocatalysis. In this work, a representative MOF, UiO-66, was furnished by installing Fe 3+ onto the Zr-oxo clusters, to give Fe-UiO-66, which features extended visible light harvesting, based on metal-to-cluster charge transfer (MCCT). The Fe-UiO-66 with unique electronic structure and strong oxidizing power exhibits visible light-driven water oxidation, which is impossible for pristine UiO-66. More strikingly, under visible irradiation, the generated holes over Fe-UiO-66 are able to exclusively convert H 2 O to hydroxide radicals, initiating and driving the activation of stubborn C-H bond, such as toluene oxidation. The electrons reduce O 2 to O 2 •- radicals that further promote the oxidation reaction. The related catalytic mechanism and the structure–activity relationship have been investigated in detail. As far as we know, this is not only an unprecedented report on activating “inert” MOFs for photocatalytic C-H activation but also the first work on extended light harvesting and enhanced photocatalysis for MOFs by introducing an MCCT process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Photoinduced Nonequilibrium Topological States in Strained Black Phosphorus

Black phosphorus (BP), an elemental semiconductor, has attracted tremendous interest because it exhibits a wealth of interesting electronic and optoelectronic properties in equilibrium condition. The nonequilibrium electronic structures of bulk BP under a periodic field of laser remain unexplored, but can lead to intriguing topological optoelectronic properties. Here we show that, under the irradiation of circularly polarized light (CPL), BP exhibits a photon-dressed Floquet-Dirac semimetal state, which can be continuously tuned by changing the direction, intensity, and frequency of the incident laser. The topological phase transition from type-I to type-II Floquet-Dirac fermions manifests a new form of type-III phase, which exists in a wide range of intensities and frequencies of the incident laser. Furthermore, topological surface states exhibit nonequilibrium electron transport in a direction locked by the helicity of CPL. Our findings not only deepen our understanding of fundamental properties of BP in relation to topology but also extend optoelectronic device applications of BP to the nonequilibrium regime.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Attosecond extreme ultraviolet generation in cluster by using spatially inhomogeneous field

A promising method to generate the attosecond extreme ultraviolet (XUV) sources has been theoretically investigated emerging from the two-dimensional Ar{sup +} cluster driven by the spatially inhomogeneous field. The results show that with the introduction of the Ar{sup +} cluster model, not only the harmonic cutoffs are enhanced, but also the harmonic yields are reinforced. Furthermore, by properly moderating the inhomogeneity as well as the laser parameters of the inhomogeneous field, the harmonic cutoff can be further extended. As a result, three almost linearly polarized XUV pulses with durations of 40 as, 42 as, and 45 as can be obtained.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Overexpression of Rac1 in leukemia patients and its role in leukemia cell migration and growth

Rac1 belongs to the Rho family that act as critical mediators of signaling pathways controlling cell migration and proliferation and contributes to the interactions of hematopoietic stem cells with their microenvironment. Alteration of Rac1 might result in unbalanced interactions and ultimately lead to leukemogenesis. In this study, we analyze the expression of Rac1 protein in leukemia patients and determine its role in the abnormal behaviours of leukemic cells. Rac1 protein is overexpressed in primary acute myeloid leukemia cells as compared to normal bone marrow mononuclear cells. siRNA-mediated silencing of Rac1 in leukemia cell lines induced inhibition of cell migration, proliferation, and colony formation. Additionally, blocking Rac1 activity by an inhibitor of Rac1-GTPase, NSC23766, suppressed cell migration and growth. We conclude that overexpression of Rac1 contributes to the accelerated migration and high proliferation potential of leukemia cells, which could be implicated in leukemia development and progression.

60 APPLIED LIFE SCIENCES↗