Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tensors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Accelerating Binarized Neural Networks via Bit-Tensor-Cores in Turing GPUs

Despite foreseeing tremendous speedups over conventional deep neural networks, the performance advantage of binarized neural networks (BNNs) has merely been showcased on general-purpose processors such as CPUs and GPUs. In fact, due to being unable to leverage bit-level-parallelism with a word-based architecture, GPUs have been criticized for extremely low utilization (1%) when executing BNNs. Consequently, the latest tensorcores in NVIDIA Turing GPUs start to experimentally support bit computation. In this work, we look into this brand new bit computation capability and characterize its unique features. We show that the stride of memory access can significantly affect performance delivery and a data-format co-design is highly desired to support the tensorcores for achieving superior performance than existing software solutions without tensorcores. We realize the tensorcore-accelerated BNN design, particularly the major functions for fully-connect and convolution layers — bit matrix multiplication and bit convolution. Evaluations on two NVIDIA Turing GPUs show that, with ResNet-18, our BTC-BNN design can process ImageNet at a rate of 5.6K images per second, 77% faster than state-of-the-art. Our BNN approach is released on https://github.com/pnnl/TCBNN.

Li, Ang↗

G2Aero (Separable shape tensors for aerodynamic design) [SWR-22-44]

G2Aero is a flexible and practical tool for design and deformation of 2D airfoils and 3D blades using data-driven approaches. G2Aero utilizes the geometry of matrix manifolds—specifically the Grassmannian—to build a novel framework for representing physics-based separable deformations of shapes. G2Aero offers the flexibility to generate perturbations in a customizable way over any portion of the blade. The G2Aero framework utilizes data-driven methods based on a curated database of physically relevant airfoils. Specific tools include: - principal geodesic analysis over normal coordinate neighborhoods of matrix manifolds; - a variety of data-regularized deformations to nominal 2D airfoil shapes; - Riemannian interpolation connecting a sequence of airfoil cross-sections to build 3D blades from 2D data; - consistent perturbations over the span of interpolated 3D blades based on dominant modes from the data-driven analysis.

Doronina, Olga↗