SinoTechIntel Academic Portal
Official PDF TranslationEngineering Information Technology & Electronic Engineering

TP-ViT: truncated uniform-log2 quantizer and progressive bit-decline reconstruction for vision Transformer quantization

Authors: Xichuan ZHOU; Sihuan ZHAO; Rui DING; Jiayu SHI; Jing NIE; Lihui CHEN; Haijun LIU

DOI: 10.1631/ENG_ITEE_2025_0081Status: Verified Translated Edition
Sponsored AdvertisementAd Placement Area
reCAPTCHA Bot Shield Active

Preparing Secure Academic Download

Verifying human reader & generating high-resolution document...

Verifying Document Integrity15s remaining
← Back to Article
Protected by Google reCAPTCHA v3.PrivacyTerms
Sponsored ContentAdSense In-Feed Ad Slot

Key Findings in This Report

• Introduces a truncated uniform-log2 quantizer that effectively handles outliers in post-Softmax activations, significantly reducing quantization errors. • Proposes a progressive bit-decline optimization strategy that gradually reduces bit precision while preserving model performance under extreme 3-bit quantization. • Achieves a notable 6.18 percentage points improvement in top-1 accuracy for ViT-small under 3-bit quantization, outperforming state-of-the-art PTQ methods. • Demonstrates robust performance across image classification, object detection, and instance segmentation, enabling efficient deployment of ViTs on edge hardware.
Download Full PDF: TP-ViT: truncated uniform-log2 quantizer and progressive bit-decline reconstruction for vision Transformer quantization | SinoTechIntel | SinoTechIntel