OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

Wenqi Shao, Ping Luo(Wuhan University), Zhiqian Li(Sichuan University), Peng Xu(Jilin University), Yu Qiao(Kyung Hee University), Zhaoyang Zhang, Peng Gao(State Forestry and Grassland Administration), Kaipeng Zhang, Lirui Zhao, Mengzhao Chen(Xiamen University)
arXiv (Cornell University)
August 25, 2023
Cited by 14


Related Papers