Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs

Song Lin(Fujian Normal University), Ying Shan(Tencent (China)), Yixiao Ge(Tencent (China)), Shuai Yang(Anhui University), Ying-Cong Chen(University of Hong Kong), Yukang Chen(University of Hong Kong), Xiaohan Ding(George Mason University)
Unknown
June 16, 2024
Cited by 12


Related Papers