EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Unified Compression and Adaptive Layer Voting

Zhongzhi Yu, Yingyan Lin(Georgia Institute of Technology), Yang Zhao(Georgia Institute of Technology), Xiaoya Zhou(Huaqiao University), Sreenidhi Reddy Bommu(Georgia Institute of Technology), Yuhan Li(Georgia Institute of Technology), Ruijie Gao(Georgia Institute of Technology), Zheng Wang(Georgia Institute of Technology)
Unknown
June 23, 2024
Cited by 52


Related Papers