EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting

Zhongzhi Yu, Yingyan Celine Lin, Sreenidhi Reedy Bommu, Zheng Wang(Georgia Institute of Technology), Yuhan Li(Chinese Academy of Agricultural Sciences), Yang Zhao(Georgia Institute of Technology), Xiaoya Zhou(Huaqiao University), Ruijie Gao(Georgia Institute of Technology), Haoran You(Rice Research Institute)
arXiv (Cornell University)
June 22, 2024
Cited by 1


Related Papers