PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Wei Zeng(East China Jiaotong University), Yonghong Tian(Peking University), Xiaoda Zhang, Dasen Yan, Qi Guo(Shanxi University), Shanzhi Gu, Xuefeng Jin, Zexuan Yi, Fangqing Jiang, Xinjing Huang, ZhenZhang Yang, Xiaozhe Ren, Hengtao Tao, Xin Jiang(Huawei Technologies (Sweden)), Gaojun Fan, Chen Li, Yue Yu, Han Zhang(Georgia Institute of Technology), Zhiwei Wang(Tongji University), Yan Zhang(Shenyang University of Technology), Chao Zhang(National Center for Infectious Diseases), Hui Wang(Queen's University Belfast), Yaowei Wang, Shaojie Zhang(University of Central Florida), Zhe Lin, Fang Peng(University of Electronic Science and Technology of China), Teng Su, Yifan Yao, Lingfeng Deng, Jianfeng Yu, Kaisheng Wang, Yi Liao, Ziyan Gong, Jun Wang, Mingyue Guo, Jin Wang(Hangzhou Normal University), Yehong Zhang
arXiv (Cornell University)
April 26, 2021
Cited by 93


Related Papers