CodeBERT: A Pre-Trained Model for Programming and Natural Languages

Zhangyin Feng(Harbin Institute of Technology), Ming Zhou(Langdon Hospital), Nan Duan(Microsoft Research Asia (China)), Daxin Jiang(Jiangsu University), Daya Guo(Sun Yat-sen University), Xiaocheng Feng(Harbin Institute of Technology), Linjun Shou(Microsoft Research Asia (China)), Ting Liu(Xi'an Jiaotong University), Ming Gong(Microsoft Research Asia (China)), Duyu Tang(Microsoft Research Asia (China)), Bing Qin(Harbin Institute of Technology)
arXiv (Cornell University)
February 19, 2020
10.48550/arxiv.2002.08155
Cited by 250

Related Papers

CodeBERT: A Pre-Trained Model for Programming and Natural Languages
|Unknown|2020|2.5k
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training
|Proceedings of the AAAI Conference on Artificial Intelligence|2020|744
CLIP4Clip: An empirical study of CLIP for end to end video clip retrieval and captioning
|Neurocomputing|2022|676
DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
|Nature|2025|610
UniXcoder: Unified Cross-Modal Pre-training for Code Representation
|Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)|2022|554