CodeBERT: A Pre-Trained Model for Programming and Natural Languages

Zhangyin Feng(Harbin Institute of Technology), Ming Zhou(Langdon Hospital), Nan Duan(Microsoft Research Asia (China)), Daxin Jiang(Jiangsu University), Daya Guo(Sun Yat-sen University), Xiaocheng Feng(Harbin Institute of Technology), Linjun Shou(Microsoft Research Asia (China)), Ting Liu(Xi'an Jiaotong University), Ming Gong(Microsoft Research Asia (China)), Duyu Tang(Microsoft Research Asia (China)), Bing Qin(Harbin Institute of Technology)
Unknown
January 1, 2020
10.18653/v1/2020.findings-emnlp.139
Cited by 2,459

Related Papers

Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training
|Proceedings of the AAAI Conference on Artificial Intelligence|2020|744
CLIP4Clip: An empirical study of CLIP for end to end video clip retrieval and captioning
|Neurocomputing|2022|676
DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
|Nature|2025|610
UniXcoder: Unified Cross-Modal Pre-training for Code Representation
|Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)|2022|554
Can Open Large Language Models Catch Vulnerabilities?
|arXiv (Cornell University)|2025|501