Next-Token Prediction Task Assumes Optimal Data Ordering for LLM Training in Proof Generation

Chenyang An, Maurice Diesendruck, Shima Imani(University of California, Riverside), Harsh Shrivastava(Microsoft (United States)), Jingbo Shang(University of Illinois Urbana-Champaign), Gayathri Mahalingam(Allen Institute for Brain Science), Feng Yao, Pramod Kumar Sharma(Vikram University), Ali Abbasi(Islamic Azad University Sari Branch), Samuel R. Buss, Chengyu Dong
arXiv (Cornell University)
October 30, 2024
Cited by 0


Related Papers