Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

Elena Voita(Yandex (Russia)), Ivan Titov(University of Luxembourg)
Unknown
January 1, 2019
Cited by 1,050


Related Papers

No related papers found

Powered by citation graph analysis