Randomized Positional Encodings Boost Length Generalization of Transformers
Anian Ruoss, Gr'egoire Del'etang, Tim Genewein, Jordi Grau-Moya, R. Csordás, Mehdi Abbana Bennani, S. Legg, J. Veness
Annual Meeting of the Association for Computational Linguistics