Antoine Liutkus, Ondřej Cífka, Shih-Lun Wu, Umut Şimşekli, yi-Hsuan yang, et al.. Relative Positional Encoding for Transformers with Linear Complexity.
ICML 2021 - 38th International Conference on Machine Learning, Jul 2021, Virtual Only, United States.
⟨hal-03256451⟩