PreprintarXiv.org2024
Recurrent Memory Finds What LLMs Miss
Yuri Kuratov, A. Bulatov, Petr Anokhin, et al.
Recurrent memory augmentation enables GPT-2 to process sequences up to 11 million elements, far exceeding standard methods limited to 10,000 elements.
52Feb 16, 2024TransformersFine Tuning
arXiv