Preprint2024
Understanding in-context learning in transformers and llms by learning to learn discrete functions
Unknown
This paper investigates in-context learning in transformers and LLMs by training them to learn discrete Boolean functions, probing the role of attention and the underlying mechanisms.
0Jan 1, 2024TransformersAttention Mechanisms