Preprint2023
Lora-fa: Memory-efficient low-rank adaptation for large language models fine-tuning
Unknown
This paper introduces Lora-fa, a memory-efficient low-rank adaptation method that reduces the memory footprint of fine-tuning large language models by avoiding the need to store full-rank gradients.
0Jan 1, 2023Large Language ModelsFine Tuning