Dynamic low-rank sparse adaptation for large language models
Unknown
The paper proposes a dynamic low-rank sparse adaptation method that unifies LLM sparsity and low-rank adaptation for efficient fine-tuning.
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Unknown
The paper proposes a dynamic low-rank sparse adaptation method that unifies LLM sparsity and low-rank adaptation for efficient fine-tuning.
Unknown
RidgeloRA enhances LoRA by incorporating matrix ridge regression to improve parameter-efficient fine-tuning of large language models.
Unknown
LoRA-XS introduces a low-rank adaptation method that drastically reduces trainable parameters while maintaining performance.
Unknown
The paper introduces nested low-rank adaptation, a method that reduces the number of trainable parameters for fine-tuning large models compared to standard LoRA.
Unknown
This study presents a low-rank adaptation method for finetuning large language models, embedding a semantic-aware low-rank adaptation module into attention layers.
Shangao Li, Yao Zhang, Volker Tresp, et al.
QuoteBench reveals that matched execution scores hide command-path failures in LLM coding agents, showing that boundary adaptation, not raw generation, separates models.
Unknown
This paper introduces in-context fine-tuning for time-series foundation models, enabling adaptation to new datasets without updating model weights.
Unknown
This paper introduces a sim-to-real approach using randomized-to-canonical adaptation networks to transfer a vision-based closed-loop grasping reinforcement learning agent from simulation to a real robot.
Unknown
This paper proposes Softmax-DPO, a novel adaptation of Direct Preference Optimization for recommendation systems, integrating softmax loss to enhance implicit feedback modeling.
Unknown
This survey systematically reviews Low-Rank Adaptation (LoRA) methods and their variants for Large Language Models (LLMs), emphasizing their efficiency in adapting models without full fine-tuning.
Unknown
Introduces Correlated Low-Rank Adaptation (CoLoRA), a novel framework that explicitly models correlations among low-rank factors to improve parameter-efficient fine-tuning of convolutional networks.
Unknown
This paper introduces Lora-fa, a memory-efficient low-rank adaptation method that reduces the memory footprint of fine-tuning large language models by avoiding the need to store full-rank gradients.