Dynamic Layer Routing in LLMs
Ahmed Heakl, Martin Gubri, Salman Khan, et al.
Dr. LLM retrofits frozen LLMs with lightweight routers trained via MCTS to skip, execute, or repeat layers, improving accuracy and efficiency without altering base weights.
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Ahmed Heakl, Martin Gubri, Salman Khan, et al.
Dr. LLM retrofits frozen LLMs with lightweight routers trained via MCTS to skip, execute, or repeat layers, improving accuracy and efficiency without altering base weights.
Tuan-Minh Pham, Thi-Thuy-Lien Nguyen
Proposes optimization models and approximation algorithms for joint gateway placement, service placement, and routing in NFV-enabled IoT edge cloud systems.
Gianni A. Di, Marco Dorigo
AntNet introduces a distributed, stigmergy-based ant colony optimization approach for adaptive routing in communications networks, outperforming six state-of-the-art algorithms.
Charles E. Perkins, Pravin Bhagwat
Proposes DSDV, a proactive routing protocol for ad-hoc networks that adapts Bellman-Ford to eliminate routing loops and support dynamic topology changes.
Woongyeong Yeo, Kangsan Kim, Soyeong Jeong, et al.
UniversalRAG is an any-to-any RAG framework that retrieves and integrates knowledge from heterogeneous sources across modalities and granularities using modality-aware routing to overcome the modality gap.
Unknown
This paper introduces a content-based sparse attention mechanism that combines the benefits of content-based and local temporal sparse attention for improved efficiency in Transformer models.
Unknown
This paper empirically studies the design of vision Mixture-of-Experts (MoE) models, providing insights into routing strategies and expert architectures for improved scalability.