Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.
A comprehensive survey of efficient LLM serving techniques spanning algorithmic optimizations and system-level designs to address latency and throughput challenges.