Lazydit: Lazy learning for the acceleration of diffusion transformers
Unknown
Lazydit introduces a lazy learning approach to accelerate Diffusion Transformers by selectively skipping redundant computations during inference.
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Unknown
Lazydit introduces a lazy learning approach to accelerate Diffusion Transformers by selectively skipping redundant computations during inference.
Unknown
This survey provides a comprehensive overview of efficient diffusion models, covering acceleration techniques, architectural optimizations, and specialized frameworks.
Unknown
Proposes Dynamic Sparse Attention (DSA) to efficiently exploit dynamic sparse patterns in attention for scalable transformer acceleration.
Unknown
FastKV decouples context reduction from KV cache compression to accelerate both prefill and decoding phases in LLM inference.
D. Du, Gu Gong, Xiaowen Chu
A comprehensive survey of model quantization and hardware acceleration techniques for vision transformers.
Unknown
This survey comprehensively reviews knowledge distillation techniques for model compression and acceleration.
Hongzheng Chen, Jiahao Zhang, Yixiao Du, et al.
This paper investigates FPGA-based spatial acceleration for LLM inference, achieving up to 13.4x speedup over prior FPGA accelerators and 5.7x energy efficiency vs. A100 GPU.