ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization
He-Yen Hsieh, H. T. Kung
ReRound is a post-training quantization method that uses a conditional diffusion model to resolve midpoint ambiguity in round-to-nearest, improving low-bit LLM quantization without calibration data.