AI Research

AI & ML Research Papers

A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.

All Papers

2 papers

Preprint2026

Weak-to-Strong On-Policy Distillation

Fangxu Yu, Zinan Lin, Xiaodong Liu, et al.

Weak-to-Strong On-Policy Distillation (W2S-OPD) improves a strong student LLM by distilling from a proxy teacher built from contrast pairs of weaker models, enabling capability transfer without a larger teacher.

0Jul 28, 2026ReasoningBenchmarks

arXiv

PreprintConference on Empirical Methods in Natural Language Processing2024

Weak-to-Strong Reasoning

Yuqing Yang, Yan Ma, Pengfei Liu

Proposes a progressive weak-to-strong reasoning framework where a strong model refines its own training data without human or advanced model input, significantly improving reasoning on GSM8K and MATH.

37Jul 18, 2024Large Language ModelsFine Tuning

arXiv