AMiD: Knowledge Distillation for LLMs with $\alpha$-mixture Assistant Distribution
categorize
Machine Learning
Author
Donghyeok Shin, Yeongmin Kim, Suhyeon Jo, Byeonghu Na, and Il-Chul Moon
Year
2026
Conference Name
International Conference on Learning Representations (ICLR 2026)
Presentation Date
April 23-27
City
Rio de Janeiro
Country
Brazil
Donghyeok Shin, Yeongmin Kim, Suhyeon Jo, Byeonghu Na, and Il-Chul Moon, AMiD: Knowledge Distillation for LLMs with $\alpha$-mixture Assistant Distribution, The Fourteenth International Conference on Learning Representations (ICLR 2026), Rio de Janeiro, Brazil, April 23-27, 2026.