Knowledge Distillation | JJ's Blog

📝 MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders -CVPR 2025

📝 Efficient Multi-modal Large Language Models via Progressive Consistency Distillation - NeurIPS'25

📝 AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders - NeurIPS'25 Spotlight