Tempo-6B-Stage2 (Pre-Long-Context SFT)

This repository contains the Stage 2 intermediate checkpoint for Tempo-6B.

Unlike earlier training stages, this checkpoint is fully capable of direct inference. It has completed short-video and image instruction tuning, making it a strong baseline for general multimodal understanding. However, it has not undergone our final Stage 3 Long-Context SFT.

🚀 When to use this checkpoint?

• Custom Fine-Tuning: An ideal starting point if you want to apply your own long-context SFT curriculum or adapt the model to specialized domains.

📊 Ablation Performance

To demonstrate its capabilities, here is the performance of this Stage 2 checkpoint compared to our final Tempo-6B model:

Note: For a detailed analysis, please check our paper's Ablation Study A (Progressive Training Curriculum).

🔗 Links

For the final long video understanding performance, please use our final weights:

• Final Model: Vision-CAIR/Tempo-6B
• GitHub Code: FeiElysia/Tempo
• Paper: Small Vision-Language Models are Smart Compressors for Long Video Understanding