cy0307/cd-clip-zeroshot-probe

Model

0

stars

3

commits

2

linked in READMEs

Jun 28, 2026

updated

advanced
embodied-ai
gpu
ropedia-academy
todo
track-d
track-lm

README

CLIP: zero-shot vs. probe 🚧 not trained yet

CLIP zero-shot classification + a trained linear probe on frozen features.

Status β€” documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β€” base model, objective, dataset, config, the exact evaluation β€” is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.

At a glance

Base modelopen_clip ViT-B/32 (pretrained)
Taskvision-language probing
Training objectiveZero-shot classification via text prompts + a trained linear probe on frozen features.
TrackC Β· Egocentric vision
Built onopen_clip
NotebookOpen In Colab
Compute / storage / timeGPU required β€” see the Compute Β· storage Β· time table in the notebook

Dataset

  • Source: CIFAR-10 (probe / eval).

Training config

GPU-scale β€” the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, …) are in the training cell.

Evaluation results

⏳ Pending β€” run the notebook on a GPU to fill this in. This lab reports zero-shot accuracy Β· linear-probe accuracy on a held-out split (see its Evaluate cell).

Inference example

No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: open_clip ViT-B/32 (pretrained).

How to fill this repo

  1. Open the notebook in Colab β†’ Runtime β†’ GPU β†’ Run all (runs the real pipeline).
  2. Run its Publish to the Hugging Face Hub step (or HfApi().upload_folder(...)) β€” the checkpoint + metrics.json + figures replace this placeholder.
  • Train / run on a GPU Β· [ ] upload weights Β· [ ] add metrics.json Β· [ ] add figures Β· [ ] swap in the real results card

Limitations

Not yet trained β€” no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.

License

Code: MIT (this repository). The base model (open_clip) and dataset are each under their own licenses β€” check the upstream source before redistribution.

Citation

@misc{ropedia_academy,
  title  = {Ropedia Academy: an interactive course on embodied & spatial AI},
  author = {Ropedia Academy},
  year   = {2026},
  howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}

Method / original work: Radford et al., CLIP, ICML 2021.


Documented placeholder in the Ropedia Academy collection β€” train it on a GPU to publish the real model. Contributions welcome on GitHub.

Contributors

cy0307

3 commits

cy0307/cd-clip-zeroshot-probe

Model

0

stars

3

commits

2

linked in READMEs

Jun 28, 2026

updated

advanced
embodied-ai
gpu
ropedia-academy
todo
track-d
track-lm

README

CLIP: zero-shot vs. probe 🚧 not trained yet

CLIP zero-shot classification + a trained linear probe on frozen features.

Status β€” documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β€” base model, objective, dataset, config, the exact evaluation β€” is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.

At a glance

Base modelopen_clip ViT-B/32 (pretrained)
Taskvision-language probing
Training objectiveZero-shot classification via text prompts + a trained linear probe on frozen features.
TrackC Β· Egocentric vision
Built onopen_clip
NotebookOpen In Colab
Compute / storage / timeGPU required β€” see the Compute Β· storage Β· time table in the notebook

Dataset

  • Source: CIFAR-10 (probe / eval).

Training config

GPU-scale β€” the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, …) are in the training cell.

Evaluation results

⏳ Pending β€” run the notebook on a GPU to fill this in. This lab reports zero-shot accuracy Β· linear-probe accuracy on a held-out split (see its Evaluate cell).

Inference example

No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: open_clip ViT-B/32 (pretrained).

How to fill this repo

  1. Open the notebook in Colab β†’ Runtime β†’ GPU β†’ Run all (runs the real pipeline).
  2. Run its Publish to the Hugging Face Hub step (or HfApi().upload_folder(...)) β€” the checkpoint + metrics.json + figures replace this placeholder.
  • Train / run on a GPU Β· [ ] upload weights Β· [ ] add metrics.json Β· [ ] add figures Β· [ ] swap in the real results card

Limitations

Not yet trained β€” no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.

License

Code: MIT (this repository). The base model (open_clip) and dataset are each under their own licenses β€” check the upstream source before redistribution.

Citation

@misc{ropedia_academy,
  title  = {Ropedia Academy: an interactive course on embodied & spatial AI},
  author = {Ropedia Academy},
  year   = {2026},
  howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}

Method / original work: Radford et al., CLIP, ICML 2021.


Documented placeholder in the Ropedia Academy collection β€” train it on a GPU to publish the real model. Contributions welcome on GitHub.

Contributors

cy0307

3 commits