Bunny-v1.0 Dataset Card

📖 Technical report | 🤗 Bunny-v1.0-3B | 🏠 Code | 🐰 Demo

Bunny is a family of lightweight multimodal models.

Bunny-v1.0-data is the training dataset for Bunny-v1.0 series, including Bunny-v1.0-3B.

Pretrain

We use a high-quality coreset with less duplicates and more informative samples of LAION-2B built by this work. We randomly sample 2 million image-text pairs from the coreset and convert them to training format. The pretraining data and images can be found in pretrain folder.

Finetune

We build Bunny-695K by modifying SVIT-mix-665K for finetuning. The finetuning data can be found in finetune folder.

Usage

The images are packed into multiple packages. After downloading the images, run the following script to merge them into one:

cat images.tar.gz.part-* > images.tar.gz

Then unpack the package with following command:

tar -xvzf images.tar.gz

License

The content of this project itself is licensed under the Apache license 2.0.