Teach Stable Diffusion a new concept with LoRA / DreamBooth, then generate.
Status β documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β base model, objective, dataset, config, the exact evaluation β is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.
| Base model | runwayml/stable-diffusion-v1-5 (or SDXL) |
| Task | text-to-image fine-tuning |
| Training objective | LoRA / DreamBooth fine-tuning of the diffusion UNet on new concepts. |
| Track | LM Β· Language & multimodal |
| Built on | huggingface/diffusers |
| Notebook | |
| Compute / storage / time | GPU required β see the Compute Β· storage Β· time table in the notebook |
GPU-scale β the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, β¦) are in the training cell.
β³ Pending β run the notebook on a GPU to fill this in. This lab reports FID Β· CLIP score (+ CLIP-I/DINO for subjects) on a held-out split (see its Evaluate cell).
No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: runwayml/stable-diffusion-v1-5 (or SDXL).
HfApi().upload_folder(...)) β the checkpoint + metrics.json + figures replace this placeholder.metrics.json Β· [ ] add figures Β· [ ] swap in the real results cardNot yet trained β no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.
Code: MIT (this repository). The base model (huggingface/diffusers) and dataset are each under their own licenses β check the upstream source before redistribution.
@misc{ropedia_academy,
title = {Ropedia Academy: an interactive course on embodied & spatial AI},
author = {Ropedia Academy},
year = {2026},
howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}
Method / original work: Rombach et al., Latent Diffusion, CVPR 2022; Hu et al., LoRA, 2021.
Documented placeholder in the Ropedia Academy collection β train it on a GPU to publish the real model. Contributions welcome on GitHub.
3 commits
Teach Stable Diffusion a new concept with LoRA / DreamBooth, then generate.
Status β documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β base model, objective, dataset, config, the exact evaluation β is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.
| Base model | runwayml/stable-diffusion-v1-5 (or SDXL) |
| Task | text-to-image fine-tuning |
| Training objective | LoRA / DreamBooth fine-tuning of the diffusion UNet on new concepts. |
| Track | LM Β· Language & multimodal |
| Built on | huggingface/diffusers |
| Notebook | |
| Compute / storage / time | GPU required β see the Compute Β· storage Β· time table in the notebook |
GPU-scale β the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, β¦) are in the training cell.
β³ Pending β run the notebook on a GPU to fill this in. This lab reports FID Β· CLIP score (+ CLIP-I/DINO for subjects) on a held-out split (see its Evaluate cell).
No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: runwayml/stable-diffusion-v1-5 (or SDXL).
HfApi().upload_folder(...)) β the checkpoint + metrics.json + figures replace this placeholder.metrics.json Β· [ ] add figures Β· [ ] swap in the real results cardNot yet trained β no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.
Code: MIT (this repository). The base model (huggingface/diffusers) and dataset are each under their own licenses β check the upstream source before redistribution.
@misc{ropedia_academy,
title = {Ropedia Academy: an interactive course on embodied & spatial AI},
author = {Ropedia Academy},
year = {2026},
howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}
Method / original work: Rombach et al., Latent Diffusion, CVPR 2022; Hu et al., LoRA, 2021.
Documented placeholder in the Ropedia Academy collection β train it on a GPU to publish the real model. Contributions welcome on GitHub.
3 commits