cy0307/lm-rag-pipeline

Model

0

stars

3

commits

2

linked in READMEs

Jun 28, 2026

updated

advanced
embodied-ai
gpu
ropedia-academy
todo
track-c
track-d

README

RAG β€” retrieval-augmented generation 🚧 not trained yet

Embed a corpus, retrieve with FAISS, and ground an LLM's answer in it.

Status β€” documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β€” base model, objective, dataset, config, the exact evaluation β€” is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.

At a glance

Base modelBAAI/bge-small-en-v1.5 (embed) + Qwen2.5-0.5B-Instruct (gen)
Taskgrounded generation over a corpus
Training objectiveEmbed β†’ FAISS retrieve β†’ ground the LLM's answer in retrieved passages.
TrackLM Β· Language & multimodal
Built onsentence-transformers + FAISS
NotebookOpen In Colab
Compute / storage / timeGPU required β€” see the Compute Β· storage Β· time table in the notebook

Dataset

  • Source: Your document corpus (demo: 6 docs).

Training config

GPU-scale β€” the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, …) are in the training cell.

Evaluation results

⏳ Pending β€” run the notebook on a GPU to fill this in. This lab reports retrieval recall@k on a held-out split (see its Evaluate cell).

Inference example

No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: BAAI/bge-small-en-v1.5 (embed) + Qwen2.5-0.5B-Instruct (gen).

How to fill this repo

  1. Open the notebook in Colab β†’ Runtime β†’ GPU β†’ Run all (runs the real pipeline).
  2. Run its Publish to the Hugging Face Hub step (or HfApi().upload_folder(...)) β€” the checkpoint + metrics.json + figures replace this placeholder.
  • Train / run on a GPU Β· [ ] upload weights Β· [ ] add metrics.json Β· [ ] add figures Β· [ ] swap in the real results card

Limitations

Not yet trained β€” no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.

License

Code: MIT (this repository). The base model (sentence-transformers + FAISS) and dataset are each under their own licenses β€” check the upstream source before redistribution.

Citation

@misc{ropedia_academy,
  title  = {Ropedia Academy: an interactive course on embodied & spatial AI},
  author = {Ropedia Academy},
  year   = {2026},
  howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}

Method / original work: Lewis et al., RAG, NeurIPS 2020.


Documented placeholder in the Ropedia Academy collection β€” train it on a GPU to publish the real model. Contributions welcome on GitHub.

Contributors

cy0307

3 commits

cy0307/lm-rag-pipeline

Model

0

stars

3

commits

2

linked in READMEs

Jun 28, 2026

updated

advanced
embodied-ai
gpu
ropedia-academy
todo
track-c
track-d

README

RAG β€” retrieval-augmented generation 🚧 not trained yet

Embed a corpus, retrieve with FAISS, and ground an LLM's answer in it.

Status β€” documented recipe (placeholder). A production-grade pipeline from Ropedia Academy for an advanced, GPU-heavy task. Everything below β€” base model, objective, dataset, config, the exact evaluation β€” is specified; the weights / metrics / figures land here automatically when you run the notebook on a GPU (one click below). Try the trained models live in the Ropedia demos Space.

At a glance

Base modelBAAI/bge-small-en-v1.5 (embed) + Qwen2.5-0.5B-Instruct (gen)
Taskgrounded generation over a corpus
Training objectiveEmbed β†’ FAISS retrieve β†’ ground the LLM's answer in retrieved passages.
TrackLM Β· Language & multimodal
Built onsentence-transformers + FAISS
NotebookOpen In Colab
Compute / storage / timeGPU required β€” see the Compute Β· storage Β· time table in the notebook

Dataset

  • Source: Your document corpus (demo: 6 docs).

Training config

GPU-scale β€” the notebook ships a demo profile (free Colab T4) and a full profile, with an exact Compute Β· storage Β· time table. Hyperparameters (optimizer, steps, batch, LoRA rank, …) are in the training cell.

Evaluation results

⏳ Pending β€” run the notebook on a GPU to fill this in. This lab reports retrieval recall@k on a held-out split (see its Evaluate cell).

Inference example

No weights are published yet. After a GPU run, load the checkpoint/adapter the notebook saves (it also has a ready inference cell). Base model: BAAI/bge-small-en-v1.5 (embed) + Qwen2.5-0.5B-Instruct (gen).

How to fill this repo

  1. Open the notebook in Colab β†’ Runtime β†’ GPU β†’ Run all (runs the real pipeline).
  2. Run its Publish to the Hugging Face Hub step (or HfApi().upload_folder(...)) β€” the checkpoint + metrics.json + figures replace this placeholder.
  • Train / run on a GPU Β· [ ] upload weights Β· [ ] add metrics.json Β· [ ] add figures Β· [ ] swap in the real results card

Limitations

Not yet trained β€” no numbers to report. The pipeline is GPU-heavy (see the compute table); on free Colab use the demo-scale settings. This is an educational, reproducible recipe, not a tuned production release.

License

Code: MIT (this repository). The base model (sentence-transformers + FAISS) and dataset are each under their own licenses β€” check the upstream source before redistribution.

Citation

@misc{ropedia_academy,
  title  = {Ropedia Academy: an interactive course on embodied & spatial AI},
  author = {Ropedia Academy},
  year   = {2026},
  howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}

Method / original work: Lewis et al., RAG, NeurIPS 2020.


Documented placeholder in the Ropedia Academy collection β€” train it on a GPU to publish the real model. Contributions welcome on GitHub.

Contributors

cy0307

3 commits