adrianlyjak/tinyllama-embed

1

stars

1

commits

Jupyter Notebook

primary language

Mar 13, 2025

updated

README

An attempt at training TinyLlama for text retrieval embeddings.

Mistral Fine Tuned for Embeddings. - Tweet linking to recreation of synthetic data

Paper training mistral on synthetic data
- dataset
- more dataset
- For that model, original training recipe taken from here https://arxiv.org/pdf/2310.08319.pdf, training code https://github.com/texttron/tevatron/tree/main/examples/repllama
TinyLlama

Contributors

1 commits

Similar repos

veya2ztn/sci-bert-finetune

Fineturn your embedding model for science paper

0

LUMIA-Group/Anchor-Embedding

The official implementation of the paper "Training LLMs to be Better Text Embedders through…

11

manveertamber/cadet-dense-retrieval

5

tcapelle/llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation

120

minishlab/potion-retrieval-32M

29

orionw/promptriever

The first dense retrieval model that can be prompted like an LM

93

NovaSearch-Team/RAG-Retrieval

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

1,129

atutej/RARe

8

Languages

Jupyter Notebook

99.2%

adrianlyjak/tinyllama-embed

1

stars

1

commits

Jupyter Notebook

primary language

Mar 13, 2025

updated

README

An attempt at training TinyLlama for text retrieval embeddings.

Mistral Fine Tuned for Embeddings. - Tweet linking to recreation of synthetic data

Paper training mistral on synthetic data
- dataset
- more dataset
- For that model, original training recipe taken from here https://arxiv.org/pdf/2310.08319.pdf, training code https://github.com/texttron/tevatron/tree/main/examples/repllama
TinyLlama

Similar repos

veya2ztn/sci-bert-finetune

Fineturn your embedding model for science paper

0

LUMIA-Group/Anchor-Embedding

The official implementation of the paper "Training LLMs to be Better Text Embedders through…

11

manveertamber/cadet-dense-retrieval

5

tcapelle/llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation

120

minishlab/potion-retrieval-32M

29

orionw/promptriever

The first dense retrieval model that can be prompted like an LM

93

NovaSearch-Team/RAG-Retrieval

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

1,129

atutej/RARe

8

Contributors

1 commits

Languages

Jupyter Notebook

99.2%