5 repos
ml-rust/splintr
A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings,…
60
369 commits
extremq/gptsubtitler
Automatically subtitle any video spoken in any language to a language of your choice using AI.
63
2 commits
victordibia/llmx
An API for Chat Fine-Tuned Large Language Models (llm)
94
98 commits
argilla-io/distilabel
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable…
3,390
837 commits
microsoft/Tokenizer
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
212
93 commits