Shadowgraph
TrendingAbout
Sign in

text-yoga/cli

CLI for automatic generation of embeddings

Rust

1

15 commits

updated Mar 13, 2024

text.yoga

See the code
ai
llm
rag

README

text.yoga cli

⚠️ WIP - not yet ready for use.

A cli for automatic generation of embeddings for text documents.

Features

  • 100% Rust - No python required
  • Hardware-accelerated (uses candle)
  • Supported models
    • jinaai/jina-embeddings-v2-small-en
  • Supported file types
    • markdown

Usage

cargo run --features metal --release -- --input-folder=<folder-with-markdown-files>

License

Licensed under MIT.

Contributors

sigma-andex

15 commits

Similar repos

tyrchen/embedding-lib

3

StarlightSearch/EmbedAnything

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing…

1,307

Anush008/fastembed-rs

Rust library for generating vector embeddings and reranking locally!

1,011

stevenwcarter/clipper-rs

Using CLIP model to generate image or text embeddings

0

Vaibhavs10/fast-llm.rs

140

huggingface/candle

Minimalist ML framework for Rust

21,071

NarrativeApp/candle

Minimalist ML framework for Rust

0

CrispStrobe/CrispEmbed

Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with…

60

Languages

Rust

100.0%

text-yoga/cli

CLI for automatic generation of embeddings

Rust

1

15 commits

updated Mar 13, 2024

text.yoga

See the code
ai
llm
rag

README

text.yoga cli

⚠️ WIP - not yet ready for use.

A cli for automatic generation of embeddings for text documents.

Features

  • 100% Rust - No python required
  • Hardware-accelerated (uses candle)
  • Supported models
    • jinaai/jina-embeddings-v2-small-en
  • Supported file types
    • markdown

Usage

cargo run --features metal --release -- --input-folder=<folder-with-markdown-files>

License

Licensed under MIT.

Similar repos

tyrchen/embedding-lib

3

StarlightSearch/EmbedAnything

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing…

1,307

Anush008/fastembed-rs

Rust library for generating vector embeddings and reranking locally!

1,011

stevenwcarter/clipper-rs

Using CLIP model to generate image or text embeddings

0

Vaibhavs10/fast-llm.rs

140

huggingface/candle

Minimalist ML framework for Rust

21,071

NarrativeApp/candle

Minimalist ML framework for Rust

0

CrispStrobe/CrispEmbed

Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with…

60

Contributors

sigma-andex

15 commits

Languages

Rust

100.0%