Shadowgraph
TrendingBuzzResearch
Chrome extension
Sign in

samuel-vitorino/Llama-3.2-3B-Instruct-Q8_0-LMRS

Model

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use: https://github.com/samuel-vitorino/lm.rs

1

4 commits

1 linked in READMEs

updated Sep 26, 2024

See the code

README

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use: https://github.com/samuel-vitorino/lm.rs

Original model by Meta: https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct

Similar repos

samuel-vitorino/Llama-3.2-1B-Instruct-Q8_0-LMRS

Model

Llama3.2 1B Instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Llama-3.2-3B-Instruct-Q4_0-LMRS

Model

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Llama-3.2-1B-Instruct-LMRS

Model

Llama3.2 1B Instruct model converted to the LMRS format. To use:…

1

samuel-vitorino/Phi-3.5-mini-instruct-q8_0-LMRS

Model

Phi-3.5-mini-instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Phi-3.5-vision-instruct-q8_0-LMRS

Model

Phi-3.5-vision-instruct model quantized and converted to the LMRS format. To use:…

2

samuel-vitorino/gemma2-2b-it-q8_0-LMRS

Model

Gemma 2 2B it model quantized and converted to the LMRS format.

2

samuel-vitorino/gemma2-9b-it-q8_0-LMRS

Model

Gemma 2 9B it model quantized and converted to the LMRS format.

2

samuel-vitorino/gemma2-2b-it-q4_0-LMRS

Model

Gemma 2 2B it model quantized and converted to the LMRS format. To use:…

1

Linked in READMEs

samuel-vitorino/lm.rs

Minimal LLM inference in Rust

1,033

README badge

samuel-vitorino/Llama-3.2-3B-Instruct-Q8_0-LMRS

Model

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use: https://github.com/samuel-vitorino/lm.rs

1

4 commits

1 linked in READMEs

updated Sep 26, 2024

See the code

README

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use: https://github.com/samuel-vitorino/lm.rs

Original model by Meta: https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct

Similar repos

samuel-vitorino/Llama-3.2-1B-Instruct-Q8_0-LMRS

Model

Llama3.2 1B Instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Llama-3.2-3B-Instruct-Q4_0-LMRS

Model

Llama3.2 3B Instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Llama-3.2-1B-Instruct-LMRS

Model

Llama3.2 1B Instruct model converted to the LMRS format. To use:…

1

samuel-vitorino/Phi-3.5-mini-instruct-q8_0-LMRS

Model

Phi-3.5-mini-instruct model quantized and converted to the LMRS format. To use:…

1

samuel-vitorino/Phi-3.5-vision-instruct-q8_0-LMRS

Model

Phi-3.5-vision-instruct model quantized and converted to the LMRS format. To use:…

2

samuel-vitorino/gemma2-2b-it-q8_0-LMRS

Model

Gemma 2 2B it model quantized and converted to the LMRS format.

2

samuel-vitorino/gemma2-9b-it-q8_0-LMRS

Model

Gemma 2 9B it model quantized and converted to the LMRS format.

2

samuel-vitorino/gemma2-2b-it-q4_0-LMRS

Model

Gemma 2 2B it model quantized and converted to the LMRS format. To use:…

1

Linked in READMEs

samuel-vitorino/lm.rs

Minimal LLM inference in Rust

1,033

README badge