Shadowgraph
About
Sign in

hfl/chinese-llama-2-1.3b-gguf

Model

2

stars

26

commits

1

linked in READMEs

Jan 24, 2024

updated

endpoints_compatible
gguf
Browse cluster: Chinese LLM Model Distribution →

README

Chinese-LLaMA-2-1.3B-GGUF

This repository contains the GGUF-v3 models (llama.cpp compatible) for Chinese-LLaMA-2-1.3B.

Performance

Metric: PPL, lower is better

Quantoriginalimatrix (-im)
Q2_K21.7422 +/- 0.4716019.0472 +/- 0.42128
Q3_K14.8538 +/- 0.3287414.2966 +/- 0.31684
Q4_013.8498 +/- 0.30349-
Q4_K16.0222 +/- 0.3555513.0832 +/- 0.28717
Q5_012.5743 +/- 0.27428-
Q5_K12.5865 +/- 0.2775912.6305 +/- 0.27711
Q6_K12.6588 +/- 0.2768212.6944 +/- 0.27805
Q8_012.7243 +/- 0.27883-
F1612.6122 +/- 0.27616-

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For Hugging Face version, please see: https://huggingface.co/hfl/chinese-llama-2-1.3b

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Contributors

hfl-rc

26 commits

Similar repos

hfl/chinese-llama-2-13b-16k-gguf

Model

1

hfl/chinese-llama-2-13b-gguf

Model

5

hfl/chinese-alpaca-2-1.3b-gguf

Model

6

hfl/chinese-alpaca-2-13b-gguf

Model

10

hfl/chinese-llama-2-7b-16k-gguf

Model

2

hfl/chinese-alpaca-2-13b-16k-gguf

Model

1

hfl/chinese-llama-2-7b-gguf

Model

5

hfl/chinese-alpaca-2-7b-16k-gguf

Model

1

Linked in READMEs

ymcui/Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context…

7,120

README badge

hfl/chinese-llama-2-1.3b-gguf

Model

2

stars

26

commits

1

linked in READMEs

Jan 24, 2024

updated

endpoints_compatible
gguf
Browse cluster: Chinese LLM Model Distribution →

README

Chinese-LLaMA-2-1.3B-GGUF

This repository contains the GGUF-v3 models (llama.cpp compatible) for Chinese-LLaMA-2-1.3B.

Performance

Metric: PPL, lower is better

Quantoriginalimatrix (-im)
Q2_K21.7422 +/- 0.4716019.0472 +/- 0.42128
Q3_K14.8538 +/- 0.3287414.2966 +/- 0.31684
Q4_013.8498 +/- 0.30349-
Q4_K16.0222 +/- 0.3555513.0832 +/- 0.28717
Q5_012.5743 +/- 0.27428-
Q5_K12.5865 +/- 0.2775912.6305 +/- 0.27711
Q6_K12.6588 +/- 0.2768212.6944 +/- 0.27805
Q8_012.7243 +/- 0.27883-
F1612.6122 +/- 0.27616-

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For Hugging Face version, please see: https://huggingface.co/hfl/chinese-llama-2-1.3b

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Similar repos

hfl/chinese-llama-2-13b-16k-gguf

Model

1

hfl/chinese-llama-2-13b-gguf

Model

5

hfl/chinese-alpaca-2-1.3b-gguf

Model

6

hfl/chinese-alpaca-2-13b-gguf

Model

10

hfl/chinese-llama-2-7b-16k-gguf

Model

2

hfl/chinese-alpaca-2-13b-16k-gguf

Model

1

hfl/chinese-llama-2-7b-gguf

Model

5

hfl/chinese-alpaca-2-7b-16k-gguf

Model

1

Linked in READMEs

ymcui/Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context…

7,120

README badge

Contributors

hfl-rc

26 commits