IndexTeam/Index-1.9B-Character

Model

40

stars

9

commits

1

repos using this model

1

linked in READMEs

Jun 27, 2024

updated

conversational
custom_code
index
pytorch
text-generation
transformers

README

Index-1.9B

Model Introduction

The Index-1.9B-Character model is a role-playing model with 1.9 billion parameters in the large language model series independently developed by the Index team. Users can customize the few shots role by uploading the role dialogue materials that meet the requirements.

For usage and related codes, please see Index-1.9B/roleplay

For more details, see our GitHub and Index-1.9B Technical Report

The Index-1.9B-Character model is evaluated using the authoritative benchmark CharacterEval in the role-playing field. The evaluation set evaluates multiple granularities from the perspectives of character consistency, dialogue ability, and role-playing attractiveness. Our 1.9b model ranks ninth in overall average score, significantly better than other models of the same level.

ModelAverage scorecharacter consistencydialogue abilityrole-playing attractiveness
CharacterYuyan-RLHF3.362.8564.0373.188
CharacterYuyan3.3092.883.9313.117
BC-NPC-Turbo3.1692.7643.7982.946
MiniMax3.1352.7183.7842.902
Baichuan2-13B3.1292.7013.7952.89
InternLM-20B3.1242.7153.7452.911
Baichuan2-7B3.112.73.7572.874
Index-1.9B-character3.1092.6763.7892.862
InternLM-7B3.0342.623.6982.784
XVERSE-13B3.0222.6323.6052.83
Qwen-14B3.0162.6493.5422.858
GPT-43.0062.6973.4482.873
Xingchen2.9912.5953.6462.732
XVERSE-7B2.9632.5643.5542.772
CharacterGLM2.9372.4933.6232.695
ChatGLM3-6B2.8982.5563.3992.739
Qwen-7B2.8492.543.3272.679
GPT-3.52.3812.1012.7492.293

Contributors

AsirAsir

3 commits

BitVoyage

2 commits

zhouying

2 commits

koushuicao

1 commits

IndexTeam/Index-1.9B-Character

Model

40

stars

9

commits

1

repos using this model

1

linked in READMEs

Jun 27, 2024

updated

conversational
custom_code
index
pytorch
text-generation
transformers

README

Index-1.9B

Model Introduction

The Index-1.9B-Character model is a role-playing model with 1.9 billion parameters in the large language model series independently developed by the Index team. Users can customize the few shots role by uploading the role dialogue materials that meet the requirements.

For usage and related codes, please see Index-1.9B/roleplay

For more details, see our GitHub and Index-1.9B Technical Report

The Index-1.9B-Character model is evaluated using the authoritative benchmark CharacterEval in the role-playing field. The evaluation set evaluates multiple granularities from the perspectives of character consistency, dialogue ability, and role-playing attractiveness. Our 1.9b model ranks ninth in overall average score, significantly better than other models of the same level.

ModelAverage scorecharacter consistencydialogue abilityrole-playing attractiveness
CharacterYuyan-RLHF3.362.8564.0373.188
CharacterYuyan3.3092.883.9313.117
BC-NPC-Turbo3.1692.7643.7982.946
MiniMax3.1352.7183.7842.902
Baichuan2-13B3.1292.7013.7952.89
InternLM-20B3.1242.7153.7452.911
Baichuan2-7B3.112.73.7572.874
Index-1.9B-character3.1092.6763.7892.862
InternLM-7B3.0342.623.6982.784
XVERSE-13B3.0222.6323.6052.83
Qwen-14B3.0162.6493.5422.858
GPT-43.0062.6973.4482.873
Xingchen2.9912.5953.6462.732
XVERSE-7B2.9632.5643.5542.772
CharacterGLM2.9372.4933.6232.695
ChatGLM3-6B2.8982.5563.3992.739
Qwen-7B2.8492.543.3272.679
GPT-3.52.3812.1012.7492.293

Contributors

AsirAsir

3 commits

BitVoyage

2 commits

zhouying

2 commits

koushuicao

1 commits