hyunseoki/ko-en-llama2-13b

Model

27

stars

9

commits

2

repos using this model

2

linked in READMEs

Oct 3, 2023

updated

endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers

README

Model Developers HyunseokLee, TaeyoungKim - (kaist alinlab, omnious.ai)

Input Models input text only.

Output Models generate text only.

Model Architecture
ko-en-llama2-13b is an auto-regressive language model based on the LLaMA2 transformer architecture.

Base Model
Llama-2-13B

Training Dataset
Open dataset wiki and AIhub (English + Korean).

Training Objective
We trained the model to learn Korean corpus while maintaining Llama's English ability. (still training)

Contributors

hyunseoki

9 commits

hyunseoki/ko-en-llama2-13b

Model

27

stars

9

commits

2

repos using this model

2

linked in READMEs

Oct 3, 2023

updated

endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers

README

Model Developers HyunseokLee, TaeyoungKim - (kaist alinlab, omnious.ai)

Input Models input text only.

Output Models generate text only.

Model Architecture
ko-en-llama2-13b is an auto-regressive language model based on the LLaMA2 transformer architecture.

Base Model
Llama-2-13B

Training Dataset
Open dataset wiki and AIhub (English + Korean).

Training Objective
We trained the model to learn Korean corpus while maintaining Llama's English ability. (still training)

Contributors

hyunseoki

9 commits