seara/rubert-base-cased-cedr-russian-emotion

Model

This is RuBERT model fine-tuned for __emotion classification__ of short __Russian__ texts.

5

12 commits

1 linked in READMEs

updated Oct 29, 2024

See the code

README

This is RuBERT model fine-tuned for emotion classification of short Russian texts. The task is a multi-label classification with the following labels:

0: no_emotion
1: joy
2: sadness
3: surprise
4: fear
5: anger

Label to Russian label:

no_emotion: нет эмоции
joy: радость
sadness: грусть
surprise: удивление
fear: страх
anger: злость

Usage

from transformers import pipeline
model = pipeline(model="seara/rubert-base-cased-cedr-russian-emotion")
model("Привет, ты мне нравишься!")
# [{'label': 'joy', 'score': 0.9388909935951233}]

Dataset

This model was trained on CEDR dataset.

An overview of the training data can be found in it's Hugging Face card or in the source article.

Training

Training were done in this project with this parameters:

tokenizer.max_length: null
batch_size: 64
optimizer: adam
lr: 0.00001
weight_decay: 0
num_epochs: 5

Eval results (on test split)

no_emotionjoysadnesssurprisefearangermicro avgmacro avgweighted avg
precision0.870.840.850.740.70.660.830.780.83
recall0.840.860.820.710.740.330.790.720.79
f1-score0.860.850.840.720.720.440.810.740.8
auc-roc0.950.970.960.940.930.860.950.930.95
support734353379170141125190219021902
bert
classification
emotion
emotion-classification
emotion-detection
emotion-recognition
endpoints_compatible
multilabel
multi-label-classification
pytorch
rubert
russian
safetensors
sentiment
sentiment analysis
sentiment-analysis
text-classification
text-embeddings-inference
tf
tiny
transformers

seara/rubert-base-cased-cedr-russian-emotion

Model

This is RuBERT model fine-tuned for __emotion classification__ of short __Russian__ texts.

5

12 commits

1 linked in READMEs

updated Oct 29, 2024

See the code

README

This is RuBERT model fine-tuned for emotion classification of short Russian texts. The task is a multi-label classification with the following labels:

0: no_emotion
1: joy
2: sadness
3: surprise
4: fear
5: anger

Label to Russian label:

no_emotion: нет эмоции
joy: радость
sadness: грусть
surprise: удивление
fear: страх
anger: злость

Usage

from transformers import pipeline
model = pipeline(model="seara/rubert-base-cased-cedr-russian-emotion")
model("Привет, ты мне нравишься!")
# [{'label': 'joy', 'score': 0.9388909935951233}]

Dataset

This model was trained on CEDR dataset.

An overview of the training data can be found in it's Hugging Face card or in the source article.

Training

Training were done in this project with this parameters:

tokenizer.max_length: null
batch_size: 64
optimizer: adam
lr: 0.00001
weight_decay: 0
num_epochs: 5

Eval results (on test split)

no_emotionjoysadnesssurprisefearangermicro avgmacro avgweighted avg
precision0.870.840.850.740.70.660.830.780.83
recall0.840.860.820.710.740.330.790.720.79
f1-score0.860.850.840.720.720.440.810.740.8
auc-roc0.950.970.960.940.930.860.950.930.95
support734353379170141125190219021902
bert
classification
emotion
emotion-classification
emotion-detection
emotion-recognition
endpoints_compatible
multilabel
multi-label-classification
pytorch
rubert
russian
safetensors
sentiment
sentiment analysis
sentiment-analysis
text-classification
text-embeddings-inference
tf
tiny
transformers