thomas-li-sjtu/Sentence-Similarity

Final Project for NIS8021——use BERT to classify similarity of sentence set to 1 if text_a and text_2 have essentially the same meaning, and 0 otherwise.

4

stars

19

commits

Python

primary language

Jan 11, 2022

updated

bert-model
nlp-machine-learning
torch

README

自然语言处理前言技术大作业:判断给定的两个句子含义是否相同(1为相同,0为不同)

数据清理

  • max_len:40
  • 句子中存在一些脏数据:
    • How can I develop android app? 0——train.txt
    • How can I create an Android app? 0——valid.txt
  • 数据增强:(仅链式)增加9万多条正例

模型

  1. bert-base-uncased

  2. bert-base-enhance

  3. bert-rdrop

  4. bert-simcse

  5. sentence-bert

  6. albert

  7. roberta

    ModelaccprecisionrecallF1
    bert-base-uncased89.3983.4588.6188.72
    bert-base-enhance90.6085.0190.2390.00
    bert-rdrop87.5681.7385.0486.71
    bert-simcse89.9585.8086.9689.21
    sentence-bert89.0384.4285.9088.23
    albert89.4685.4885.7988.66
    roberta90.1086.0390.0490.39

Contributors

thomas-li-sjtu

19 commits

thomas-li-sjtu/Sentence-Similarity

Final Project for NIS8021——use BERT to classify similarity of sentence set to 1 if text_a and text_2 have essentially the same meaning, and 0 otherwise.

4

stars

19

commits

Python

primary language

Jan 11, 2022

updated

bert-model
nlp-machine-learning
torch

README

自然语言处理前言技术大作业:判断给定的两个句子含义是否相同(1为相同,0为不同)

数据清理

  • max_len:40
  • 句子中存在一些脏数据:
    • How can I develop android app? 0——train.txt
    • How can I create an Android app? 0——valid.txt
  • 数据增强:(仅链式)增加9万多条正例

模型

  1. bert-base-uncased

  2. bert-base-enhance

  3. bert-rdrop

  4. bert-simcse

  5. sentence-bert

  6. albert

  7. roberta

    ModelaccprecisionrecallF1
    bert-base-uncased89.3983.4588.6188.72
    bert-base-enhance90.6085.0190.2390.00
    bert-rdrop87.5681.7385.0486.71
    bert-simcse89.9585.8086.9689.21
    sentence-bert89.0384.4285.9088.23
    albert89.4685.4885.7988.66
    roberta90.1086.0390.0490.39

Contributors

thomas-li-sjtu

19 commits

Languages

Python

100.0%