nuvocare/WikiMedical_sentence_similarity

Dataset

Dataset Card for "WikiMedical_sentence_similarity"

1

5 commits

2 linked in READMEs

updated Oct 18, 2023

See the code

README

Dataset Card for "WikiMedical_sentence_similarity"

WikiMedical_sentence_similarity is an adapted and ready-to-use sentence similarity dataset based on this dataset.

The preprocessing followed three steps:

  • Each text is splitted into sentences of 256 tokens (nltk tokenizer)
  • Each sentence is paired with a positive pair if found, and a negative one. Negative one are drawn randomly in the whole dataset.
  • Train and test split correspond to 70%/30%

More Information needed

nuvocare/WikiMedical_sentence_similarity

Dataset

Dataset Card for "WikiMedical_sentence_similarity"

1

5 commits

2 linked in READMEs

updated Oct 18, 2023

See the code

README

Dataset Card for "WikiMedical_sentence_similarity"

WikiMedical_sentence_similarity is an adapted and ready-to-use sentence similarity dataset based on this dataset.

The preprocessing followed three steps:

  • Each text is splitted into sentences of 256 tokens (nltk tokenizer)
  • Each sentence is paired with a positive pair if found, and a negative one. Negative one are drawn randomly in the whole dataset.
  • Train and test split correspond to 70%/30%

More Information needed