Chrome extension

singletongue/wikipedia-utils

Dataset

Wikipedia-Utils: Preprocessed Wikipedia Texts for NLP

8

20 commits

3 linked in READMEs

updated Apr 9, 2024

README

Wikipedia-Utils: Preprocessed Wikipedia Texts for NLP

Preprocessed Wikipedia texts generated with the scripts in singletongue/wikipedia-utils repo.

For detailed information on how the texts are processed, please refer to the repo.

Similar repos

legacy-datasets/wikipedia

Dataset Card for Wikipedia

685

Salesforce/wikitext

Dataset Card for "wikitext"

866

stanford-oval/wikipedia

This dataset contains preprocessed and chunked Wikipedia HTML dumps from 25 languages.

14

LazarusNLP/wikipedia_id_20230520

Dataset Card for "wikipedia_id_20230520"

0

fujiki/llm-japanese-dataset_wikipedia

- This dataset is a subset of izumi-lab/llm-japanese-dataset only including wikipedia task.

3

singletongue/wikipedia-utils

Utility scripts for preprocessing Wikipedia texts for NLP

78

taufiqdp/Indo4B-hf

3

sabilmakbar/indo_wiki

Indonesian Wikipedia Data Repository

2

Linked in READMEs

singletongue/wikipedia-utils

Utility scripts for preprocessing Wikipedia texts for NLP

78

hotchpotch/JQaRA

JQaRA: Japanese Question Answering with Retrieval Augmentation - 検索拡張(RAG)評価のための日本語Q&Aデータセット

45

hotchpotch/wikipedia-passages-jawiki-embeddings-utils

wikipedia 日本語の文を、各種日本語の embeddings や faiss index へと変換するスクリプト等。

12

singletongue/wikipedia-utils

Dataset

Wikipedia-Utils: Preprocessed Wikipedia Texts for NLP

8

20 commits

3 linked in READMEs

updated Apr 9, 2024

README

Wikipedia-Utils: Preprocessed Wikipedia Texts for NLP

Preprocessed Wikipedia texts generated with the scripts in singletongue/wikipedia-utils repo.

For detailed information on how the texts are processed, please refer to the repo.

Similar repos

legacy-datasets/wikipedia

Dataset Card for Wikipedia

685

Salesforce/wikitext

Dataset Card for "wikitext"

866

stanford-oval/wikipedia

This dataset contains preprocessed and chunked Wikipedia HTML dumps from 25 languages.

14

LazarusNLP/wikipedia_id_20230520

Dataset Card for "wikipedia_id_20230520"

0

fujiki/llm-japanese-dataset_wikipedia

- This dataset is a subset of izumi-lab/llm-japanese-dataset only including wikipedia task.

3

singletongue/wikipedia-utils

Utility scripts for preprocessing Wikipedia texts for NLP

78

taufiqdp/Indo4B-hf

3

sabilmakbar/indo_wiki

Indonesian Wikipedia Data Repository

2

Linked in READMEs

singletongue/wikipedia-utils

Utility scripts for preprocessing Wikipedia texts for NLP

78

hotchpotch/JQaRA

JQaRA: Japanese Question Answering with Retrieval Augmentation - 検索拡張(RAG)評価のための日本語Q&Aデータセット

45

hotchpotch/wikipedia-passages-jawiki-embeddings-utils

wikipedia 日本語の文を、各種日本語の embeddings や faiss index へと変換するスクリプト等。

12