Pritesh-2711/pii-bench

Dataset

PIIBench

7

5 commits

1 linked in READMEs

updated Jun 3, 2026

See the code

README

PIIBench

Description

PIIBench is a unified benchmark dataset for PII detection across multiple domains.

Paper

Dataset Summary

  • Total records: 999,940
  • Entity types: 82
  • BIO labels: 165 including O
  • Format: BIO token classification with source text

Structure

Each example contains:

  • tokens: list of tokens
  • labels: BIO labels
  • source: original data source of the sample
  • text: original/source text when available; deterministic token-joined text for token-only sources

Splits

SplitRecords
train.jsonl799,948
validation.jsonl99,990
test.jsonl100,002

Source

Ten datasets are downloaded from Hugging Face and consolidated into a unified BIO-tagged format:

DatasetRowsDomain
ai4privacy/pii-masking-400k~400kGeneral, 63 PII classes
ai4privacy/pii-masking-300k~300kGeneral + Finance (FinPII-80k)
gretelai/synthetic_pii_finance_multilingual~56kFinance (100 doc types)
nvidia/Nemotron-PII~100kGeneral (50+ industries)
wikiann (en)~20kWikipedia, PER/ORG/LOC only
Babelscape/multinerd (en)variesWikipedia + news, 15 types
DFKI-SLT/few-nerd~188kWikipedia, 66 fine-grained types
conll2003~14kNews (Reuters), 4 types
nlpaueb/finer-139~1.1MFinance (SEC filings), 139 XBRL tags
Isotonic/pii-masking-200k~200kGeneral, 54 PII classes

finer-139 is capped at 150k records during data preparation. Entity types with fewer than 500 B-mentions globally are collapsed to O.

The current release was regenerated with the PIIBench preparation pipeline's --include-text option so each example includes a text field in addition to the trainable token/label/source fields.

License

This dataset is derived from multiple sources. Users must comply with the original dataset licenses of the constituent datasets.

Citation

@article{jha2026piibench,
  title={PIIBench: A Unified Multi-Source Benchmark Corpus for PII Detection},
  author={Jha, Pritesh},
  year={2026}
}
benchmark
privacy

Pritesh-2711/pii-bench

Dataset

PIIBench

7

5 commits

1 linked in READMEs

updated Jun 3, 2026

See the code

README

PIIBench

Description

PIIBench is a unified benchmark dataset for PII detection across multiple domains.

Paper

Dataset Summary

  • Total records: 999,940
  • Entity types: 82
  • BIO labels: 165 including O
  • Format: BIO token classification with source text

Structure

Each example contains:

  • tokens: list of tokens
  • labels: BIO labels
  • source: original data source of the sample
  • text: original/source text when available; deterministic token-joined text for token-only sources

Splits

SplitRecords
train.jsonl799,948
validation.jsonl99,990
test.jsonl100,002

Source

Ten datasets are downloaded from Hugging Face and consolidated into a unified BIO-tagged format:

DatasetRowsDomain
ai4privacy/pii-masking-400k~400kGeneral, 63 PII classes
ai4privacy/pii-masking-300k~300kGeneral + Finance (FinPII-80k)
gretelai/synthetic_pii_finance_multilingual~56kFinance (100 doc types)
nvidia/Nemotron-PII~100kGeneral (50+ industries)
wikiann (en)~20kWikipedia, PER/ORG/LOC only
Babelscape/multinerd (en)variesWikipedia + news, 15 types
DFKI-SLT/few-nerd~188kWikipedia, 66 fine-grained types
conll2003~14kNews (Reuters), 4 types
nlpaueb/finer-139~1.1MFinance (SEC filings), 139 XBRL tags
Isotonic/pii-masking-200k~200kGeneral, 54 PII classes

finer-139 is capped at 150k records during data preparation. Entity types with fewer than 500 B-mentions globally are collapsed to O.

The current release was regenerated with the PIIBench preparation pipeline's --include-text option so each example includes a text field in addition to the trainable token/label/source fields.

License

This dataset is derived from multiple sources. Users must comply with the original dataset licenses of the constituent datasets.

Citation

@article{jha2026piibench,
  title={PIIBench: A Unified Multi-Source Benchmark Corpus for PII Detection},
  author={Jha, Pritesh},
  year={2026}
}
benchmark
privacy