achouhan93/eur-lex-sum

Dataset for cross-lingual legal text summarization from EUR-Lex document summaries

Python

21

112 commits

updated Feb 27, 2024

See the code

README

EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain

Dennis Aumiller*, Ashish Chouhan*, and Michael Gertz
Heidelberg University & SRH Hochschule Heidelberg
contact us at: {aumiller, chouhan, gertz}@informatik.uni-heidelberg.de

Find our dataset on the Huggingface Hub: 🤗 eur-lex-sum
The data card also provides further insight on the acquisition process (and some limitations) of the data. Please refer to the Huggingface Hub for more information.
A pre-print of our work is available; it has also been accepted at the main conference track of EMNLP 2022, conference proceedings will be available in December 2022.

Installation

Install all necessary dependencies by running

python3 -m pip install -r requirements.txt

after cloning this repository.

This code base provides necessary scripts for the scraping process (Scraping/), as well as the analysis of our corpus (Analysis/) and final baseline experiments (Baselines/).

For a comparison of language-specific stats, please refer to Table 5 in our pre-print.

Dataset NameDomainNumber of LanguagesAverage Tokens in Reference TextAverage Tokens in the Summary text (in words)Compression RatioDataset
EUR-Lex-Sum - Our ContributionLegal2412,200 (EN)799 (EN)16🤗
BillSum (US)Legal113822000 characters, Words are not considered as tokens-🤗
BillSum (CA)Legal116842000 characters, Words are not considered as tokens-🤗
Global VoicesNews1535951-Paperswithcode
WikiLinguaWikiHow1839139-🤗
Xwikis (comparable)Wikipedia494577EN: ~12.2🤗
Xwikis (parallel)Wikipedia49727618.35🤗
Spektrum (Wiki)Wikipedia2155914020GitHub
Spektrum (Spektrum)Scientific2233736130GitHub
CLIDSUM (Chat)Dialogue383,920,3-GitHub
CLIDSUM (Interview)Dialogue31555,414,4-GitHub
MLSUMNews5(French) FR: 632,39FR: 29,5FR: 21,4🤗
(German) DE: 570,6DE: 30,36DE: 18,8
(Spanish) ES: 800,50ES: 20,71ES: 38,7
(Russian) RU: 959,4RU: 14,57RU: 65,8
(Turkish) TU: 309,18TU: 22,88TU: 13,5
(English) EN: 790,24EN: 55,56EN: 14,2

Cite our work

If you use the dataset or other parts of this code base, please use the following citation for attribution:

@inproceedings{aumiller-etal-2022-eur,
    title = {{EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain}},
    author = "Aumiller, Dennis  and
      Chouhan, Ashish  and
      Gertz, Michael",
    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
    month = dec,
    year = "2022",
    address = "Abu Dhabi, United Arab Emirates",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.emnlp-main.519",
    pages = "7626--7639"
}

License Information

Copyright for the editorial content of EUR-Lex website, the summaries of EU legislation and the consolidated texts owned by the EU, are licensed under the Creative Commons Attribution 4.0 International licence, i.e., CC BY 4.0 as mentioned on the official EUR-Lex website. Any data artifacts remain licensed under the CC BY 4.0 license.

License for software component

Per recommendation of the Creative Commons, we apply a separate license to the software component of this repository. We use the standard MIT license for code artifacts.

Contributors

dennlinger

94 commits

achouhan93

18 commits

achouhan93/eur-lex-sum

Dataset for cross-lingual legal text summarization from EUR-Lex document summaries

Python

21

112 commits

updated Feb 27, 2024

See the code

README

EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain

Dennis Aumiller*, Ashish Chouhan*, and Michael Gertz
Heidelberg University & SRH Hochschule Heidelberg
contact us at: {aumiller, chouhan, gertz}@informatik.uni-heidelberg.de

Find our dataset on the Huggingface Hub: 🤗 eur-lex-sum
The data card also provides further insight on the acquisition process (and some limitations) of the data. Please refer to the Huggingface Hub for more information.
A pre-print of our work is available; it has also been accepted at the main conference track of EMNLP 2022, conference proceedings will be available in December 2022.

Installation

Install all necessary dependencies by running

python3 -m pip install -r requirements.txt

after cloning this repository.

This code base provides necessary scripts for the scraping process (Scraping/), as well as the analysis of our corpus (Analysis/) and final baseline experiments (Baselines/).

For a comparison of language-specific stats, please refer to Table 5 in our pre-print.

Dataset NameDomainNumber of LanguagesAverage Tokens in Reference TextAverage Tokens in the Summary text (in words)Compression RatioDataset
EUR-Lex-Sum - Our ContributionLegal2412,200 (EN)799 (EN)16🤗
BillSum (US)Legal113822000 characters, Words are not considered as tokens-🤗
BillSum (CA)Legal116842000 characters, Words are not considered as tokens-🤗
Global VoicesNews1535951-Paperswithcode
WikiLinguaWikiHow1839139-🤗
Xwikis (comparable)Wikipedia494577EN: ~12.2🤗
Xwikis (parallel)Wikipedia49727618.35🤗
Spektrum (Wiki)Wikipedia2155914020GitHub
Spektrum (Spektrum)Scientific2233736130GitHub
CLIDSUM (Chat)Dialogue383,920,3-GitHub
CLIDSUM (Interview)Dialogue31555,414,4-GitHub
MLSUMNews5(French) FR: 632,39FR: 29,5FR: 21,4🤗
(German) DE: 570,6DE: 30,36DE: 18,8
(Spanish) ES: 800,50ES: 20,71ES: 38,7
(Russian) RU: 959,4RU: 14,57RU: 65,8
(Turkish) TU: 309,18TU: 22,88TU: 13,5
(English) EN: 790,24EN: 55,56EN: 14,2

Cite our work

If you use the dataset or other parts of this code base, please use the following citation for attribution:

@inproceedings{aumiller-etal-2022-eur,
    title = {{EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain}},
    author = "Aumiller, Dennis  and
      Chouhan, Ashish  and
      Gertz, Michael",
    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
    month = dec,
    year = "2022",
    address = "Abu Dhabi, United Arab Emirates",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.emnlp-main.519",
    pages = "7626--7639"
}

License Information

Copyright for the editorial content of EUR-Lex website, the summaries of EU legislation and the consolidated texts owned by the EU, are licensed under the Creative Commons Attribution 4.0 International licence, i.e., CC BY 4.0 as mentioned on the official EUR-Lex website. Any data artifacts remain licensed under the CC BY 4.0 license.

License for software component

Per recommendation of the Creative Commons, we apply a separate license to the software component of this repository. We use the standard MIT license for code artifacts.

Contributors

dennlinger

94 commits

achouhan93

18 commits

Languages

Python

100.0%