Baseline model for the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input
2
8 commits
1 linked in READMEs
updated Jul 21, 2023
Baseline model for the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input
This is a BART-base model finetuned as a baseline. The model was finetuned on GovReport using the data processing pipeline from SLED; to load the validation or test set for use with these model, please use the datasets urialon/gov_report_validation and urialon/gov_report_test.
Baseline model for the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input
2
8 commits
1 linked in READMEs
updated Jul 21, 2023
Baseline model for the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input
This is a BART-base model finetuned as a baseline. The model was finetuned on GovReport using the data processing pipeline from SLED; to load the validation or test set for use with these model, please use the datasets urialon/gov_report_validation and urialon/gov_report_test.
