thunlp/KernelGAT

The source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

Python

182

59 commits

updated Dec 8, 2022

See the code

README

Kernel Graph Attention Network (KGAT)

There are source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

model

For more information about the FEVER 1.0 shared task can be found on this website.

😃 What's New

Fact Extraction and Verification with SCIFACT

The shared task introduces scientific claim verification for helping scientists, clinicians, and public to verify the credibility of such claims with scientific literature, especially for the claims related to COVID-19.
>> Reproduce Our Results >> About SCIFACT Dataset >> Our Paper

Requirement

  • Python 3.X
  • fever_score
  • Pytorch
  • pytorch_pretrained_bert
  • transformers

Data and Checkpoint

  • All data and BERT based chechpoints can be found at Ali Drive.
  • RoBERTa based models and chechpoints can be found at Ali Drive.

Retrieval Model

  • BERT based ranker.
  • Go to the retrieval_model folder for more information.

Pretrain Model

  • Pre-train BERT with claim-evidence pairs.
  • Go to the pretrain folder for more information.

KGAT Model

  • Our KGAT model.
  • Go to the kgat folder for more information.

Results

The results are all on Codalab leaderboard.

UserPre-train ModelLabel AccuracyFEVER Score
GEAR_singleBERT (Base)0.71600.6710
a.soleimani.bBERT (Large)0.71860.6966
KGATRoBERTa (Large)0.74070.7038

KGAT performance with different pre-trained language model.

Pre-train ModelLabel AccuracyFEVER Score
BERT (Base)0.72810.6940
BERT (Large)0.73610.7024
RoBERTa (Large)0.74070.7038
CorefBERT (RoBERT Large)0.75960.7230

Citation

@inproceedings{liu2020kernel,
  title={Fine-grained Fact Verification with Kernel Graph Attention Network},
  author={Liu, Zhenghao and Xiong, Chenyan and Sun, Maosong and Liu, Zhiyuan},
  booktitle={Proceedings of ACL},
  year={2020}
}
@inproceedings{liu2020adapting,
    title = {Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling},
    author = {Liu, Zhenghao and Xiong, Chenyan and Dai, Zhuyun and Sun, Si and Sun, Maosong and Liu, Zhiyuan},
    booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2020},
   year={2020}
}

Contact

If you have questions, suggestions and bug reports, please email:

[email protected]
fact-verification
graph-attention-network
kernel

thunlp/KernelGAT

The source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

Python

182

59 commits

updated Dec 8, 2022

See the code

README

Kernel Graph Attention Network (KGAT)

There are source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

model

For more information about the FEVER 1.0 shared task can be found on this website.

😃 What's New

Fact Extraction and Verification with SCIFACT

The shared task introduces scientific claim verification for helping scientists, clinicians, and public to verify the credibility of such claims with scientific literature, especially for the claims related to COVID-19.
>> Reproduce Our Results >> About SCIFACT Dataset >> Our Paper

Requirement

  • Python 3.X
  • fever_score
  • Pytorch
  • pytorch_pretrained_bert
  • transformers

Data and Checkpoint

  • All data and BERT based chechpoints can be found at Ali Drive.
  • RoBERTa based models and chechpoints can be found at Ali Drive.

Retrieval Model

  • BERT based ranker.
  • Go to the retrieval_model folder for more information.

Pretrain Model

  • Pre-train BERT with claim-evidence pairs.
  • Go to the pretrain folder for more information.

KGAT Model

  • Our KGAT model.
  • Go to the kgat folder for more information.

Results

The results are all on Codalab leaderboard.

UserPre-train ModelLabel AccuracyFEVER Score
GEAR_singleBERT (Base)0.71600.6710
a.soleimani.bBERT (Large)0.71860.6966
KGATRoBERTa (Large)0.74070.7038

KGAT performance with different pre-trained language model.

Pre-train ModelLabel AccuracyFEVER Score
BERT (Base)0.72810.6940
BERT (Large)0.73610.7024
RoBERTa (Large)0.74070.7038
CorefBERT (RoBERT Large)0.75960.7230

Citation

@inproceedings{liu2020kernel,
  title={Fine-grained Fact Verification with Kernel Graph Attention Network},
  author={Liu, Zhenghao and Xiong, Chenyan and Sun, Maosong and Liu, Zhiyuan},
  booktitle={Proceedings of ACL},
  year={2020}
}
@inproceedings{liu2020adapting,
    title = {Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling},
    author = {Liu, Zhenghao and Xiong, Chenyan and Dai, Zhuyun and Sun, Si and Sun, Maosong and Liu, Zhiyuan},
    booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2020},
   year={2020}
}

Contact

If you have questions, suggestions and bug reports, please email:

[email protected]
fact-verification
graph-attention-network
kernel

Significant stargazers

Ronak

32 followers · starred Jan 2021

Weijia Shi

251 followers · starred Jul 2021