Hzfinfdu/MPMP

ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Python

40

1 commits

updated Oct 24, 2022

See the code

README

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Implementation of Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning (https://arxiv.org/abs/2210.07565).

Release

Oct 22, 2022. Released the first version of MPMP and the 45 datasets on Google Drive.

Installation

python 3.7 is recommended.

pip install transformers==4.11.3
pip install datasets
pip install cma
pip install fastNLP
pip install sklearn
pip install bayesian-optimization
pip install scipy

Training

Please modify the meta path to the directory that contains the datasets in dataconfig.py.

Use the default parameters in run.py to reproduce the training of MPMP.

sh run.sh
black-box-tuning
deep-learning
few-shot-learning
gradient-free-optimization
modular
multitask-learning
natural-language-processing
prompt-learning

Hzfinfdu/MPMP

ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Python

40

1 commits

updated Oct 24, 2022

See the code

README

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Implementation of Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning (https://arxiv.org/abs/2210.07565).

Release

Oct 22, 2022. Released the first version of MPMP and the 45 datasets on Google Drive.

Installation

python 3.7 is recommended.

pip install transformers==4.11.3
pip install datasets
pip install cma
pip install fastNLP
pip install sklearn
pip install bayesian-optimization
pip install scipy

Training

Please modify the meta path to the directory that contains the datasets in dataconfig.py.

Use the default parameters in run.py to reproduce the training of MPMP.

sh run.sh
black-box-tuning
deep-learning
few-shot-learning
gradient-free-optimization
modular
multitask-learning
natural-language-processing
prompt-learning