cs7643_project

Code for CS 7643 Project

Files included:

• pretrain.py: implementation of task-adaptive pre-training of the entire language model (non-adapter-based)

• classify.py: script for fine-tuning a language model on the chosen classification task and evaluating the fine-tuned model

• adapter-based_training: a folder that contains all training and evaluation scripts for adapter-based pre-training and fine-tuning.

• arXiv_multilabel_classification.ipynb: a notebook for running experiments on the arXiv dataset