Work done for my Bachelor's thesis.
Summarization framework based on subtopics and extractive summarization using pretrained language models.
Install the dependencies by running:
pip install -r framework/requirements.txt
Refer to biomed-ext-summ for converting an abstractive dataset into an extractive one.
To evaluate a configuration of the framework, run:
python eval/eval.py \
--dataset=<dataset name> \
--dataset-path=<path to extractive dataset> \
--embedding=<embedding>
Available <embedding> are bow, word2vec, glove, fasttext, biowordvec,
minilm, biobert and pubmedbert.
Instead of --embedding, the following options are available:
--plain to evaluate using only a pretrained model (without the framework).--oracle to evaluate using the reference extractive summary.This is a prototype to present the result of the framework to the end user.
To start the application, run in the repository root:
docker compose up
By default, the application will be served at http://localhost:8001.
Note that nvidia-container-toolkit is required in order to use the GPU in a container.
40 commits
Python
73.3%
Vue
21.3%
TypeScript
3.6%
Dockerfile
1.0%
Work done for my Bachelor's thesis.
Summarization framework based on subtopics and extractive summarization using pretrained language models.
Install the dependencies by running:
pip install -r framework/requirements.txt
Refer to biomed-ext-summ for converting an abstractive dataset into an extractive one.
To evaluate a configuration of the framework, run:
python eval/eval.py \
--dataset=<dataset name> \
--dataset-path=<path to extractive dataset> \
--embedding=<embedding>
Available <embedding> are bow, word2vec, glove, fasttext, biowordvec,
minilm, biobert and pubmedbert.
Instead of --embedding, the following options are available:
--plain to evaluate using only a pretrained model (without the framework).--oracle to evaluate using the reference extractive summary.This is a prototype to present the result of the framework to the end user.
To start the application, run in the repository root:
docker compose up
By default, the application will be served at http://localhost:8001.
Note that nvidia-container-toolkit is required in order to use the GPU in a container.
40 commits
Python
73.3%
Vue
21.3%
TypeScript
3.6%
Dockerfile
1.0%