Testing ground for task 5 from BioCreative VI
Task 5: Text mining chemical-protein interactions (CHEMPROT)
The aim of the CHEMPROT task of BioCreative VI is to promote the development and evaluation of systems that are able to automatically detect in running text (PubMed abstracts) relations between chemical compounds/drug and genes/proteins. We will therefore release a manually annotated corpus, the CHEMPROT corpus, where domain experts have exhaustively labeled: (a) all chemical and gene mentions, and (b) all binary relationships between them corresponding to a specific set of biologically relevant relation types (CHEMPROT relation classes).
data/
├── chemprot_development
│ ├── chemprot_development_abstracts.tsv
│ ├── chemprot_development_entities.tsv
│ ├── chemprot_development_gold_standard.tsv
│ ├── chemprot_development_relations.tsv
│ └── Readme.pdf
├── chemprot_sample
│ ├── chemprot_sample_abstracts.tsv
│ ├── chemprot_sample_entities.tsv
│ ├── chemprot_sample_gold_standard.tsv
│ ├── chemprot_sample_predictions_eval.txt
│ ├── chemprot_sample_predictions.tsv
│ ├── chemprot_sample_relations.tsv
│ ├── guidelines
│ │ ├── CEM_guidelines.pdf
│ │ ├── CHEMPROT_guidelines_v6.pdf
│ │ └── GPRO_guidelines.pdf
│ └── Readme.pdf
├── chemprot_test_gs
│ ├── chemprot_test_abstracts_gs.tsv
│ ├── chemprot_test_entities_gs.tsv
│ ├── chemprot_test_gold_standard.tsv
│ ├── chemprot_test_relations_gs.tsv
│ └── readme_test_gs.pdf
└── chemprot_training
├── chemprot_training_abstracts.tsv
├── chemprot_training_entities.tsv
├── chemprot_training_gold_standard.tsv
├── chemprot_training_relations.tsv
└── Readme.pdf
5 directories, 25 files
10471277
Probing the salmeterol binding site on the beta 2-adrenergic receptor using a novel photoaffinity ligand,[(125)I]iodoazidosalmeterol.
Salmeterol is a long-acting beta2-adrenergic receptor (beta 2AR) agonist used clinically to treat asthma. In addition to binding at the active agonist site, it has been proposed that salmeterol also binds with very high affinity at a second site, termed the "exosite", and that this exosite contributes to the long duration of action of salmeterol. To determine the position of the phenyl ring of the aralkyloxyalkyl side chain of salmeterol in the beta 2AR binding site, we designed and synthesized the agonist photoaffinity label [(125)I]iodoazidosalmeterol ([125I]IAS). In direct adenylyl cyclase activation, in effects on adenylyl cyclase after pretreatment of intact cells, and in guinea pig tracheal relaxation assays, IAS and the parent drug salmeterol behave essentially the same. Significantly, the photoreactive azide of IAS is positioned on the phenyl ring at the end of the molecule which is thought to be involved in exosite binding. Carrier-free radioiodinated [125I]IAS was used to photolabel epitope-tagged human beta 2AR in membranes prepared from stably transfected HEK 293 cells. Labeling with [(125)I]IAS was blocked by 10 microM (-)-alprenolol and inhibited by addition of GTP gamma S, and [125I]IAS migrated at the same position on an SDS-PAGE gel as the beta 2AR labeled by the antagonist photoaffinity label [125I]iodoazidobenzylpindolol ([125I]IABP). The labeled receptor was purified on a nickel affinity column and cleaved with factor Xa protease at a specific sequence in the large loop between transmembrane segments 5 and 6, yielding two peptides. While the control antagonist photoaffinity label [125I]IABP labeled both the large N-terminal fragment [containing transmembranes (TMs) 1-5] and the smaller C-terminal fragment (containing TMs 6 and 7), essentially all of the [125I]IAS labeling was on the smaller C-terminal peptide containing TMs 6 and 7. This direct biochemical evidence demonstrates that when salmeterol binds to the receptor, its hydrophobic aryloxyalkyl tail is positioned near TM 6 and/or TM 7. A model of IAS binding to the beta 2AR is proposed.
| PMID | Entity | Type | Start | End | Text |
|---|---|---|---|---|---|
| 10471277 | T1 | CHEMICAL | 135 | 145 | Salmeterol |
| 10471277 | T2 | CHEMICAL | 1248 | 1259 | [(125)I]IAS |
| 10471277 | T3 | CHEMICAL | 1285 | 1299 | (-)-alprenolol |
| 10471277 | T4 | CHEMICAL | 1329 | 1332 | GTP |
| 10471277 | T5 | CHEMICAL | 1346 | 1355 | [125I]IAS |
| 10471277 | T6 | CHEMICAL | 1467 | 1496 | [125I]iodoazidobenzylpindolol |
| 10471277 | T7 | CHEMICAL | 1498 | 1508 | [125I]IABP |
| 10471277 | T8 | CHEMICAL | 1550 | 1556 | nickel |
| 10471277 | T9 | CHEMICAL | 1762 | 1772 | [125I]IABP |
| 10471277 | T10 | CHEMICAL | 1796 | 1797 | N |
| 10471277 | T11 | CHEMICAL | 1870 | 1871 | C |
| 10471277 | T12 | CHEMICAL | 1939 | 1948 | [125I]IAS |
| 10471277 | T13 | CHEMICAL | 318 | 328 | salmeterol |
| 10471277 | T14 | CHEMICAL | 1977 | 1978 | C |
| 10471277 | T15 | CHEMICAL | 2076 | 2086 | salmeterol |
| 10471277 | T16 | CHEMICAL | 2126 | 2138 | aryloxyalkyl |
| 10471277 | T17 | CHEMICAL | 2192 | 2195 | IAS |
| 10471277 | T18 | CHEMICAL | 472 | 482 | salmeterol |
| 10471277 | T19 | CHEMICAL | 517 | 523 | phenyl |
| 10471277 | T20 | CHEMICAL | 566 | 576 | salmeterol |
| 10471277 | T21 | CHEMICAL | 667 | 694 | [(125)I]iodoazidosalmeterol |
| 10471277 | T22 | CHEMICAL | 696 | 705 | [125I]IAS |
| 10471277 | T23 | CHEMICAL | 718 | 726 | adenylyl |
| 10471277 | T24 | CHEMICAL | 761 | 769 | adenylyl |
| 10471277 | T25 | CHEMICAL | 860 | 863 | IAS |
| 10471277 | T26 | CHEMICAL | 884 | 894 | salmeterol |
| 10471277 | T27 | CHEMICAL | 957 | 962 | azide |
| 10471277 | T28 | CHEMICAL | 966 | 969 | IAS |
| 10471277 | T29 | CHEMICAL | 991 | 997 | phenyl |
| 10471277 | T30 | CHEMICAL | 1110 | 1119 | [125I]IAS |
| 10471277 | T31 | CHEMICAL | 106 | 133 | [(125)I]iodoazidosalmeterol |
| 10471277 | T33 | GENE-N | 1158 | 1172 | human beta 2AR |
| 10471277 | T34 | GENE-N | 1412 | 1420 | beta 2AR |
| 10471277 | T35 | GENE-N | 1590 | 1599 | factor Xa |
| 10471277 | T36 | GENE-N | 2211 | 2219 | beta 2AR |
| 10471277 | T37 | GENE-N | 163 | 188 | beta2-adrenergic receptor |
| 10471277 | T38 | GENE-N | 584 | 592 | beta 2AR |
| 10471277 | T39 | GENE-N | 190 | 198 | beta 2AR |
| 10471277 | T40 | GENE-N | 43 | 69 | beta 2-adrenergic receptor |
| 10471277 | T32 | CHEMICAL | 12 | 22 | salmeterol |
| 10471277 | T41 | CHEMICAL | 536 | 551 | aralkyloxyalkyl |
| 10471277 | T42 | GENE-Y | 718 | 734 | adenylyl cyclase |
| 10471277 | T44 | GENE-Y | 761 | 777 | adenylyl cyclase |
| PMID | CPR Group | Evaluation Type | CPR | Arg1 | Arg2 |
|---|---|---|---|---|---|
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T30 | Arg2:T33 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T31 | Arg2:T40 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T32 | Arg2:T40 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T20 | Arg2:T38 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T41 | Arg2:T38 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T19 | Arg2:T38 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T25 | Arg2:T42 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T26 | Arg2:T42 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T25 | Arg2:T44 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T26 | Arg2:T44 |
| 10471277 | CPR:6 | Y | ANTAGONIST | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Y | ANTAGONIST | Arg1:T7 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T5 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T2 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T17 | Arg2:T36 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T3 | Arg2:T34 |
| PMID | CPR Group | Arg1 | Arg2 |
|---|---|---|---|
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:5 | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:3 | Arg1:T25 | Arg2:T42 |
| 10471277 | CPR:3 | Arg1:T26 | Arg2:T42 |
| 10471277 | CPR:3 | Arg1:T25 | Arg2:T44 |
| 10471277 | CPR:3 | Arg1:T26 | Arg2:T44 |
| 10471277 | CPR:6 | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Arg1:T7 | Arg2:T34 |
| PMID | CPR Group | Arg1 | Arg2 |
|---|---|---|---|
| 10471277 | CPR:5 | Arg1:T17 | Arg2:T36 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:5 | Arg1:T20 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T31 | Arg2:T40 |
| 10471277 | CPR:5 | Arg1:T32 | Arg2:T40 |
| 10471277 | CPR:6 | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Arg1:T7 | Arg2:T34 |

BLUE, the Biomedical Language Understanding Evaluation benchmark
Model file of scibert_scivocab_uncased:
wget "https://s3-us-west-2.amazonaws.com/ai2-s2-research/scibert/pytorch_models/scibert_scivocab_uncased.tar"
23 commits
Jupyter Notebook
82.8%
Python
17.2%
Testing ground for task 5 from BioCreative VI
Task 5: Text mining chemical-protein interactions (CHEMPROT)
The aim of the CHEMPROT task of BioCreative VI is to promote the development and evaluation of systems that are able to automatically detect in running text (PubMed abstracts) relations between chemical compounds/drug and genes/proteins. We will therefore release a manually annotated corpus, the CHEMPROT corpus, where domain experts have exhaustively labeled: (a) all chemical and gene mentions, and (b) all binary relationships between them corresponding to a specific set of biologically relevant relation types (CHEMPROT relation classes).
data/
├── chemprot_development
│ ├── chemprot_development_abstracts.tsv
│ ├── chemprot_development_entities.tsv
│ ├── chemprot_development_gold_standard.tsv
│ ├── chemprot_development_relations.tsv
│ └── Readme.pdf
├── chemprot_sample
│ ├── chemprot_sample_abstracts.tsv
│ ├── chemprot_sample_entities.tsv
│ ├── chemprot_sample_gold_standard.tsv
│ ├── chemprot_sample_predictions_eval.txt
│ ├── chemprot_sample_predictions.tsv
│ ├── chemprot_sample_relations.tsv
│ ├── guidelines
│ │ ├── CEM_guidelines.pdf
│ │ ├── CHEMPROT_guidelines_v6.pdf
│ │ └── GPRO_guidelines.pdf
│ └── Readme.pdf
├── chemprot_test_gs
│ ├── chemprot_test_abstracts_gs.tsv
│ ├── chemprot_test_entities_gs.tsv
│ ├── chemprot_test_gold_standard.tsv
│ ├── chemprot_test_relations_gs.tsv
│ └── readme_test_gs.pdf
└── chemprot_training
├── chemprot_training_abstracts.tsv
├── chemprot_training_entities.tsv
├── chemprot_training_gold_standard.tsv
├── chemprot_training_relations.tsv
└── Readme.pdf
5 directories, 25 files
10471277
Probing the salmeterol binding site on the beta 2-adrenergic receptor using a novel photoaffinity ligand,[(125)I]iodoazidosalmeterol.
Salmeterol is a long-acting beta2-adrenergic receptor (beta 2AR) agonist used clinically to treat asthma. In addition to binding at the active agonist site, it has been proposed that salmeterol also binds with very high affinity at a second site, termed the "exosite", and that this exosite contributes to the long duration of action of salmeterol. To determine the position of the phenyl ring of the aralkyloxyalkyl side chain of salmeterol in the beta 2AR binding site, we designed and synthesized the agonist photoaffinity label [(125)I]iodoazidosalmeterol ([125I]IAS). In direct adenylyl cyclase activation, in effects on adenylyl cyclase after pretreatment of intact cells, and in guinea pig tracheal relaxation assays, IAS and the parent drug salmeterol behave essentially the same. Significantly, the photoreactive azide of IAS is positioned on the phenyl ring at the end of the molecule which is thought to be involved in exosite binding. Carrier-free radioiodinated [125I]IAS was used to photolabel epitope-tagged human beta 2AR in membranes prepared from stably transfected HEK 293 cells. Labeling with [(125)I]IAS was blocked by 10 microM (-)-alprenolol and inhibited by addition of GTP gamma S, and [125I]IAS migrated at the same position on an SDS-PAGE gel as the beta 2AR labeled by the antagonist photoaffinity label [125I]iodoazidobenzylpindolol ([125I]IABP). The labeled receptor was purified on a nickel affinity column and cleaved with factor Xa protease at a specific sequence in the large loop between transmembrane segments 5 and 6, yielding two peptides. While the control antagonist photoaffinity label [125I]IABP labeled both the large N-terminal fragment [containing transmembranes (TMs) 1-5] and the smaller C-terminal fragment (containing TMs 6 and 7), essentially all of the [125I]IAS labeling was on the smaller C-terminal peptide containing TMs 6 and 7. This direct biochemical evidence demonstrates that when salmeterol binds to the receptor, its hydrophobic aryloxyalkyl tail is positioned near TM 6 and/or TM 7. A model of IAS binding to the beta 2AR is proposed.
| PMID | Entity | Type | Start | End | Text |
|---|---|---|---|---|---|
| 10471277 | T1 | CHEMICAL | 135 | 145 | Salmeterol |
| 10471277 | T2 | CHEMICAL | 1248 | 1259 | [(125)I]IAS |
| 10471277 | T3 | CHEMICAL | 1285 | 1299 | (-)-alprenolol |
| 10471277 | T4 | CHEMICAL | 1329 | 1332 | GTP |
| 10471277 | T5 | CHEMICAL | 1346 | 1355 | [125I]IAS |
| 10471277 | T6 | CHEMICAL | 1467 | 1496 | [125I]iodoazidobenzylpindolol |
| 10471277 | T7 | CHEMICAL | 1498 | 1508 | [125I]IABP |
| 10471277 | T8 | CHEMICAL | 1550 | 1556 | nickel |
| 10471277 | T9 | CHEMICAL | 1762 | 1772 | [125I]IABP |
| 10471277 | T10 | CHEMICAL | 1796 | 1797 | N |
| 10471277 | T11 | CHEMICAL | 1870 | 1871 | C |
| 10471277 | T12 | CHEMICAL | 1939 | 1948 | [125I]IAS |
| 10471277 | T13 | CHEMICAL | 318 | 328 | salmeterol |
| 10471277 | T14 | CHEMICAL | 1977 | 1978 | C |
| 10471277 | T15 | CHEMICAL | 2076 | 2086 | salmeterol |
| 10471277 | T16 | CHEMICAL | 2126 | 2138 | aryloxyalkyl |
| 10471277 | T17 | CHEMICAL | 2192 | 2195 | IAS |
| 10471277 | T18 | CHEMICAL | 472 | 482 | salmeterol |
| 10471277 | T19 | CHEMICAL | 517 | 523 | phenyl |
| 10471277 | T20 | CHEMICAL | 566 | 576 | salmeterol |
| 10471277 | T21 | CHEMICAL | 667 | 694 | [(125)I]iodoazidosalmeterol |
| 10471277 | T22 | CHEMICAL | 696 | 705 | [125I]IAS |
| 10471277 | T23 | CHEMICAL | 718 | 726 | adenylyl |
| 10471277 | T24 | CHEMICAL | 761 | 769 | adenylyl |
| 10471277 | T25 | CHEMICAL | 860 | 863 | IAS |
| 10471277 | T26 | CHEMICAL | 884 | 894 | salmeterol |
| 10471277 | T27 | CHEMICAL | 957 | 962 | azide |
| 10471277 | T28 | CHEMICAL | 966 | 969 | IAS |
| 10471277 | T29 | CHEMICAL | 991 | 997 | phenyl |
| 10471277 | T30 | CHEMICAL | 1110 | 1119 | [125I]IAS |
| 10471277 | T31 | CHEMICAL | 106 | 133 | [(125)I]iodoazidosalmeterol |
| 10471277 | T33 | GENE-N | 1158 | 1172 | human beta 2AR |
| 10471277 | T34 | GENE-N | 1412 | 1420 | beta 2AR |
| 10471277 | T35 | GENE-N | 1590 | 1599 | factor Xa |
| 10471277 | T36 | GENE-N | 2211 | 2219 | beta 2AR |
| 10471277 | T37 | GENE-N | 163 | 188 | beta2-adrenergic receptor |
| 10471277 | T38 | GENE-N | 584 | 592 | beta 2AR |
| 10471277 | T39 | GENE-N | 190 | 198 | beta 2AR |
| 10471277 | T40 | GENE-N | 43 | 69 | beta 2-adrenergic receptor |
| 10471277 | T32 | CHEMICAL | 12 | 22 | salmeterol |
| 10471277 | T41 | CHEMICAL | 536 | 551 | aralkyloxyalkyl |
| 10471277 | T42 | GENE-Y | 718 | 734 | adenylyl cyclase |
| 10471277 | T44 | GENE-Y | 761 | 777 | adenylyl cyclase |
| PMID | CPR Group | Evaluation Type | CPR | Arg1 | Arg2 |
|---|---|---|---|---|---|
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T30 | Arg2:T33 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T31 | Arg2:T40 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T32 | Arg2:T40 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T20 | Arg2:T38 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T41 | Arg2:T38 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T19 | Arg2:T38 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Y | AGONIST | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T25 | Arg2:T42 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T26 | Arg2:T42 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T25 | Arg2:T44 |
| 10471277 | CPR:3 | Y | UPREGULATOR | Arg1:T26 | Arg2:T44 |
| 10471277 | CPR:6 | Y | ANTAGONIST | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Y | ANTAGONIST | Arg1:T7 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T5 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T2 | Arg2:T34 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T17 | Arg2:T36 |
| 10471277 | CPR:2 | N | DIRECT-REGULATOR | Arg1:T3 | Arg2:T34 |
| PMID | CPR Group | Arg1 | Arg2 |
|---|---|---|---|
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:5 | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:3 | Arg1:T25 | Arg2:T42 |
| 10471277 | CPR:3 | Arg1:T26 | Arg2:T42 |
| 10471277 | CPR:3 | Arg1:T25 | Arg2:T44 |
| 10471277 | CPR:3 | Arg1:T26 | Arg2:T44 |
| 10471277 | CPR:6 | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Arg1:T7 | Arg2:T34 |
| PMID | CPR Group | Arg1 | Arg2 |
|---|---|---|---|
| 10471277 | CPR:5 | Arg1:T17 | Arg2:T36 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T37 |
| 10471277 | CPR:5 | Arg1:T1 | Arg2:T39 |
| 10471277 | CPR:5 | Arg1:T20 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T21 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T22 | Arg2:T38 |
| 10471277 | CPR:5 | Arg1:T31 | Arg2:T40 |
| 10471277 | CPR:5 | Arg1:T32 | Arg2:T40 |
| 10471277 | CPR:6 | Arg1:T6 | Arg2:T34 |
| 10471277 | CPR:6 | Arg1:T7 | Arg2:T34 |

BLUE, the Biomedical Language Understanding Evaluation benchmark
Model file of scibert_scivocab_uncased:
wget "https://s3-us-west-2.amazonaws.com/ai2-s2-research/scibert/pytorch_models/scibert_scivocab_uncased.tar"
23 commits
Jupyter Notebook
82.8%
Python
17.2%