xu1998hz/InstructScore

Model

InstructScore (SEScore3)

9

8 commits

2 linked in READMEs

updated May 24, 2023

See the code

README

InstructScore (SEScore3)

An amazing explanation metric (diagnostic report) for text generation evaluation

First step, you may download all required dependencies through: pip3 install -r requirements.txt

To run our metric, you only need five lines

Please visit our github: https://github.com/xu1998hz/SEScore3/

```
from InstructScore import *
refs = ["Normally the administration office downstairs would call me when there’s a delivery."]
outs = ["Usually when there is takeaway, the management office downstairs will call."]
scorer = InstructScore()
batch_outputs, scores_ls = scorer.score(refs, outs)
```
endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers

xu1998hz/InstructScore

Model

InstructScore (SEScore3)

9

8 commits

2 linked in READMEs

updated May 24, 2023

See the code

README

InstructScore (SEScore3)

An amazing explanation metric (diagnostic report) for text generation evaluation

First step, you may download all required dependencies through: pip3 install -r requirements.txt

To run our metric, you only need five lines

Please visit our github: https://github.com/xu1998hz/SEScore3/

```
from InstructScore import *
refs = ["Normally the administration office downstairs would call me when there’s a delivery."]
outs = ["Usually when there is takeaway, the management office downstairs will call."]
scorer = InstructScore()
batch_outputs, scores_ls = scorer.score(refs, outs)
```
endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers