wxjiao/alpaca-7b

Model

15

stars

18

commits

4

repos using this model

3

linked in READMEs

Apr 6, 2023

updated

endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers

README

This repo contains an in-house tuned LLaMA-7b based on the Stanford Alpaca dataset, for only research use.

Quantitative evaluation on machine translation and qualitative comparison on general abilities can be found at alpaca-mt.

Translation Performance of LLMs on Flores Subsets.
DirectionDe-EnEn-DeZh-EnEn-Zh
MetricBLEUCOMETBLEUCOMETBLEUCOMETBLEUCOMET
Google45.040.887941.160.886131.660.877143.580.8842
DeepL49.230.897041.460.890331.220.873944.310.8811
ChatGPT43.710.891038.870.881424.730.858138.270.8699
GPT-446.000.893145.730.892828.500.874242.500.8840
LLaMA-7b6.960.65483.640.50848.950.63400.100.4899
Alpaca-7b36.000.873720.090.800314.370.806910.060.5604

Contributors

wxjiao

18 commits

wxjiao/alpaca-7b

Model

15

stars

18

commits

4

repos using this model

3

linked in READMEs

Apr 6, 2023

updated

endpoints_compatible
llama
pytorch
text-generation
text-generation-inference
transformers

README

This repo contains an in-house tuned LLaMA-7b based on the Stanford Alpaca dataset, for only research use.

Quantitative evaluation on machine translation and qualitative comparison on general abilities can be found at alpaca-mt.

Translation Performance of LLMs on Flores Subsets.
DirectionDe-EnEn-DeZh-EnEn-Zh
MetricBLEUCOMETBLEUCOMETBLEUCOMETBLEUCOMET
Google45.040.887941.160.886131.660.877143.580.8842
DeepL49.230.897041.460.890331.220.873944.310.8811
ChatGPT43.710.891038.870.881424.730.858138.270.8699
GPT-446.000.893145.730.892828.500.874242.500.8840
LLaMA-7b6.960.65483.640.50848.950.63400.100.4899
Alpaca-7b36.000.873720.090.800314.370.806910.060.5604

Contributors

wxjiao

18 commits