Instruct-tune LLaMA on consumer hardware
Jupyter Notebook
71
117 commits
updated Jun 3, 2023
README
Guanaco-lora: LoRA for trainin Multilingual Instruction-following LM based on LLaMA
- 🤗 Try the pretrained model out here
This repository is forked from alpaca-lora, and introduce a method to train more modules like embed/head with lora.
with trained embed and head, you can get better result on multilang performance.
Dataset
We use cleaned version alpaca from alpaca-lora and whole guanaco dataset to train the pretrained model.
guanaco dataset: link
Usage
basically as same as alpaca lora
Example
Some example of instruction-based QA and instruction-based chat
Resource
Todo...
Contributors
Similar repos
Languages
Jupyter Notebook
74.0%
Python
26.0%
Instruct-tune LLaMA on consumer hardware
Jupyter Notebook
71
117 commits
updated Jun 3, 2023
README
Guanaco-lora: LoRA for trainin Multilingual Instruction-following LM based on LLaMA
- 🤗 Try the pretrained model out here
This repository is forked from alpaca-lora, and introduce a method to train more modules like embed/head with lora.
with trained embed and head, you can get better result on multilang performance.
Dataset
We use cleaned version alpaca from alpaca-lora and whole guanaco dataset to train the pretrained model.
guanaco dataset: link
Usage
basically as same as alpaca lora
Example
Some example of instruction-based QA and instruction-based chat
Resource
Todo...
Similar repos
Contributors
Languages
Jupyter Notebook
74.0%
Python
26.0%