samwit/alpaca7B-lora

Model

This is a fine-tuning of the LLaMa7B model in the style of the Alpaca dataset and setting but using LoRa.

8

3 commits

1 linked in READMEs

updated Mar 15, 2023

See the code

README

This is a fine-tuning of the LLaMa7B model in the style of the Alpaca dataset and setting but using LoRa.

For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html

This repo only contains the LoRa weights and not the original LLaMa weights which are research only.

Contributors

samwit

3 commits

samwit/alpaca7B-lora

Model

This is a fine-tuning of the LLaMa7B model in the style of the Alpaca dataset and setting but using LoRa.

8

3 commits

1 linked in READMEs

updated Mar 15, 2023

See the code

README

This is a fine-tuning of the LLaMa7B model in the style of the Alpaca dataset and setting but using LoRa.

For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html

This repo only contains the LoRa weights and not the original LLaMa weights which are research only.

Contributors

samwit

3 commits