hazyresearch/lolcats-llama-3.1-8b-distill

Model

This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.

8 commits

1 linked in READMEs

updated Nov 24, 2024

See the code

README

This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.

Details on this model and how to train your own are provided at: https://github.com/HazyResearch/lolcats/tree/lolcats-scaled

Demo

Here is a quick GitHub GIST that will help you run inference on the model checkpoints.

Paper

See the paper page: https://huggingface.co/papers/2410.10254

text-generation

Contributors

simarora

6 commits

ariG23498

1 commits

nielsr

1 commits

Similar repos

GSAI-ML/LLaDA-8B-Instruct

Model

LLaDA-8B-Instruct

364

GSAI-ML/LLaDA-8B-Base

Model

LLaDA-8B-Base

102

sail/longspec-Llama-3-8B-Instruct-262k

Model

This repository contains the LongSpec model described in [LongSpec: Long-Context Lossless…

JiaxinGe/llama-3.1-8b-autopresent_high_level

Model

Uploaded model

JiaxinGe/llama-3.1-8b-autopresent_detailed_instruction

Model

Uploaded model

GeneZC/MiniLoong-3B

Model

MiniLoong-3B

AILab-CVC/seed-llama-8b-sft

Model

P01son/Linly-Chinese-LLaMA-33b-hf

Model

Hot to use: https://github.com/ydli-ai/Chinese-ChatLLaMA

Linked in READMEs

HazyResearch/lolcats

Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"

262

README badge

hazyresearch/lolcats-llama-3.1-8b-distill

Model

This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.

8 commits

1 linked in READMEs

updated Nov 24, 2024

See the code

README

This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.

Details on this model and how to train your own are provided at: https://github.com/HazyResearch/lolcats/tree/lolcats-scaled

Demo

Here is a quick GitHub GIST that will help you run inference on the model checkpoints.

Paper

See the paper page: https://huggingface.co/papers/2410.10254

text-generation

Similar repos

GSAI-ML/LLaDA-8B-Instruct

Model

LLaDA-8B-Instruct

364

GSAI-ML/LLaDA-8B-Base

Model

LLaDA-8B-Base

102

sail/longspec-Llama-3-8B-Instruct-262k

Model

This repository contains the LongSpec model described in [LongSpec: Long-Context Lossless…

JiaxinGe/llama-3.1-8b-autopresent_high_level

Model

Uploaded model

JiaxinGe/llama-3.1-8b-autopresent_detailed_instruction

Model

Uploaded model

GeneZC/MiniLoong-3B

Model

MiniLoong-3B

AILab-CVC/seed-llama-8b-sft

Model

P01son/Linly-Chinese-LLaMA-33b-hf

Model

Hot to use: https://github.com/ydli-ai/Chinese-ChatLLaMA

Linked in READMEs

HazyResearch/lolcats

Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"

262

README badge

Contributors

simarora

6 commits

ariG23498

1 commits

nielsr

1 commits