PO

PowerInfer/ReluLLaMA-7B-Predictor

Model

5

stars

4

commits

1

linked in READMEs

Dec 18, 2023

updated

PowerInfer

Browse cluster: Sparse LLaMA Model Variants →

README

ReluLLaMA-7B-Predictor

Model creator: PowerInfer

This repository provides a group of sparsity predictors serving for SparseLLM/ReluLLaMA-7B.

Contributors

2 commits

HO

1 commits

YS

1 commits

Similar repos

PowerInfer/ReluLLaMA-13B-Predictor

0

PowerInfer/ReluFalcon-40B-Predictor

0

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

15

PowerInfer/prosparse-llama-2-7b-predictor

0

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

9

PowerInfer/prosparse-llama-2-13b-predictor

0

PowerInfer/prosparse-llama-2-7b-gguf

2

PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

2

Linked in READMEs

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,788

PO

PowerInfer/ReluLLaMA-7B-Predictor

Model

5

stars

4

commits

1

linked in READMEs

Dec 18, 2023

updated

PowerInfer

Browse cluster: Sparse LLaMA Model Variants →

README

ReluLLaMA-7B-Predictor

Model creator: PowerInfer

This repository provides a group of sparsity predictors serving for SparseLLM/ReluLLaMA-7B.

Similar repos

PowerInfer/ReluLLaMA-13B-Predictor

0

PowerInfer/ReluFalcon-40B-Predictor

0

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

15

PowerInfer/prosparse-llama-2-7b-predictor

0

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

9

PowerInfer/prosparse-llama-2-13b-predictor

0

PowerInfer/prosparse-llama-2-7b-gguf

2

PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

2

Linked in READMEs

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,788

Contributors

2 commits

HO

1 commits

YS

1 commits