PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

Model

stars

commits

linked in READMEs

Dec 26, 2023

updated

endpoints_compatible

gguf

llama

transformers

Browse cluster: Sparse LLaMA Model Variants →

README

ReluLLaMA-7B-PowerInfer-GGUF

Original model: SparseLLM/ReluLLaMA-7B
Converted & distributed by: PowerInfer

This model is the downstream distribution of SparseLLM/ReluLLaMA-7B in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

Contributors

syx

5 commits

hodlen

1 commits

Yixin Song

1 commits

Similar repos

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

Model

PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

Model

PowerInfer/ReluLLaMA-7B-Predictor

Model

PowerInfer/prosparse-llama-2-7b-gguf

Model

PowerInfer/prosparse-llama-2-13b-gguf

Model

PowerInfer/ReluLLaMA-13B-Predictor

Model

SparseLLM/ReluLLaMA-7B

Model

PowerInfer/ReluFalcon-40B-Predictor

Model

Linked in READMEs

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,788

README badge