PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

Model

stars

commits

linked in READMEs

Dec 26, 2023

updated

endpoints_compatible

gguf

relullama

transformers

Browse cluster: Sparse LLaMA Model Variants →

README

ReluLLaMA-13B-PowerInfer-GGUF

Original model: SparseLLM/ReluLLaMA-13B
Converted & distributed by: PowerInfer

This model is the downstream distribution of SparseLLM/ReluLLaMA-13B in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

Contributors

syx

5 commits

hodlen

2 commits

Yixin Song

1 commits

Similar repos

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

Model

shared topics

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

Model

PowerInfer/ReluLLaMA-13B-Predictor

Model

PowerInfer/prosparse-llama-2-13b-gguf

Model

PowerInfer/ReluLLaMA-7B-Predictor

Model

PowerInfer/prosparse-llama-2-7b-gguf

Model

PowerInfer/ReluFalcon-40B-Predictor

Model

mys/ggml_llava-v1.5-13b

Model

Linked in READMEs

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,788

README badge