PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

Model

stars

commits

linked in READMEs

Feb 2, 2024

updated

endpoints_compatible

gguf

relullama

transformers

Browse cluster: Sparse LLaMA Model Variants →

README

ReluLLaMA-70B-PowerInfer-GGUF

Original model: SparseLLM/ReluLLaMA-70B
Converted & distributed by: PowerInfer

This model is the downstream distribution of SparseLLM/ReluLLaMA-70B in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

Contributors

syx

7 commits

hodlen

1 commits

Yixin Song

1 commits

Similar repos

PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

Model

shared topics

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

Model

PowerInfer/ReluLLaMA-7B-Predictor

Model

PowerInfer/prosparse-llama-2-7b-gguf

Model

PowerInfer/prosparse-llama-2-13b-gguf

Model

PowerInfer/ReluLLaMA-13B-Predictor

Model

SparseLLM/ReluLLaMA-70B

Model

PowerInfer/ReluFalcon-40B-Predictor

Model

Linked in READMEs

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,788

README badge