Cluster 451951

8 repos

Python · 6

C++ · 1

arm ·962

c ·962

cpp ·962

cuda-programming ·962

deep-learning ·962

edge-computing ·962

large-language-models ·962

on-device-ai ·962

quantization ·962

x86-64 ·962

Related clusters

Large Language Models and NLP16 Cluster 43765313 LLM Fine-tuning and Parameter-Efficient Adaptation23 Cluster 4486757 Cluster 4526229 Transformer Models & Fine-Tuning23

Louym/awq4nvomni

A temporary repo

Python

116 commits

mit-han-lab/llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and…

Python

3,633

116 commits

vimarsh244/llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and…

Python

116 commits

casper-hansen/AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.…

Python

2,348

546 commits

phunggiahuy159/awq-embed

No description

Python

9 commits

mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

C++

962

14 commits

SqueezeBits/QUICK

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Python

123

13 commits

Efficient-Large-Model/NVILA-AWQ

Model

No description

9 commits