1
stars
0
commits
linked in READMEs
Apr 1, 2024
updated
meta-llama/CodeLlama-7b-hf
128
relaxml/Llama-2-7b-E8PRVQ-4Bit
relaxml/Llama-2-7b-E8PRVQ-3Bit
relaxml/Llama-2-70b-E8PRVQ-4Bit
relaxml/Llama-2-7b-E8P-2Bit
relaxml/Llama-2-70b-E8PRVQ-3Bit
relaxml/Llama-2-70b-E8P-2Bit
3
relaxml/Llama-2-13b-E8PRVQ-4Bit
ainergy-ml/SDSAT
The official implementation of "SDSAT: Accelerating LLM Inference through Speculative Decoding with…
5