Shadowgraph
TrendingBuzzAbout
Sign in

radi-cho/Meta-Llama-3.1-70B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

5 commits

1 linked in READMEs

updated Aug 4, 2024

See the code

README

WikiC4
W4G644.159.18
W3G644.749.48

Revisions available in this repository:

  • main (W4G64, scales learned);
  • nfl_w3g64 (W3G64, scales learned);

Evaluations are provided for models with learned scales.
Check the base Meta-Llama-3.1-70B-FLUTE for lm-eval-harness benchmarks.

llama
safetensors

Similar repos

radi-cho/Meta-Llama-3.1-8B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

radi-cho/Meta-Llama-3-70B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

radi-cho/Meta-Llama-3-8B-Instruct-FLUTE

Model

| | Wiki | C4 |

0

radi-cho/Meta-Llama-3.1-70B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3-70B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3.1-8B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3-8B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3.1-405B-Instruct-FLUTE

Model

Revisions available in this repository:

0

Linked in READMEs

HanGuo97/flute

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

395

README badge

radi-cho/Meta-Llama-3.1-70B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

5 commits

1 linked in READMEs

updated Aug 4, 2024

See the code

README

WikiC4
W4G644.159.18
W3G644.749.48

Revisions available in this repository:

  • main (W4G64, scales learned);
  • nfl_w3g64 (W3G64, scales learned);

Evaluations are provided for models with learned scales.
Check the base Meta-Llama-3.1-70B-FLUTE for lm-eval-harness benchmarks.

llama
safetensors

Similar repos

radi-cho/Meta-Llama-3.1-8B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

radi-cho/Meta-Llama-3-70B-Instruct-FLUTE

Model

| | Wiki | C4 |

1

radi-cho/Meta-Llama-3-8B-Instruct-FLUTE

Model

| | Wiki | C4 |

0

radi-cho/Meta-Llama-3.1-70B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3-70B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3.1-8B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3-8B-FLUTE

Model

| | Wiki | C4 | PIQA | ARC-E | ARC-C | HellaSwag | Wino | Avg. |

0

radi-cho/Meta-Llama-3.1-405B-Instruct-FLUTE

Model

Revisions available in this repository:

0

Linked in READMEs

HanGuo97/flute

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

395

README badge