danfu09/m2-bert-110M

Model

Monarch Mixer-BERT

3

4 commits

1 linked in READMEs

updated Oct 21, 2023

README

Monarch Mixer-BERT

The 110M checkpoint for M2-BERT-base from the paper Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture.

Check out our GitHub for instructions on how to download and fine-tune it!

text-classification

Contributors

DF

2 commits

2 commits

Similar repos

danfu09/m2-bert-260m

Monarch Mixer-BERT

1

danfu09/m2-bert-341m

Monarch Mixer-BERT

4

danfu09/m2-bert-80M

Monarch Mixer-BERT

4

HazyResearch/m2

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

563

zhouyik/MMVMBench

0

togethercomputer/m2-bert-80M-2k-retrieval

Monarch Mixer-BERT

15

togethercomputer/m2-bert-80M-32k-retrieval

Monarch Mixer-BERT

131

togethercomputer/m2-bert-80M-8k-retrieval

Monarch Mixer-BERT

33

Linked in READMEs

HazyResearch/m2

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

563

danfu09/m2-bert-110M

Model

Monarch Mixer-BERT

3

4 commits

1 linked in READMEs

updated Oct 21, 2023

README

Monarch Mixer-BERT

The 110M checkpoint for M2-BERT-base from the paper Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture.

Check out our GitHub for instructions on how to download and fine-tune it!

text-classification

Similar repos

danfu09/m2-bert-260m

Monarch Mixer-BERT

1

danfu09/m2-bert-341m

Monarch Mixer-BERT

4

danfu09/m2-bert-80M

Monarch Mixer-BERT

4

HazyResearch/m2

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

563

zhouyik/MMVMBench

0

togethercomputer/m2-bert-80M-2k-retrieval

Monarch Mixer-BERT

15

togethercomputer/m2-bert-80M-32k-retrieval

Monarch Mixer-BERT

131

togethercomputer/m2-bert-80M-8k-retrieval

Monarch Mixer-BERT

33

Linked in READMEs

HazyResearch/m2

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

563

Contributors

DF

2 commits

2 commits