hazyresearch/my-awesome-model

Model

Based model but uses layernorm instead of QK.sum(-1) for the normalization, for better hardware efficiency.

2

stars

6

commits

1

linked in READMEs

Oct 18, 2024

updated

gpt2
pytorch

README

Based model but uses layernorm instead of QK.sum(-1) for the normalization, for better hardware efficiency.

Contributors

simarora

6 commits

hazyresearch/my-awesome-model

Model

Based model but uses layernorm instead of QK.sum(-1) for the normalization, for better hardware efficiency.

2

stars

6

commits

1

linked in READMEs

Oct 18, 2024

updated

gpt2
pytorch

README

Based model but uses layernorm instead of QK.sum(-1) for the normalization, for better hardware efficiency.

Contributors

simarora

6 commits