The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
13
stars
5
commits
Jupyter Notebook
primary language
Apr 10, 2024
updated
README
The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
The code is based on Wang et al.; I fixed some bugs, made it more efficient for inference, and enabled model-parallel to support multi-GPUs.
Just run the jupyter notebook.
Contributors
5 commits
Similar repos
Languages
Jupyter Notebook
96.4%
Python
3.6%
The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
13
stars
5
commits
Jupyter Notebook
primary language
Apr 10, 2024
updated
README
The code for paper Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
The code is based on Wang et al.; I fixed some bugs, made it more efficient for inference, and enabled model-parallel to support multi-GPUs.
Just run the jupyter notebook.
Similar repos
Contributors
5 commits
Languages
Jupyter Notebook
96.4%
Python
3.6%