CPU MatmulFree LLM
If you like our project, please give us a star ⭐ on GitHub for the latest updates.
Run:
git clone https://github.com/MengAiDev/MatmulFree-cpu
cd MatmulFree-cpu
pip install -e .
python generate.py
You can use the generate.py script to generate text with the pre-trained models. The script supports various command-line arguments to customize the generation process. Change name variable in generate.py to use different models.
This project is licensed under the MIT License. See the LICENSE file for details. Part of the code is used from MatmulFree
@article{zhu2024scalable,
title={Scalable MatMul-free Language Modeling},
author={Zhu, Rui-Jie and Zhang, Yu and Sifferman, Ethan and Sheaves, Tyler and Wang, Yiqiao and Richmond, Dustin and Zhou, Peng and Eshraghian, Jason K},
journal={arXiv preprint arXiv:2406.02528},
year={2024}
}
CPU MatmulFree LLM
If you like our project, please give us a star ⭐ on GitHub for the latest updates.
Run:
git clone https://github.com/MengAiDev/MatmulFree-cpu
cd MatmulFree-cpu
pip install -e .
python generate.py
You can use the generate.py script to generate text with the pre-trained models. The script supports various command-line arguments to customize the generation process. Change name variable in generate.py to use different models.
This project is licensed under the MIT License. See the LICENSE file for details. Part of the code is used from MatmulFree
@article{zhu2024scalable,
title={Scalable MatMul-free Language Modeling},
author={Zhu, Rui-Jie and Zhang, Yu and Sifferman, Ethan and Sheaves, Tyler and Wang, Yiqiao and Richmond, Dustin and Zhou, Peng and Eshraghian, Jason K},
journal={arXiv preprint arXiv:2406.02528},
year={2024}
}