Eleusis-12B ExLlamaV2

This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model. The main branch only contains the measurement.json file, to produce your own quants of the model with a different bpw. You can find the pre-quanted checkpoints in the following branches:

• 3.0bpw
• 4.0bpw
• 5.0bpw
• 6.0bpw
• 7.0bpw
• 8.0bpw