songtao-x/vlora

This is a project of integrating VAE into LORA for asymmetrical training to embed some knowledge to models

0

stars

7

commits

Makefile

primary language

Dec 6, 2024

updated

README

VAE_LORA

vlora/finetune.py --- training code.

vlora/Custom.py --- Custom llama model definition containing most of changed code.

vlora/vlora.py --- VloraLayer definition.

Contributors

songtao-x

7 commits

songtao-x/vlora

This is a project of integrating VAE into LORA for asymmetrical training to embed some knowledge to models

0

stars

7

commits

Makefile

primary language

Dec 6, 2024

updated

README

VAE_LORA

vlora/finetune.py --- training code.

vlora/Custom.py --- Custom llama model definition containing most of changed code.

vlora/vlora.py --- VloraLayer definition.

Contributors

songtao-x

7 commits

Languages

Makefile

68.6%

Python

22.8%

CMake

5.1%

C

1.4%

C++

1.4%