pip install requirements.txt
accelerate launch --config_file config/acclerate/accelerate_config_zero2.yaml trainer/trainer_stage1.py -c config/stage1.json
accelerate launch --config_file config/acclerate/accelerate_config_zero2.yaml trainer/trainer_stage2.py -c config/stage2.json
more details please check code, just an example for personal experiment.
2 commits
Python
100.0%
pip install requirements.txt
accelerate launch --config_file config/acclerate/accelerate_config_zero2.yaml trainer/trainer_stage1.py -c config/stage1.json
accelerate launch --config_file config/acclerate/accelerate_config_zero2.yaml trainer/trainer_stage2.py -c config/stage2.json
more details please check code, just an example for personal experiment.
2 commits
Python
100.0%