phanxuanphucnd/LLMs-SFT-DPO

Python

1

1 commits

updated Mar 1, 2024

See the code

README

Table of Contents

Structure Folders

  • data: Folder chứa data
    • data/testset: Folder chứa data test
  • models: Folder lưu trữ model sau khi fine-tuning (adapter)
  • src: Folder chứa code
  • storages: Folder lưu trữ model sử dụng để inference

Training

bash sft_run.sh

Inference

python inference.py