Installation

• for cuda 11.8

conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu118
pip install -r requirements.txt

• for cuda 12.1

conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
pip install -r requirements.txt

Start Hugging Face UI

python app.py

Start Log server

uvicorn serve.log_server:app --reload --port 22005 --host 0.0.0.0

Update leaderboard

cd arena_elo && bash update_leaderboard.sh

Paper: arxiv.org/abs/2406.04485