RAD-Bench

RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialogues

Tzu-Lin Kuo*, Feng-Ting Liao*, Mu-Wei Hsieh, Fu-Chieh Chang, Po-Chun Hsu, Da-Shan Shiu

*core contributors

This is the official repo of the RAD-Bench.

Benchmark results

Installation

pip install -r requirements.txt

Inference

Simply do,

cd rad_bench/script
sh run_inference.sh

Evaluation

Simply do,

cd rad_bench/script
sh run_evaluation.sh

Visulization

To see the results, do

cd rad_bench/script
sh run_qa_browser.sh

then open localhost:1234 in your browser

Citation

Please cite this repo with

@misc{rad-kuo2024,
      title={RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval
Augmented Dialogues},
      author={Tzu-Lin Kuo, Feng-Ting Liao, Mu-Wei Hsieh, Fu-Chieh Chang, Po-Chun Hsu, Da-Shan Shiu},
      year={2024}
}