ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models (ICLR 2025)
3
19 commits
2 linked in READMEs
updated Mar 17, 2025
README
ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models (ICLR 2025)
Check the paper's webpage and GitHub for more info!
The ClimaQA benchmark is designed to evaluate Large Language Models (LLMs) on climate science question-answering tasks by ensuring scientific rigor and complexity. It is built from graduate-level climate science textbooks, which provide a reliable foundation for generating questions with precise terminology and complex scientific theories. The benchmark consists of two datasets: ClimaQA-Gold, an expert-validated set, and ClimaQA-Silver, a large-scale synthetic dataset.
Paper: ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models
Similar repos
Linked in READMEs
ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models (ICLR 2025)
3
19 commits
2 linked in READMEs
updated Mar 17, 2025
README
ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models (ICLR 2025)
Check the paper's webpage and GitHub for more info!
The ClimaQA benchmark is designed to evaluate Large Language Models (LLMs) on climate science question-answering tasks by ensuring scientific rigor and complexity. It is built from graduate-level climate science textbooks, which provide a reliable foundation for generating questions with precise terminology and complex scientific theories. The benchmark consists of two datasets: ClimaQA-Gold, an expert-validated set, and ClimaQA-Silver, a large-scale synthetic dataset.
Paper: ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models