hsaest/Llama-3.1-8B-Instruct-travelplanner-SFT

Model

| | Commonsense (Micro) | Commonsense (Macro) | Hard (Micro) | Hard (Macro) | Final Pass Rate |

5

7 commits

1 linked in READMEs

updated Dec 19, 2024

README

	Commonsense (Micro)	Commonsense (Macro)	Hard (Micro)	Hard (Macro)	Final Pass Rate
Direct Prompting
Llama3.1-8B	60.1	0.0	7.9	2.8	0.0
Qwen2-7B	49.9	1.1	2.1	0.0	0.0
Fine-tuning
Llama3.1-8B	78.3	17.8	19.3	6.1	3.8
Qwen2-7B	59.0	0.6	0.2	0.0	0.0

If our related resources prove valuable to your research, we kindly ask for a citation.

@article{xie2024revealing,
  title={Revealing the Barriers of Language Agents in Planning},
  author={Xie, Jian and Zhang, Kexun and Chen, Jiangjie and Yuan, Siyu and Zhang, Kai and Zhang, Yikai and Li, Lei and Xiao, Yanghua},
  journal={arXiv preprint arXiv:2410.12409},
  year={2024}
}

conversational

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Contributors

7 commits

Similar repos

hsaest/Qwen2-7B-Instruct-travelplanner-SFT

| | Commonsense (Micro) | Commonsense (Macro) | Hard (Micro) | Hard (Macro) | Final Pass Rate |

0

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!

112

Salesforce/xLAM-v0.1-r

License: cc-by-nc-4.0

55

unsloth/llama-3-8b-bnb-4bit

Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!

206

Qwen/Qwen3.8-2.4T-A95B

Qwen3.8-2.4T-A95B

1,257

UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3

Self-Play Preference Optimization for Language Model Alignment (https://arxiv.org/abs/2405.00675)

82

gradientai/Llama-3-8B-Instruct-262k

Llama-3 8B Gradient Instruct 262k

260

nebius/SWE-rebench-openhands-Qwen3-30B-A3B

Model Summary

12

Linked in READMEs

OSU-NLP-Group/TravelPlanner

[ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"

549

hsaest/Llama-3.1-8B-Instruct-travelplanner-SFT

Model

| | Commonsense (Micro) | Commonsense (Macro) | Hard (Micro) | Hard (Macro) | Final Pass Rate |

5

7 commits

1 linked in READMEs

updated Dec 19, 2024

README

	Commonsense (Micro)	Commonsense (Macro)	Hard (Micro)	Hard (Macro)	Final Pass Rate
Direct Prompting
Llama3.1-8B	60.1	0.0	7.9	2.8	0.0
Qwen2-7B	49.9	1.1	2.1	0.0	0.0
Fine-tuning
Llama3.1-8B	78.3	17.8	19.3	6.1	3.8
Qwen2-7B	59.0	0.6	0.2	0.0	0.0

If our related resources prove valuable to your research, we kindly ask for a citation.

@article{xie2024revealing,
  title={Revealing the Barriers of Language Agents in Planning},
  author={Xie, Jian and Zhang, Kexun and Chen, Jiangjie and Yuan, Siyu and Zhang, Kai and Zhang, Yikai and Li, Lei and Xiao, Yanghua},
  journal={arXiv preprint arXiv:2410.12409},
  year={2024}
}

conversational

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Similar repos

hsaest/Qwen2-7B-Instruct-travelplanner-SFT

| | Commonsense (Micro) | Commonsense (Macro) | Hard (Micro) | Hard (Macro) | Final Pass Rate |

0

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!

112

Salesforce/xLAM-v0.1-r

License: cc-by-nc-4.0

55

unsloth/llama-3-8b-bnb-4bit

Finetune Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!

206

Qwen/Qwen3.8-2.4T-A95B

Qwen3.8-2.4T-A95B

1,257

UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3

Self-Play Preference Optimization for Language Model Alignment (https://arxiv.org/abs/2405.00675)

82

gradientai/Llama-3-8B-Instruct-262k

Llama-3 8B Gradient Instruct 262k

260

nebius/SWE-rebench-openhands-Qwen3-30B-A3B

Model Summary

12

Linked in READMEs

OSU-NLP-Group/TravelPlanner

[ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"

549

Contributors

7 commits