6 repos
KushagraKanaujia/throttle
Safe, local benchmarking for OpenAI-compatible inference endpoints
7
49 commits
eugr/llama-benchy
llama-benchy - llama-bench style benchmarking tool for all backends
719
108 commits
fw-ai/benchmark
Benchmark suite for LLMs from Fireworks.ai
116
111 commits
ray-project/llmperf
LLMPerf is a library for validating and benchmarking LLMs
1,124
35 commits
Applied-Compute/trie
Lightweight harness for replaying inference traffic against an endpoint
28
19 commits
OpenCSGs/llm-inference
llm-inference is a platform for publishing and managing llm inference, providing a wide range of…
97
116 commits
