Public leaderboard for UncensorBench - a benchmark for measuring LLM censorship removal effectiveness.
This leaderboard tracks model performance on the UncensorBench benchmark, which evaluates how well models respond to prompts that typically trigger refusal behaviors.
Install the package and run the benchmark:
pip install uncensorbench
from uncensorbench import UncensorBench, SemanticEvaluator, Leaderboard
# Run benchmark on your model
bench = UncensorBench()
evaluator = SemanticEvaluator()
# ... generate responses and evaluate ...
# Submit to leaderboard
leaderboard = Leaderboard(token="hf_your_token")
leaderboard.submit({
"model": "your-model-name",
"uncensored_rate": 0.15,
"avg_compliance_score": 0.23,
"total_prompts": 150,
})
Or use the provided notebook: establish_baseline.ipynb
This benchmark is for research purposes only. Results should be interpreted in the context of AI safety research.
21 commits
Public leaderboard for UncensorBench - a benchmark for measuring LLM censorship removal effectiveness.
This leaderboard tracks model performance on the UncensorBench benchmark, which evaluates how well models respond to prompts that typically trigger refusal behaviors.
Install the package and run the benchmark:
pip install uncensorbench
from uncensorbench import UncensorBench, SemanticEvaluator, Leaderboard
# Run benchmark on your model
bench = UncensorBench()
evaluator = SemanticEvaluator()
# ... generate responses and evaluate ...
# Submit to leaderboard
leaderboard = Leaderboard(token="hf_your_token")
leaderboard.submit({
"model": "your-model-name",
"uncensored_rate": 0.15,
"avg_compliance_score": 0.23,
"total_prompts": 150,
})
Or use the provided notebook: establish_baseline.ipynb
This benchmark is for research purposes only. Results should be interpreted in the context of AI safety research.
21 commits