🎯 English Phonemic Transcription Leaderboard

Welcome to the English Phonemic Transcription Leaderboard! This simple leaderboard helps track and compare the performance of different speech-to-phoneme models. Feel free to fork it for your own hugging face leaderboards!

✨ Features

• 📊 Interactive leaderboard with real-time sorting
• 🔄 Easy model submission system
• 📈 Automatic evaluation of submitted models
• 📱 Responsive design that works on all devices

🎯 What This Project Does

This leaderboard tracks two key metrics for phonemic transcription models:

• PER (Phoneme Error Rate): How accurately your model converts speech to phonemes
• FER (Feature Error Rate): A more nuanced metric that considers phonemic features

Read more about evaluations on our blog

Models are evaluated on a variety of English speech: native, non-native, and impaired.

🚀 Getting Started

Navigate to the hosted version on Hugging Face or follow the instructions in DEVELOPMENT.md to run the leaderboard locally.

🎮 Using the Leaderboard

Submitting a Model

1. Go to the "Submit Model" tab
2. Enter your model details:
   • Model ID (e.g., "my-name/wav2vec2-phoneme-wizard")
   • Submission name (e.g., "MyAwesomeModel v1.0")
   • GitHub/Kaggle/HuggingFace URL (optional)
3. Click Submit and watch your model climb the ranks! 🚀

Checking Model Status

1. Navigate to the "Model Status" tab
2. Enter your model ID or task ID
3. Get real-time updates on your model's evaluation progress

📊 Understanding the Results

The leaderboard shows:

• Model names and submission details
• PER and FER scores (lower is better!)
• Links to model repositories
• Submission dates

Sort by either metric to see who's leading the pack!

🛠️ Technical Details

• Built with Gradio for a smooth UI experience
• Runs on a basic compute plan (16GB RAM, 2vCPUs) for easy reproducibility
• Evaluation can take several hours - perfect time to grab a coffee ☕

🤝 Contributing

Want to make this leaderboard even better? We'd love your help! Here are some ways you can contribute:

• Add new evaluation metrics
• Improve the UI design
• Enhance documentation
• Submit bug fixes
• Add new features

Check out the CONTRIBUTING.md for more details.

📝 License

This project is licensed under the GNU Affero General Public License.

We retain all rights to the Koel Labs brand, logos, blog posts and website content.

🆘 Need Help?

Got questions? Found a bug? Want to contribute? Open an issue or reach out to us! We're here to help make speech recognition evaluation fun and accessible for everyone!

Remember: Every great model deserves its moment to shine! 🌟

---

Happy Transcribing! 🎤✨