ONNX Model Optimization and Inference
20 repos
Tools and frameworks for optimizing, quantizing, and deploying machine learning models using ONNX format and ONNX Runtime. The cluster focuses on making models smaller, faster, and more portable—particularly for edge inference and resource-constrained environments. Key themes include model compression, format conversion (especially GGUF and llama.cpp integration), and runtime optimization across different platforms.
Python · 3
JavaScript · 2
C# · 1
C++ · 1
Jupyter Notebook · 1
Rust · 1
onnxruntime ·15,247
onnx ·15,247
speech ·10,268
onnx-runtime ·10,264
pytorch ·10,264
speech-processing ·10,243
vad ·10,243
voice-activity-detection ·10,243
voice-commands ·10,243
voice-control ·10,243
