ThunderAgent-org/ThunderAgent

A simple, fast and robust program-aware agentic inference system.

eldahl/VisioPetrae

A proof-of-concept system for scaleable deployment of VLM inference.

GeorgePearse/optillm-rs

A rust optillm port, for use with just-ever/code (or at least my fork of it)

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference

smartcomputer-ai/lightspeed

Deterministic agent harness for Temporal (in Rust)

0xplaygrounds/rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

THUDM/slime

slime is an LLM post-training framework for RL Scaling.