LTX-2-MLX

Native Apple Silicon implementation of Lightricks LTX-2 video generation models using MLX. Supports both LTX-2.0 (19B) and LTX-2.3 (22B) with automatic version detection.

768×512, 65 frames (~2.7s at 24fps), 8 steps on Apple Silicon

Quick Start

# 1. Install uv
curl -LsSf https://astral.sh/uv/install.sh | sh

# 2. Download weights
uv run scripts/download_weights.py

# 3. Generate video (auto-detects model version)
uv run python scripts/generate.py "A golden retriever running through a meadow"

# Or specify the 2.3 checkpoint explicitly
uv run python scripts/generate.py --weights weights/ltx-2.3/ltx-2.3-22b-distilled.safetensors \
  "A golden retriever running through a meadow"

Required Models

LTX-2.3 (Recommended)

Download from Lightricks/LTX-2 on HuggingFace:

LTX-2.0

Text Encoder: Gemma 3 12B (~25GB) - Requires accepting license

Or use the interactive downloader:

uv run scripts/download_weights.py --weights all

Available Pipelines

# Fast preview
python scripts/generate.py "Your prompt" --pipeline distilled

# High quality
python scripts/generate.py "Your prompt" --pipeline one-stage --steps 20 --cfg 5.0

# High resolution
python scripts/generate.py "Your prompt" --pipeline two-stage --height 768 --width 1024

See Pipelines Guide for all 6 pipelines and options.

Optimization Tips

• Use --fp16 - Reduces memory ~50% (enabled by default)
• Use --pipeline distilled - Fastest inference (8 steps)
• Use --low-memory - For systems with <32GB RAM
• Reduce resolution - Start with --height 256 --width 384 for testing

See Usage Guide for memory requirements and benchmarks.

Prompting Tips

Focus on detailed, chronological descriptions. Include movements, appearances, camera angles, and environment details in a flowing paragraph. Keep under 200 words.

Structure your prompts:

1. Main action in a single sentence
2. Specific movements and gestures
3. Character/object appearances
4. Background and environment
5. Camera angles and movements
6. Lighting and colors

See Lightricks prompting guide for more tips.

Requirements

• macOS with Apple Silicon (M1/M2/M3/M4)
• ~25GB RAM (128GB recommended for high resolution)
• ffmpeg: brew install ffmpeg

Documentation

• Usage Guide - Options, examples, troubleshooting
• Pipelines - All 6 pipelines explained
• Architecture - Model architecture details
• Parity Testing - PyTorch/MLX verification (97%+ correlation)
• Technical Report - Official Lightricks paper

License

Research and educational use. See LTX-2 for model licensing.

Acknowledgments

• Lightricks for LTX-2
• Apple MLX Team for MLX
• Google for Gemma 3