Video DeltaNet: Hybrid Attention to Speed Up Video Models with Near-Lossless Quality

[Code] [Weights] [License]

We release VDN-Minimax-H3 (VDN-H3), a hybrid-attention model that generates video faster than it plays, powered by MiniMax H3. It offers these key features:

• Fast inference: On 8 B200 GPUs, VDN-H3 generates a 14.4-second clip in 11.23 seconds in 8 denoising steps.
• Hybrid Architecture: We propose a hybrid-attention architecture: one frame-wise linear attention branch that is highly efficient, and a softmax branch that maintains the backbone's visual quality and consistency.
• Plug-and-Play: The checkpoint adds a separate linear attention branch and two small LoRA adapters that can be merged into the backbone during inference without touching the backbone weights.
• Fully open-source: We don't just open-source the weights. The optimized inference stack and its corresponding training code is released together.

This repository holds the weights. The inference and training code, together with the setup instructions, is at OpenVDN/vdn-minimax-h3.

Download the weights

Download everything (about 82 GB) into ckpts/ using

hf download OpenVDN/vdn-minimax-h3 --local-dir ckpts

The layout will look like

ckpts/
  h3-base/             the released MiniMax-H3: transformer, video and audio VAEs, schedulers · 72 GB
  stage-b-step-2000/   VDN-H3-50-step: linear_branch/ + adapters/default/ LoRA · 4.3 GB
  stage-dmd-step-250/  VDN-H3-8-step: the above + adapters/turbo/ · 5.1 GB

stage-dmd-step-250 is the 8-step model the headline numbers use; stage-b-step-2000 is the 50-step model it is distilled from. Each directory describes itself: model_spec.json records the hybrid architecture, metadata.json the training recipe, and the learned tensors sit in linear_branch/model.safetensors and adapters/<name>/adapter_model.safetensors.

Your first render

After setting up the environment, the simplest way to start is by running the model on a single GPU:

bash scripts/8nfe_tuned_fp8.sh

Note that the first run needs to compile all of the kernels, which might take several minutes. Later runs can reuse the cache.

For your own prompt, you should first encode it using the Qwen3-VL-32B VLM, then render it through the main diffusion model:

python src/inference/encode_prompt.py --prompt "..." --out prompts/mine.pt

python src/inference/infer.py \
  --config configs/inference/8nfe_tuned_fp8.yaml \
  checkpoint=ckpts/stage-dmd-step-250 \
  render.prompt_file=prompts/mine.pt \
  render.out=results/mine.mp4

We strongly recommend rewriting it first using H3-Context-IR or the official prompt-writing skills before encoding it. This can greatly improve the generated video quality.

Results

We report steady-state denoising speed on the 768p, 14.4-second video generation workload for the released model using our inference pipeline on H200s and B200s:

H200:

B200:

We exclude model loading, warm-up, VAE decoding, and MP4 encoding. For a live setup, we recommend running the text prompt rewriter, VAE decoding, and MP4 conversion on separate machines, so the eight GPUs only do denoise.

Acknowledgement

VDN-H3 is built on MiniMax-H3 and starts from its released transformer weights. We also thank Diffusers, FlashAttention, and Triton, which the optimized inference path is built with.

License

VDN-H3 is a derivative of MiniMax-H3 and is distributed under the MiniMax H3 Community License Agreement, included here verbatim from the upstream repository.

The agreement grants rights only in its applicable territory, defined as worldwide excluding the European Union, the United Kingdom, the Republic of Korea, and the United States of America. It states that use outside the applicable territory is not authorized and invites people in an excluded territory to contact MiniMax about obtaining a license.

The agreement also contains redistribution requirements and an Acceptable Use Policy. Among other requirements, a distribution must include the agreement, modified files must carry notices of their modification, and distributions to third parties other than through hosted services must include the NOTICE file supplied with the code repository. Please read the agreement in full before using or distributing VDN-H3. This note is not a substitute for the license text or for legal advice.