acvlab/abot-world-interactive

Space

🌍 ABot-World β€” Interactive World Rollout

95

20 commits

1 linked in READMEs

updated Jul 12, 2026

See the code

README

🌍 ABot-World β€” Interactive World Rollout

Upload a single starting image and steer a live navigable world in real time. Provide a first-frame image (image-to-video seed), describe the scene, and drive the world with WASD (move & turn) / IJKL (look & pan). The model autoregressively rolls out an action-conditioned world and streams decoded frames straight to your browser.

Architecture

This Space runs a proper live backend/infrastructure (in the spirit of Overworld/waypoint-1-5):

  • gradio.Server exposes ZeroGPU-friendly /start_game and /stop_game API endpoints plus a raw WebSocket (/ws) that streams binary JPEG frames and receives live control input β€” no Gradio UI polling.
  • A custom index.html front-end handles image upload (the i2v seed β€” no video upload needed), live keyboard steering, and a clean HUD.
  • Every endpoint is keyed by a per-client session_id, so concurrent players never share seed images, frame queues, or status messages.
  • ZeroGPU quota is billed to the requesting user: the HF iframe's x-api-token / x-ip-token is forwarded by the Gradio JS client and the incoming request context is propagated into the GPU worker thread, so @spaces.GPU consumes the visitor's own quota rather than the Space owner's.

Inference is causal / block-wise, matching the upstream CausalInferencePipeline.

gradio

Contributors

multimodalart

20 commits

acvlab/abot-world-interactive

Space

🌍 ABot-World β€” Interactive World Rollout

95

20 commits

1 linked in READMEs

updated Jul 12, 2026

See the code

README

🌍 ABot-World β€” Interactive World Rollout

Upload a single starting image and steer a live navigable world in real time. Provide a first-frame image (image-to-video seed), describe the scene, and drive the world with WASD (move & turn) / IJKL (look & pan). The model autoregressively rolls out an action-conditioned world and streams decoded frames straight to your browser.

Architecture

This Space runs a proper live backend/infrastructure (in the spirit of Overworld/waypoint-1-5):

  • gradio.Server exposes ZeroGPU-friendly /start_game and /stop_game API endpoints plus a raw WebSocket (/ws) that streams binary JPEG frames and receives live control input β€” no Gradio UI polling.
  • A custom index.html front-end handles image upload (the i2v seed β€” no video upload needed), live keyboard steering, and a clean HUD.
  • Every endpoint is keyed by a per-client session_id, so concurrent players never share seed images, frame queues, or status messages.
  • ZeroGPU quota is billed to the requesting user: the HF iframe's x-api-token / x-ip-token is forwarded by the Gradio JS client and the incoming request context is propagated into the GPU worker thread, so @spaces.GPU consumes the visitor's own quota rather than the Space owner's.

Inference is causal / block-wise, matching the upstream CausalInferencePipeline.

gradio

Contributors

multimodalart

20 commits