anthonywu/gamecraft-fal-app

Hunyuan Gamecraft single-gpu implementation on Fal's serverless cloud

Python

0

0 commits

updated Aug 17, 2025

See the code

README

Gamecraft 1.0 on Fal (Experiment)

This is my trying Fal Serverless to deploy a custom container image and host it at: https://fal.ai/models/anthonywu/gamecraft (not promotable for now until bugs fixed)

The model deployed is Hunyuan Gamecraft which as of Aug 16 does not have a inference provider in the USA, so I thought it was a neat challenge to push the boundaries of my CUDA understanding as well as pushing GPU inference timeout limits.

Status

  • image -> video are generated during container warmup
  • can send request from UI -> backend, but the generation is taking too long and I think is timing out (a generation is 10+ minutes on the best H100 machine type)
  • need to implement GUI for sending in action_list and action_speed_list which is where the camera moves for each iteration, and how fast the camera is moving (think: game controllers generate this data)

Interesting Notes

  • Using OrbStack on macOS to docker build a amd64-destined container was easier than I expected. I've used Docker for 10+ years but never had to use emulation during docker packaging. This was frictionless.
  • I have to read the Fal docs on whether each user inference request can spread out to N>1 GPUs, to avoid torch distributed run complexity, I implemented the single-gpu option described by Hunyuan.
  • Hunyuan provided the inference sample code as a CLI torch_run command, assuming the user would have shell access on a Nvidia host to do the inference. I had to re-write the inference flow to be compatible with how fal.Apps are pickled and packaged.
  • Your local fal CLI must run in a venv with a Python version that matches the Python that will execute the code
  • Due to pickling requirements (very wonky Python low level details), a bunch of the import statements must be inside of fal.App's instancemethods. For this, I have to mute the linters and checkers.

Infrastructure Notes

anthonywu/gamecraft-fal-app

Hunyuan Gamecraft single-gpu implementation on Fal's serverless cloud

Python

0

0 commits

updated Aug 17, 2025

See the code

README

Gamecraft 1.0 on Fal (Experiment)

This is my trying Fal Serverless to deploy a custom container image and host it at: https://fal.ai/models/anthonywu/gamecraft (not promotable for now until bugs fixed)

The model deployed is Hunyuan Gamecraft which as of Aug 16 does not have a inference provider in the USA, so I thought it was a neat challenge to push the boundaries of my CUDA understanding as well as pushing GPU inference timeout limits.

Status

  • image -> video are generated during container warmup
  • can send request from UI -> backend, but the generation is taking too long and I think is timing out (a generation is 10+ minutes on the best H100 machine type)
  • need to implement GUI for sending in action_list and action_speed_list which is where the camera moves for each iteration, and how fast the camera is moving (think: game controllers generate this data)

Interesting Notes

  • Using OrbStack on macOS to docker build a amd64-destined container was easier than I expected. I've used Docker for 10+ years but never had to use emulation during docker packaging. This was frictionless.
  • I have to read the Fal docs on whether each user inference request can spread out to N>1 GPUs, to avoid torch distributed run complexity, I implemented the single-gpu option described by Hunyuan.
  • Hunyuan provided the inference sample code as a CLI torch_run command, assuming the user would have shell access on a Nvidia host to do the inference. I had to re-write the inference flow to be compatible with how fal.Apps are pickled and packaged.
  • Your local fal CLI must run in a venv with a Python version that matches the Python that will execute the code
  • Due to pickling requirements (very wonky Python low level details), a bunch of the import statements must be inside of fal.App's instancemethods. For this, I have to mute the linters and checkers.

Infrastructure Notes