ROCm-AI-Installer

Installation scripts for an AI applications using ROCm on Linux.

Info:

[!Important] All models and applications are tested on a GPU with 24GB of VRAM.
Some applications may not work on GPUs with less VRAM.

Test platform:

Text generation:

Image & video generation:

ComfyUI Addons:

Music generation:

Voice:

3D generation:

Instalation:

1. Install Podman.

[!Note] If you are using Debian 13.6, you can use sudo apt-get update && sudo apt-get -y install podman podman-compose qemu-system (should also work on Ubuntu 26.04)

[!Note] The installer menus need whiptail. It is preinstalled on most systems; if it is missing the script says so and exits.

2. Make sure that /dev/dri and /dev/kfd are accessible.

ls /dev/dri
ls /dev/kfd

[!Important] Your distribution must have amdgpu configured.

3. Make sure that your user has permissions for the video and render groups.

sudo usermod -aG video,render $USER

[!Important] If not, you need reboot after this step.

4. Clone repository.

git clone https://github.com/Mateusz-Dera/ROCm-AI-Installer.git

5. Run installer.

./install.sh

6. Set variables

[!Important] From version 17, ROCm packages are installed per GPU architecture. The installer reads the cards from the kernel and preselects them under GFX, and the container is built with the packages for those architectures only - not for every GPU AMD ships.
Selecting more than one architecture is supported, so a machine with, say, a gfx1100 card and a gfx1036 integrated GPU can have both. Changing the selection requires recreating the container.

[!Note] Using several cards at once has not been tested. The installer can build for more than one architecture, and each application is pinned to a single card when it is installed, but everything here was only ever run on a single GPU.

7. Create a container if you are upgrading or running the script for the first time.

8. Install the applications of your choice.

[!NOTE] With more than one usable card, each application asks which one it should run on while it is being installed. The answer is written into that application's run.sh as HIP_VISIBLE_DEVICES, so different applications can use different cards - image generation on the discrete GPU, something small on the integrated one.
There is no container-wide setting for this.
To change it later, edit HIP_VISIBLE_DEVICES in the application's run.sh or reinstall the application.

9. Go to the application folder and run:

./run.sh

[!NOTE] Everything is configured to start from the host side (You don't need to enter the container).

Container:

Checking the container

To check if the container is running:

podman ps

Starting the container

If the container is not running, start it with:

podman start rocm

Accessing container bash

To enter the container's bash shell:

podman exec -it rocm bash

Removing the container

To stop and remove the container:

podman stop rocm
podman rm rocm

Or force remove (stop and remove in one command):

podman rm -f rocm