Possibility to specify whether Docker or Podman is running in the background as Podman inistatilizes GPU differently.

[JBBERLIN77]

Describe why it is important and where it will be useful

Since one part of the Linux world uses Podman in addition to Docker and Podman, in contrast to Docker, inistalizes the GPUs differently than Docker.

Podman: --device nvidia.com/gpu=all
Docker: --gpus all

It would be cool if the AppAPI or the new HaRP gets the possibility to specify whether Docker or Podman is running in the background.

Otherwise you can only run the ExApps in CPU mode when Podman is running in the background.

Describe your proposed solution

A switch or a field where you specify how the GPU is to be addressed in the ExApp.

Describe alternatives you've considered, if relevant

No response

Additional context

No response

[kinnewig]

The issue appears to originate from podman itself, as it does not respect device requests from the Docker API. See containers/podman#22645.

[kinnewig]

As a workaround, you can add the GPU to the /usr/share/containers/containers.conf (the location of this file may vary depending on your operating system).

Once you've located the containers.conf file, search for the line #devices = []. And add the GPU as a device by modifying the line as follows:

devices = ["nvidia.com/gpu=all"]

Note that you'll need to restart the Podman service after making these changes.

[oleksandr-nc]

As a workaround, you can add the GPU to the /usr/share/containers/containers.conf (the location of this file may vary depending on your operating system).

Once you've located the containers.conf file, search for the line #devices = []. And add the GPU as a device by modifying the line as follows:

devices = ["nvidia.com/gpu=all"]

Note that you'll need to restart the Podman service after making these changes.

Hello. Do you willing to make a PR to the Nextcloud documentation with this finding?

[lord0gnome]

Just to be clear, this will make accessible nvidia GPUs to ALL running containers on the system. so not exactly optimal. (Though I understand this is only a workaround)

[oleksandr-nc]

Closing as stale