https://shanemcd.com/posts/03-ollama-rootless-podman-quadlet

[giscus[bot]]

https://shanemcd.com/posts/03-ollama-rootless-podman-quadlet

I haven’t seen any instances of other people running Ollama quite like this, so I thought I would share in case it proves to be useful for anyone else out there.

https://shanemcd.com/posts/03-ollama-rootless-podman-quadlet

[shanemcd]

Update: As of right now, NVIDIA has not published official drivers for Fedora 42. Got things working by installing the driver from RPM Fusion, and installing the container toolkit via https://copr.fedorainfracloud.org/coprs/g/ai-ml/nvidia-container-toolkit/

[karlos-oliveira]

probably a silly question but, where a put this file > ~/.config/containers/systemd/ollama.container

its just create this folder hierarchy on user folder? I did that and receive erro when execute the command systemctl --user daemon-reload

error: Failed to connect to bus: No medium found

[shanemcd]

@karlos-oliveira Apologies I just saw your comment here. Not a silly question at all, happy to help.

For rootless Quadlet, the file should go right here in your home directory:

~/.config/containers/systemd/ollama.container

It’s fine to create the folders:

mkdir -p ~/.config/containers/systemd

If you see this:

systemctl --user daemon-reload
Failed to connect to bus: No medium found

that usually means systemctl --user isn’t available in your environment (for example, running inside a container, WSL without systemd, or using sudo by accident).

Rootless Quadlet requires a working user systemd session, since the whole point is to avoid system-wide units.

Once systemctl --user works on your system, the file in ~/.config/containers/systemd will load correctly.

Happy to help if you want to share what OS or environment you're running.