Tacostrange

I had the same issue a few weeks ago. Try this in your docker compose

deploy:
      resources:
        reservations:
          devices:
            - driver: cdi
              device_ids:
                - nvidia.com/gpu=all