I do this on my ultra, token speed is not great, depending on the model of course, a lot of source code sets are optimized for Nvidia and don’t even use native Mac gpu without modifying the code, defaulting to cpu. I’ve had to modify about half of what I run

Ymmv but I find it’s actually cheaper to just use a hosted service

If you want some specific numbers lmk