BorgDrone@lemmy.onetoSelfhosted@lemmy.world•Using Mac M2 Ultra 192GB to Self-Host LLMs?English
21·
15 hours agoAnd what is the memory bandwidth on these APUs?
And what is the memory bandwidth on these APUs?
you’d definitely be able to do it cheaper with PC hardware.
You can get a GPU with 192GB VRAM for less than a Mac? Sign me up please.
they wanna share a codebase between web, desktop and possibly mobile.
That way you get an app that’s crap on every platform.
Which is how fast?