SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 2 months agoDo you host your own AI?message-squaremessage-square204linkfedilinkarrow-up1182arrow-down142file-text
arrow-up1140arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 2 months agomessage-square204linkfedilinkfile-text
minus-squaresurewhynotlem@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·2 months agoI have to recommend switching to llamacpp. It’s SO much faster than ollama.
minus-squarecurbstickle@anarchist.nexusMlinkfedilinkEnglisharrow-up2arrow-down1·2 months agoOn the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…
I have to recommend switching to llamacpp. It’s SO much faster than ollama.
On the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…