Phoenix3875@lemmy.world to Programmer Humor@programming.dev · 20 hours agoWork of pure human soul (and pure human sweat, and pure human tears)lemmy.worldimagemessage-square41fedilinkarrow-up1319arrow-down133
arrow-up1286arrow-down1imageWork of pure human soul (and pure human sweat, and pure human tears)lemmy.worldPhoenix3875@lemmy.world to Programmer Humor@programming.dev · 20 hours agomessage-square41fedilink
minus-squarepassepartout@feddit.orglinkfedilinkarrow-up10·18 hours agoIf you have a supported GPU you could try Ollama (with openwebui), works like a charm.
minus-squarebi_tux@lemmy.worldlinkfedilinkarrow-up3·16 hours agoyou don’t even need a supported gpu, I run ollama on my rx 6700 xt
minus-squareBaroqueInMind@lemmy.onelinkfedilinkarrow-up1·10 hours agoYou don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af
If you have a supported GPU you could try Ollama (with openwebui), works like a charm.
you don’t even need a supported gpu, I run ollama on my rx 6700 xt
You don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af