Work of pure human soul (and pure human sweat, and pure human tears)

@Phoenix3875@lemmy.world · 7 months ago

@bi_tux@lemmy.world · 7 months ago

you don’t even need a supported gpu, I run ollama on my rx 6700 xt

@passepartout@feddit.org · 7 months ago

I have the same gpu my friend. I was trying to say that you won’t be able to run ROCm on some Radeon HD xy from 2008 :D

@BaroqueInMind@lemmy.one · 7 months ago

You don’t even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af

@bi_tux@lemmy.world · 7 months ago

I tried it with my cpu (with llama 3.0 7B), but unfortunately it ran really slow (I got a ryzen 5700x)

@tomjuggler@lemmy.world · 7 months ago

I ran it on my dual core celeron and… just kidding try the mini llama 1B. I’m in the same boat with Ryzen 5000 something cpu