Post by Michael DiLeo, @mdileo@michaeldileo.org
gotosocial.michaeldileo.org
I finally got my #trunas server using the #gpu for #openwebui running the #deepseek coder v2. I got so close before with the system identifying the gpu and then not using it. I followed this guide and made only one change to put the open web ui portion into a custom app yaml so that it'd show up...

And I’m making everyone go to my gotosocial post because the server is running, so I’m going to use it!

  • @liliumstar@lemmy.dbzer0.comEnglish
    2•21 days ago

    Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn’t really possible. Now, smooth sailing.