I finally got my #trunas server using the #gpu for #openwebui running the #deepseek coder v2. I got so close before with the system identifying the gpu and then not using it. I followed this guide and made only one change to put the open web ui portion into a custom app yaml so that it'd show up...
And I’m making everyone go to my gotosocial post because the server is running, so I’m going to use it!
Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn’t really possible. Now, smooth sailing.