

I do this on my ultra, token speed is not great, depending on the model of course, a lot of source code sets are optimized for Nvidia and don’t even use native Mac gpu without modifying the code, defaulting to cpu. I’ve had to modify about half of what I run
Ymmv but I find it’s actually cheaper to just use a hosted service
If you want some specific numbers lmk
Default instances would go a long way, I know there’s a lot of hate for lemmy.world but defaulting to the biggest instance or a random one in the top 10 would help ease some of the early friction. Users can choose an instance later when they get more comfortable with the platform.
Federation is neat but the average person just wants to scroll and chat