• 0 Posts
  • 16 Comments
Joined 2 years ago
cake
Cake day: June 15th, 2023

help-circle
  • But any 50 watt chip will get absolutely destroyed by a 500 watt gpu

    If you are memory-bound (and since OP’s talking about 192GB, it’s pretty safe to assume they are), then it’s hard to make a direct comparison here.

    You’d need 8 high-end consumer GPUs to get 192GB. Not only is that insanely expensive to buy and run, but you won’t even be able to support it on a standard residential electrical circuit, or any consumer-level motherboard. Even 4 GPUs (which would be great for 70B models) would cost more than a Mac.

    The speed advantage you get from discrete GPUs rapidly disappears as your memory requirements exceed VRAM capacity. Partial offloading to GPU is better than nothing, but if we’re talking about standard PC hardware, it’s not going to be as fast as Apple Silicon for anything that requires a lot of memory.

    This might change in the near future as AMD and Intel catch up to Apple Silicon in terms of memory bandwidth and integrated NPU performance. Then you can sidestep the Apple tax, and perhaps you will be able to pair a discrete GPU and get a meaningful performance boost even with larger models.





  • I think it helps to think of browsing as a basic form of searching. Everything you can do in a browsing context, you can by definition do in a searching context…if the client doesn’t suck. The information needed to browse is embedded in the tags.

    So this strikes me as entirely dependent on your client software. A good client should let you browse by tags. You could add Dewey numbers as tags to start with, so you can browse that way if you want, then add any other tags that might be useful (like genres, for example) on top of that.

    The only difference with tags in this context is that books will appear in multiple places.








  • It’s insane how many things they push as Snaps when they are entirely incompatible with the Snap model.

    I think everyone first learns what Snaps are by googling “why doesn’t ____ work on Ubuntu?” For me, it was Filebot. Spent an hour or two trying to figure out how the hell to get it to actually, you know, access my files. (This was a few years ago, so maybe things are better now. Not sure. I don’t live that Snap life anymore, and I’m not going back.)




  • On Mastodon it’s pretty easy. Download the official app and go through the prompts. They should probably have a little note saying “just go with the defaults if you’re not sure” but this shouldn’t be a road block for any normal person. The fact that Mastodon has a standard migration method makes this a low-impact decision.

    Lemmy is definitely harder. “Jerboa” doesn’t sound like an official app, and I don’t think you can even create an account in Jerboa. So the first step is finding an instance on the web with no guidance. That’s bad.

    I still haven’t joined Matrix because it’s too hard. People say I shouldn’t use matrix.org for various reasons (like bans without warning) but I can’t find an alternative that seems sensible. All the guides I found are basically “you should really host your own, but if you’re too much of a noob, here are some Polish lolicon-themed servers you can join”. If it were possible to sign up without feeling like I’m doing something wrong, I would have many years ago.