Yes, llama-swap and I use it for home assistant text-gen notifications, basic coding tasks, etc
If anyone here self-hosts definitely check out llama-swap as it has some nifty features for hotswapping LLMs, image generation models and voice models.
Yes, llama-swap and I use it for home assistant text-gen notifications, basic coding tasks, etc
If anyone here self-hosts definitely check out llama-swap as it has some nifty features for hotswapping LLMs, image generation models and voice models.


Surprised no one has mentioned proxmox (at least not the top 10 threads I saw first)
Basically debian with a webui specifically for spinning up VMs and LXCs and managing storage and such, then install whatever distro in an LXC and run docker in that.


Source? ;)


Depends on how much quantization, but still fairly beefy, couldn’t run it on my homelab with a 3080ti for example.
I generally use smaller 8-12b models and they’re alright depending on the task.
Proxmox as another option


Does proxmox count? Then I run lots of docker containers in lxcs


Vaultwarden


There’s a silly bug where if you use Ventoy to install proxmox it fucks up the efi partition and won’t allow boot without the USB in, I left that USB in for probably 6 months before bothering to fix it lol.


“Having common functionality around certain types of fediverse content is centralization.”


Maybe consider moving to an instance that includes basic functionality?


It means you frequently defended the IDF genociding in Gaza


I’ll check these out soon, thanks!
And yeah the formatting was rough lmao, I’ll check some of those out!


I’m curious if you have any good video essays, I really enjoy learning while doing things, which is much more difficult with reading, though I have started Socialism With Chinese Characteristics and it is interesting!


They’re an IDF apologist, so probably not


74 across 2 proxmox nodes in a few lxcs


Authelia does have it too, I use that with traefik
Yeah, I just thought about my suggestion more and one thing I think that has given reddit so much staying power is the fact content sticks around so long, I’d imagine many of us here would specifically search in reddit for reviews or help with something and found a like 3 year old thread with the answer.
So… Pruning is probably a bad idea lol.
Unfortunately threadiverse searchability is pretty bad, assumedly because of the nature of the fediverse with content being copied across instances essentially I am sure its a little more difficult for an indexer to properly handle it, not to mention somehow deciding which instance to specifically link to for a certain thread. On top of that, it wouldn’t surprise me if all the corpo search engines would deprioritize most fediverse sites out of self preservation 🤷
On the “warming them up” that makes sense in theory, but usually if I’m making a rare post it’s to engage with a group of people, if I don’t see the engagement I’m probably not going to go there again to post whatever it is because what’s the point if no one sees it anyway?
Would it almost be better to prune old communities? I agree it’s off-putting to find community for an interest and seeing last activity like a year ago, doesn’t make you want to post since it seems inactive.
One thing about how reddit/lemmy works though is people subscribed (assumedly still active on Lemmy elsewhere) might still see that content vs a forum where no activity means very few visit the site.
I’ve been using the bitwarden android app for about a year and a half with zero issue 🤷