In the next ~6 months I’m going to entirely overhaul my setup. Today I have a NUC6i3 running Home Assistant OS, and a NUC8i7 running OpenMediaVault with all the usual suspects via Docker.

I want to upgrade hardware significantly, partially because I’d like to bring in some local LLM. Nothing crazy, 1-8B models hitting 50tps would make me happy. But even that is going to mean a beefy machine compared to today, which will be nice for everything else too of course.

I’m still all over the place on hardware, part of what I’m trying to decide is whether to go with a single machine for everything or keep them separate.

Idea 1 is a beefy machine and Proxmox with HA in a VM, OMV or TrueNAS in another, and maybe a 3rd straight Debian to separate all the Docker stuff. But I don’t know if I want to add the complexity.

Idea 2 would be beefy machine for straight OMV/TrueNAS and run most stuff there, and then just move HA over to the existing i7 for more breathing room (mostly for Frigate, which could also separate to other machine I guess).

I hear a lot of great things about Proxmox, but I’m not sold that it’s worth the new complexity for me. And keeping HA (which is “critical” compared to everything else) separated feels like a smart choice. But keeping it on aging hardware diminishes that anyway, so I don’t know.

Just wanting to hear various opinions I guess.

  • tmjaea@lemmy.worldEnglish
    1·
    13 hours ago

    Thanks for your answer.

    I use proxmox since version 2.1 in my home lab and since 2020 in production at work. We did not have issues with the ssh files yet. Also corosync is working fine although it shares its 10g network with ceph.

    In all that time I was not aware of how the certs are handled, despite the fact I had two official proxmox trainings. Ouch.

    • dbtng@eviltoast.orgEnglish
      2·
      4 hours ago

      Cool.

      Here. SSH key issues. There was a huge forum war.
      https://forum.proxmox.com/threads/ssh-keys-in-a-proxmox-cluster-resolving-replication-host-key-verification-failed-errors.138102/
      But its still a thing. That still needs to be fixed by a human. Today that’s me.

      Regarding CEPH and corosync on the same network … well I’m just getting started with that now. I do have them on different vlans, but its the same 10gb set of nics. I’m hoping if it gets really lousy, my netadmin can prioritize the corosync vlan. I’ll burn that bridge when I come to it.

      EDIT … The linked forum post above leads to the SSH key answer, but its convoluted.
      Here’s what I put in my own wiki.

      Get the right key from each server.
      cat ~/.ssh/id_rsa.pub

      Make sure they match in here. Fix em if they don’t.
      /etc/pve/priv/authorized_keys

      There’s a couple symlinks to fix too, but this should get it.