Hey, I am curious, are people working on storing fediverse data off the servers? Like using bittorent protocol or ipfs?

  • poVoq@slrpnk.net
    link
    fedilink
    English
    arrow-up
    10
    ·
    1 day ago

    Its is commonly done with S3 compatible storage, and projects like Garage allow to do so in a distributed way.

    Neither Bittorrent or IPFS seem particularly well suited for this.

    • rglullis@communick.news
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      edit-2
      1 day ago

      projects like Garage allow to do so in a distributed way.

      Really? Does this mean that different instances could share a bucket? Do they have to trust each other? I’ll have to jump off the minio train anyway, if you have any tips to get this going would be nice.

      • poVoq@slrpnk.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        23 hours ago

        Garage has deduplication of all files, yes. Obviously if you host something on server not under your control you have to have a certain trust in them. Generally speaking Garage seems to be a good replacement for Minio, but I don’t have any direct tips for migrating.

        There was also a project for Mastodon to sit between it and any S3 storage that would allow sharing and deduplicating files between instances, but I can’t find it right now and forgot the name. But it seemed stuck in a rewrite and not actively developed outside of that.