• 0 Posts
  • 24 Comments
Joined 2 years ago
cake
Cake day: June 12th, 2023

help-circle
  • Really depends on what data it is and whether you want to search it regularly or just as a one time thing.

    You could load them into an rdbms (MySQL/Postgres) and have it handle the indexing, or use python tools to process the files. Something like elasticsearch could work too.

    If it’s just a one time thing grep is probably fine tho.

    Aleph could work as well but I have no experience with it.

    I guess it depends on how much time you want to invest in setting something up versus how much time you’d lose waiting for grep to finish (if you only need to search a certain column, you can create an index with just that column using awk, search that index file, then extract the full line from the source file based on that result, but at that point you’re basically creating a new database engine).






  • My answer would basically be yes, but. An old desktop (or even laptop) can definitely be used and will run fine. It should be very easy to get one for free or very cheap as companies will typically write them off after 3-5 years.

    However, you might want to consider power consumption. Running a desktop 24/7 will use a lot more power than a new MiniPC or a NUC, so you may want to calculate how much it’ll cost to run a desktop 24/7 compared to a device that only uses 5W or whatever, and see whether the upfront savings make up for what you’ll pay in electricity over a certain period.

    I think you might actually want to look into second hand MiniPCs unless you absolutely need to fit a bunch of hard drives in a case (like you probably would with Jellyfin).

    Also I want to echo what others are saying about noise. A desktop or rack mounted server will make more noise than a laptop or MiniPC.





  • I personally wouldn’t mind algorithmic recommendations if:

    • you can control or choose the algorithm
    • you can turn it off, or it turns off after you follow N amount of users

    Discovery is important when you’re initially signing up, but once you found the people you want to follow, you don’t really need it any more. It should just be there to help new users, essentially. As long as it’s open source and not run for profit, there’s not the traditional incentive to keep your eyeballs on the app like we see with the other networks.