Cool, but is there any reason to use this over Searx?
Cool, but is there any reason to use this over Searx?
I second that. Even my lower-midrange laptop from 3 years ago (8GB RAM, Integrated AMD GPU) can run a few of the smaller LLMs, and it’s true that you don’t even need a GPU as they can run in RAM. And depending on how much RAM you have and what GPU, you might find models performing better in RAM instead of on the GPU. Just keep in mind that when a model says, for example, 8GB Memory required, if you have 8GB RAM, you can’t run it cuz you also have your operating system and other applications running. If you have 8GB video memory on your GPU though, you should be golden (I think).
I completely forgot about the Linux Upskill Challenge! I should have mentioned I’ve been running Linux as my desktop operating system for almost 3 years, and I’ve been tinkering with it quite a lot throughout so I’m quite familiar and very comfortable with the command line. I shoukd go through the Linux upskill challenge so I can fill in any knowledge gaps though. Thanks for reminding me!
If only. I’m a student living in student accommodation. I can’t set up a NAS because hosting things on the network is against their policy, and I also wouldn’t feel comfortable having that type of hardware in my room. And if electricity bills skyrocket because of me, I’ll be forced to pay them.
What’s a safe place to buy storage online? I’ve seen horror stories of an sd card in a drive enclosure, and modifying the storage to make it appear larger than it is.
Are cheap
Yeah, right. I know they’re cheaper than they were but they can’t be that cheap.
finds a high-speed 2tb m.2 from Kingston (a brand I trust) for £120
I stand corrected.
I’ve just realized there’s an animated series on Youtube, that I’ve had a really hard time (read: impossible) finding anywhere else, and if LEGO (yes, I’m talking about Ninjago) decides to delete these videos from their channels, the OG seasons are nowhere to ve found as far as I can tell. Yes, there are some cartoon streaming services but those are few in number and getting fewer, so I wouldn’t bet on them or any new ones that spring up having that content available in 5-10 years. And that’s worrying. Time to download all 15 seasons and store them somewhere! (oh shit, I don’t have enough space, do I)
Edit: found them on a downloads site from the piracy megathread, but only Seasons 1-11. I’ll get them all soon enough.
Edit 2: The first 11 seasons from that website come up to just over 105GB and I don’t have the space. Do I buy a 256GB USB/ Drive to store this at? I’m scared that I’m getting to the point of becoming a data hoarder. Not too long ago, I didn’t know what I’d do with my single 32GB USB, now I have added a 128GB one, and a 64GB Ventoy usb to the mix, and I still don’t have enough. Wtf?
I feel almost obliged to ask: what are you running on this monster of a setup?
Is Hugo good for, say, a portfolio website? I know its good for blogging, but I’ve been thinking about a simple portfolio website hosted on Gitlab pages (I wish I could selfhost, but I can’t due to a lack of hardware and restrictions from my student accommodation and their network policy), and was wondering if Hugo would be a good choice for a portfolio website, maybe just having one page per project or something like that?
Fair point. But even if they were legit in any way, I’m already positioned not to trust them.
I really like the idea of user-friendly selfhosting (which is essentially what this company is offering, I mean hell, I’ve had similar business ideas floating around in my head too) BUT any company that has:
an in-the-know marketing team
Any employees that are somewhat technical enough (which should be guaranteed for a company with this sort of product
NOT a scam
Would know what a HUGE risk reputation-wise it is to showcase crypto-related selfhosting on the FRONT page. It’s like a “build-a-red-flag” or “destroy-our-reputation” speedrun. Even IF you want to offer this, anyone in-the-know with at least 3 braincells would bury this deep in the page and make it difficult to find (if they were well-intentioned in the first place) because at this point anything crypto, especially being the main offering, is a huge red flag.
If instead, they offered a nextcloud instance, for example, or Pihole as an adblocker, or some other good and common services, maybe a selfhosted VPN (or maybe not, because of the stupid and misleading ads of VPN companies), they would be seen as 100% more legit.
Edit: Just checked their marketplace and they have:
Jellyfin
Vaultwarden
FreeGPT-2
Gitea
Matrix
Nextcloud
Their own service for TOR pages
Ghost (a blogging platform)
SearxNG (a search engine)
I mean, add Wordpress, Pihole and some other friendly services, and advertise THOSE!!! Build your own Google (SearxNG)! Build your own MS Office online and OneDrive (Nextcloud)! Build your own Github (Gitea)! Build your own Discord (Matrix)! Build your own password manager (Vaultwarden)! Build your own Netflix (Jellyfin)!
Not THAT far. But 32GB RAM is getting more common, though I haven’t heard of many people using 64, let alone more than that.
Also, storage is usually not that extreme, though multiple terabytes are also getting more common on the higher end.
Just this month, I upgraded to 16GB RAM and 1TB SSD so it isn’t that extreme for most people.
CPU and GPU - wise, most people aren’t running the best of the best, and there are still plenty of people using 10-series Nvidia GPUs, with most people seemingly using 20-series or 30-series GPUs, (and usually not the best cards for these generations)