I’m not sure the smaller Lemmy servers running on a pi or resident internet upload could handle the equal sizable fraction of .world . it would be interesting to calculate how many users total on Lemmy divided by how many public joinable instances and see the averages or which servers are forced to scale the most.
This would take away complete user freedom to choose the server they want which is controversial.
I just spent a good few hours optimizing my LLM rig. Disabling the graphical interface to squeeze 150mb of vram from xorg, setting programs cpu niceness to highest priority, tweaking settings to find memory limits.
I was able to increase the token speed by half a second while doubling context size. I don’t have the budget for any big vram upgrade so I’m trying to make the most of what ive got.
I have two desktop computers. One has better ram+CPU+overclocking but worse GPU. The other has better GPU but worse ram, CPU, no overclocking. I’m contemplating whether its worth swapping GPUs to really make the most of available hardware. Its bee years since I took apart a PC and I’m scared of doing somthing wrong and damaging everything. I dunno if its worth the time, effort, and risk for the squeeze.
Otherwise I’m loving my self hosting llm hobby. Ive been very into l learning computers and ML for the past year. Crazy advancements, exciting stuff.
Sounds like ollama was loaded up with an either overly censored or plain brain dead language model. Do you know which model it was? Maybe try mistral if it fits in your computer.
I run kobold.cpp which is a cutting edge local model engine, on my local gaming rig turned server. I like to play around with the latest models to see how they improve/change over time. The current chain of thought thinking models like deepseek r1 distills and qwen qwq are fun to poke at with advanced open ended STEM questions.
STEM questions like “What does Gödel’s incompleteness theorem imply about scientific theories of everything?” Or “Could the speed of light be more accurately refered to as ‘the speed of causality’?”
As for actual daily use, I prefer using mistral small 24b and treating it like a local search engine with the legitimacy of wikipedia. Its a starting point to ask questions about general things I don’t know about or want advice on, then do further research through more legitimate sources.
Its important to not take the LLM too seriously as theres always a small statistical chance it hallucinates some bullshit but most of the time its fairly accurate and is a pretty good jumping off point for further research.
Lets say I want an overview of how can I repair small holes forming in concrete, or general ideas on how to invest financially, how to change fluids in a car, how much fat and protein is in an egg, ect.
If the LLM says a word or related concept I don’t recognize I grill it for clarifying info and follow it through the infinite branching garden of related information.
I’ve used an LLM to help me go through old declassified documents and speculate on internal gov terminalogy I was unfamiliar with.
I’ve used a speech to text model and get it to speek just for fun. Ive used multimodal model and get it to see/scan documents for info.
Ive used websearch to get the model to retrieve information it didn’t know off a ddg search, again mostly for fun.
Feel free to ask me anything, I’m glad to help get newbies started.
Download server files and run them. Modern Minecraft requires java runtime enviroment 17, 1.16 and belore jre8. If you have synaptic package manager search for jre there.
I usually make a batch file to execute server. You can run jre as is by executing as an application but a batch file helps set memory size usage, nogui and stuff.
It will stop on first server startup to produce a EULA text file. Open it up, set to true, save, restart server. See if you can connect through LAN by using another computer and entering your servers local IP address probably 10.0.0.xx:25565
Open up the port for default mc server in your router so others can connect on public network. 25565, TCP+UDP, in out both ways. Make exceptions in your firewall too.
I wrote a guide on here about the differences between alternative search engines. I recommend for you either YaCy or marginalia.nu. searxng supports calling YaCy (I actually contributed to that feature on the github).
The problem with decentralized engines like marginalia and YaCy is that they aren’t good at the things a average user wants from a typical search engine. Ideally a search engine is meant to quickly provide you links to webpages which are strongly related in content to you are looking for. Shopping, weather, map directions, local business hours. On some level you need to prioritize showing the user what they want ideally within the first few results.
Decentralized engines by their nature don’t do this easily. Instead using YaCy or marginalia feels like a scavenger hunt where you get handed a page of random websites loosely connected by your keyword search term and are told to start looking. This is good when your in the mood for blogspam and personal webpage blog dicovery, but not great for finding local buisniess info quickly. YaCy has a user curated priority system but not enough user mass adoption to be worth a damn in practice.
So sadly if you want anything resembling google or bing results for your practical convinence driven daily internet searching needs, you need to scrape them with searxng or use one of their few real search engine company competitors funding their own indexers and web crawlers. So really your options are scraping google, bing, mojeek, qwant, kagi and DuckDuckGo(ish they still use bing for indexing a lot).
Out of those Ive actually warmed up to Kagi over the year. I was put off at the idea of subscription based internet search but its a really good service they provide and they line out their reasoning for pricing well. They seem to be using that monthly sub money to actually improve the service and user experiences while remaining transparent with constant changelogs and blog updates. Kagis recent implimentation of privacy pass protocol, available TOR access, anonymous payment options, and taking fediverse + small net indexing seriously are all green flags to me. Never thought I would pay for a search engine but the way the world is going I’d rather eat the equivalent of a 5-10$ patreon sub to grow a service I believe is respecting me as a customer over fucking FAANG treating me like cattle and absolutely violating user experience so hard just for another nickles worth value in data scraping.
Three is better than none. as long as the community exist and has some kind of activity even one post a month with three comments, you are doing your part to create a viable home for those who share your niche interest. In three months you might get up to 6 people, in 9 months 10, one year later 15. Its difficult going from passive consumer to one of the few active posters but you truly are adding value to the space just by trying.
Lemmy users like to present lemmy vs reddit usage as all or nothing, its not. Realistically you still use reddit for the niche communities that arent getting much interaction here. I do for locallama and dynavap. But ideally you cross post to the lemmy communities to add content here too so that those like you have a better chance to find a home.
You can’t do anything because these excuses are window dressing and not the core of the issue. The core of the issue is that 99% of people are incredibly unwilling to change their habits or spend five minutes to wrap their heads around how things work. If the question of which server to join is too much, this kind of space isn’t for you.
No, having a full time job or a family is not an excuse to not learn how computers or the internet or networks in general work. You’ve had a lifetime to learn and are willfully ignorant. If you just give up and run away the moment you have to apply two braincells to understand a new concept, your cognition is fucked.
Im personally fine with basic competence and tech literacy to be a natural gate keeping the unwashed morons out. Lemmy is growing at a fine pace without catering to the lowest common denominators.
I get its a bit of self deprecating humor but in seriousness it shows the exact opposite IMO. Going with the flow would be continuing to consume reddit slop no matter how awful the website gets, no matter how much content is baked by a bot, no matter how many more ads they show you just to comment or post.
“Lol I know its getting shittier but im addicted and unwilling to change my habits or show some backbone. Im sorry for even considering a 12 hour protest, Please daddy just let me continue posting I promise ill be good little content monkey and keep your shareholder numbers up this quarter. I don’t miss my old phone app for reddit at all…”
wipes away a single suppressed tear for the death of boost/sync/whatever and their own lost dignity when spez isn’t looking
Seriously good on you for being a trendsetter with a basic shred of self respect who knows when to tap out of a bad/abusive situation, Echofox. I wonder just how much more the water needs to be boiled before even the joke characature above gets tired of reddits BS. Maybe never.
Its generic slop by anime standards. Like yeah anime is meant for teenagers and young adults so you can’t be too critical over fanservice or flat YA novel Gary sue tier character writing or forgetting to write an actually compelling reason for the villain doing the bad thing at the start by the time the story wraps up. But you can at least try you know?
Anime in general is not meant to be high art but SAO goes the extra mile to be uninteresting bland slop that appeals to the lowest common denominator. Young nerdy teenage boys dont care because all they want is the hot anime girl harem and flashy epic gamer op superpower eye candy sakuga battles but the older you get the more apparent the poor writing gets.
The isekai genre has done a lot better over the decade since SAO initially released things like rezero or even Overlord blow it out of the water in terms of actually interesting plot and suspense. The only reason SAO is still popular is the high quality porn.
Dad printed this photo out and put it up on work paper board many years ago. Glad to see its still acrewing new pixels today.
I run a local LLM on my gaming computer thats like a decade old now with an old 1070ti 8GB VRAM card. It does a good job running mistral small 22B at 3t/s which I think is pretty good. But any tech enthusiast into LLMs look at those numbers and probably wonder how I can stand such a slow token speed. I look at their multi card data center racks with 5x 4090s and wonder how the hell they can afford it.
If all computers are on local network you can use warpinator.
Koreader has a plugin to sync with calibre local server and its a REALLY good ereader software
I like that I can somewhat recognize usernames across all the lemmy post I comment in. Im not sure if anyone really notices me or recognizes my username and goes ‘Oh hey its smokeydope again’ but I do that for some other active lemmy users and it starts to feel like we are all acquaintances working together to make an interesting experience for eachother and not just competing for attention without adknowledging eachother.
Steam deck runs SteamOS, a custom distro built by steam specifically. You can download it here
I blocked all the news communities for this reason. Just go down your feed and look at the name of the community and if the post or community isnt what you want to see or interested in than block it. Ive been doing that and my feed has improved dramatically. Theres only so much depressing stuff im willing to expose myself to, some people get off on the emotional charge seeing that kind of news, not me though.
damn imagine if this is how you found out you were blue-green color blind, I hope that your phones color rendering is just really shitty
Would something like this interest you? Gemtext formatted to html is about as light weight as it gets. lots of automatic gemtext blog software on github that also formats and mirrors an html copy. Whenever a news page article gets rendered to gemtext through newswaffle it shrinks about 95-99% of the page size while keeping text intact. Let me know if you want some more information on gemini stuff.