Social gating, too.

This is a lovely read, a lot of interesting and compact pondering. Cheers.

Yeah, precisely.

This is exactly what I’m talking about.

I get that.

That’s part of my motivation too.

My mental state is not great, and I too came here to avoid a manipulative bombardment of ragebait. Hence its frustrating to fund other users reposting it over, especially when its misleading or straight up misinformation.

I thought most of us came here to escape that trap, but apparently not.

The structure is important, too. That ultimately colors the community, no matter how “free” it is.

I think Lemmy mirrored Reddit a little too closely. For instance, feeds are structured in a way so that popular and “ragebait” communities rise over niche interest ones, and starve the latter.

Piefed is better, and getting better, though. In some ways.

It’s not on over the line on dbzer0 though. The admin has made that crystal clear.

And when other admins try to put the foot down (like on Lemmy.world), the communty piles on them.

I don’t know why you’re being so thorny.

And why would I ever got back to Twitter or Reddit? They’re cesspools. What would make you think I’d ever touch them?

…This is exactly what I’m talking about. Its like if I don’t pass a political purity test, if I am not X level of explicit or hostile in every single post, I’m the enemy. Because apparently I’m not good enough for lemmy.

I can.

But as some point I worry about the health of the community.

I don’t want to invest my time in platform that shrinks into a one-topic pit. Been down that rabbit hole before.

…To be clear, I think Lemmy is okay now, but I worry about the trajectory.

I was not defending the tesseract dev, what they did is inexcusable. That app can burn.

I sympathized with them some, though. I get what they were trying to do in their head, on some level.

If you think the more extreme parts of Lemmy are representative of “everyone around you,” as in the larger public in my life, I don’t even know where to begin with that. We live in different worlds I guess.

I think Lemmy is radicalizing.

It’s not just Lemmy.ml either. I used to love dbz0, almost switched from lemmy.world, but now all the non-political content is withering away, and most of what I see is just absolutist, anarchist post. The admin is fine with explicit calls to violence against pretty much anyone.

And that’s fine. It’s their instance, they can their thing. But it’s so extreme I don’t even find satisfaction interacting with the instance anymore, like it’s a single community with one topic.

And I don’t mean to single them out. I have similar feelings from many instances, including Lemmy.world.

I’ve even seen some pretty extreme stuff on blajah, which I used to picture as a wholesome LGBTQ+ instance! Which I adore… until it’s not so wholesome.

What’s worse, Lemmy users don’t seem to care.

I’ll point out some off-topic discussion in a thread, and I just get piled on. Like, not every single Lemmy conversation has to involve statements about western imperialism or the futility of democracy or whatever, but apparently it does on Lemmy.ml, and it feels like it’s spreading.

That was more of a rant than I intended.

But I am concerned about this new internet place I like. I’ve seen one or two other Reddit clones wither away from political radicalization, too.

Unfortunately condensation is, indeed, an intractable issue there.

Sometimes people put a heat pump in water cooling loops, where condensation along the pipe can be mitigated with insulation, but even that’s a little risky with a 5090 these days.

Enjoy your lovely greenery!

Duct it!

I have a 400W 3090 with zero case fans.

Its always cool, because I bought like $10 of weather stripping to “seal” its intakes against the edge of an SFF case. So it’s always sucking in ambient air:

You can also severely undervolt a 5090 to like 250-300W, with very little performance impact. Honestly its stock speeds are kind of crazy.

…But again, you aren’t gaining much over a 4090. A 4090 + DDR4 threadripper would be way faster than a 5090 + occulink, for many reasons. And TR CPUs are pretty reasonably priced compared to GPUs these days.

But even if you do go 5090, I’d highly recommend finding some way to shove it in the case and duct some air into its intakes. Its going to be way faster on a PCIe slot.

You could even get a riser and mount it somewhere else in the case, theoretically.

First of all, I mean zero offense with any purchase decision. A 5090 is very good.

…But if I were paying that kind of money, I’d probably get a 4090 and a new motherboard/CPU instead. Maybe a used DRR4 threadripper system.

Hybrid (CPU + GPU) inference is where it’s at these days. It opens up a whole world of huge MoE models, whereas on an 5090 you are stuck with Qwen 27B.

Having a fast CPU, with lots of RAM channels, with full PCIe bandwidth is much more important for that than having a 5090, where a 3090 or 4090 will get the job done.

Even if pure speed is your primary concern, you can tune a sparse 120B model (like Laguna) to run almost as fast as Qwen 27B on a 5090, and get at-least-good results.

It’s more finicky and involved, though. For sure.

Running an LLM on a 5090 is a task. Hybrid CPU + GPU inference is a hobby.

Be aware that you pay a significant performance penalty for going over occulink.

The hit modest for fully offloaded dense models (like Qwen 27B), but dramatic for hybrid inference of big MoEs.

Even my old 3090 got a noticeable performance gain going from a PCIe 3.0 x16 riser to a PCIe 4.0 one.

• It’s just under 300B, trained at FP4; absolutely the perfect size for servers with 128GB-192GB CPU RAM to spare.

• Its fast. I’m getting 17 tokens/sec on a single RTX 3090 GPU, all experts offloaded to RAM; for a 300B model this smart, that’s crazy fast.

• Its attention mechanism is cutting edge, good for long context without too much processing time.

• The benchmarks for coding/agenic usage are absolutely bonkers, within margin of error of frontier models or Deepseek Pro in some cases: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731

• …Though I don’t put much stock in benchmarks. And I haven’t tested it enough to tell you if it lives up to that hype for specific use cases.

• Deepseek also publishes its base model. That means I can “unfry” the model with a merge if I have to.

I am afraid of the the model being “overfit” to coding and agenic stuff.

For reference, my previous favorite model was Xiaomi MiMo V2.5 310B. It benched well, but it also smelt “smart” outside of benchmarks, like in knowledge of trivia without tool usage/internet access or comprehension of weird questions.

[AIT] I know this isn’t everyone’s cup of tea, but I’m excited about Deepseek V4 flash. It’s (for me) the perfect size and architecture to self-host an LLM.

My box (and brain) are chugging through a queue:

• Figure out why my swap is going crazy, and how to ban processes from it [Done].

• Figure out why Code OSS is unhappy [Partially Done].

• Make an ik_llama.cpp iMatrix for Deepseek V4 [Done].

• Figure out why quantization isn’t working [Done].

• Make a test IQ2_KL/MXFP4_R8 quant to see how it does squeezed onto my box [in progress].

• Test. Tune. Inevitably troubleshoot the dozen other things that go wrong. Figure out how much spare RAM that leaves me.

• Make a higher quality IQ3_KT quantization. This will take all night on my CPU.

• KLD test both of them vs the full precision, to quantify quantization loss. Likely an overnight task, too.

• Try merging the new model release with the base model, 50/50, for a less “deep fried” model. imatrix, quant, test.

The goal is to host it on a single RTX 3090, Ryzen 7000 with 128GB RAM, for anyone curious. Though I may try smaller models too, like Laguna S1.

Yeah.

For a while, I came here with the attitude of “don’t block anything,” but the politics subs are just too much. It’s not that they post misinformation, but that it’s always at the absolute top of hot/new comments, drowning everything else out.

It still an attention drain for the whole Fediverse.

It’s zero sum: every eyeball on made-up garbage is a someone not engaging with authentic content. And from the looks of things, it’s draining a lot of attention.

It’s easy to say “just deal with it yourself,” and I do, but it’s still not good for the health of content I do see.

It’s definitely been a term for some time. I don’t know who invented it, but I heard it elsewhere.

I love it too.

Also, to add:

Information hygiene here is bad.

Every day, nearly every time I scroll the feed, some spicy headline goes past. When I go to look it up, it’s often completely made-up misinformation, or a warped ragebait headline, or a literally bot-written Tweet, yet it’s voted right to the front page.

…I thought Reddit refugees would be sick of this, and more careful/skeptical, but apparently not. I’ve even talked to some users who don’t understand the distinction between opinion columns and news.

And I had an argument with a mod, who had no problem with an LLM engagement farm Tweet as long as its “the right message.”

On the contrary, I think the impulse to check a user’s post history and judge them is a bad habit on Lemmy.

Take me. Scroll through my history, and you’ll probably peg me as a AI Tech Bro and a… closet neolib, maybe? I dunno. But if it’s along those lines, you could not be more wrong, on either count.

With the exception of extreme trolls (or moderators doing their thing), I think Lemmy’s culture of “purity checks” is poison to the platform. It turns communities insular, toxic, and angry like it does on Reddit, governed by takes that have nothing to do with the particular thread. It kills the focus of communities. It rewards conformance.

And this thread is a good example. I thought OP was raising some good general points, but digging previous comments up threw all that out the window. I’ve seen this happen in other threads, where a technical or fandom discussion devolves into unrelated, raging arguments on something I did not come there to read.