Yeah.

Don’t get me wrong, I don’t want to touch projects vibe coded to this level, going solely on past experience with them.

But I am scientifically curious about its functionality.

Yeah, in that case it’s sus. I’d be scared to look at the codebase.

Does it actually work, though?

Oh yeah… yeah, it doesn’t seem like it’s client/server or anything. It’s just a CAD program?

Doesn’t fit this at all.

I dunno if it fits the “vibe coded” label though, as it appears to work well. I tend to apply that to quick hacks, or to projects where the devs clearly have no idea what they’re doing (and end up with something really bloated and janky, yet hyped a ton).

Why is a post about a CAD program being downvoted so much?

I mean… it’s an issue. OP’s system is swapping the SSD when it clearly should not be doing it. My system had horrible usability issues in some scenarios without a lot of reconfiguration, and thrashed my SSD for no benefit.

The default heuristic is not good for our systems, and OP’s situation is a pretty common scenario. That’s a fact. How is that not an issue?

And support for TRIM and whatever else was added for SSD support is not really the issue, here. That’s working fine.

I disagree with most here.

You need to reduce swappiness even more, and tweak some other variables (like the memory “threshold” Linux starts to swap, and disk cache aggressiveness) to stop Linux from swapping so opportunistically under such a light load.

IMO, Linux is configured for “old” systems by default: slow HDDs, and constrained RAM pools, where disk IO really, really needs caching, and where idle background processes take a large fraction of RAM.

You have superfluous RAM for your workload. And very fast disk IO that isn’t such a hindrance to apps anyway. And a disk you don’t want to wear. This is the opposite scenario: you don’t want Linux to swap unless it absolutely has to.

For reference, this is part of my config. It’s rather niche and you probably shouldn’t use it, but you should consider looking up the variables:

# Keep min reserve reasonable for 8GB usable space
vm.min_free_kbytes = 262144        # Lower absolute minimum to 256MB

vm.watermark_scale_factor = 10     # Lower to 0.1% (which is ~128MB on 128GB)

# Disable watermark boosting completely
vm.watermark_boost_factor = 0

# Normal-ish metadata pressure so desktop doesn't stutter on disk reads
vm.vfs_cache_pressure = 120

# Allow reasonable swapping of inactive anonymous desktop pages, could be lower
vm.swappiness = 10

# Dirty bytes limits to limit caching
vm.dirty_background_bytes = 67108864
vm.dirty_bytes = 268435456

# Disable compaction & proactive scans to stop freezing with large portions of RAM mlocked
vm.compaction_proactiveness = 0
vm.compact_unevictable_allowed = 0

vm.page-cluster = 0 # 4kb pages for SSD

My system still uses RAM as disk cache with this config, it just won’t go out of its way to swap just to keep that cache, especially I lower swappiness to 1-3.

I also have a 1GB zram pool, prioritized over ssd swap. But you should make yours even larger (maybe 4GB?). This will intercept anything that does swap first.

I also start some applications with systemd-run and specify memory caps and swap limits (often forbidding them from swapping entirely).

It makes a night-and-day difference for some workloads on my system, that would otherwise swap pointlessly, just tank performance and even de-stabilize the system.

I mean, practically? Orion’s Arm.

Taking care of humanity is literally trivial.

There’s a big soup of civilizations and frontiers and mysteries to explore. Some danger to keep it interesting. Infinite and transcendental pleasure to experience, entire simulated worlds you can try.

But it’s grounded in real physics, so you don’t get that big can of worms from living in a universe that isn’t… self-consistent.

In other words, its as sci-fi as you can possibly get without things getting timey wimey.

But my adventure-yearning-heart says Avatar.

Bending is just so freaking cool. It’s the best magic system ever.

Also, I would contest this:

Never before has the government had so much power.

I feel that the legitimacy of governments is collapsing and power is going to corporations, in a hurry.

In other words, we got so busy worrying about direct government spying we let a handful of corporations completely take over the information sphere, instead.

I’m rewatching Person of Interest, and it hits so different now.

That post 9/11, Snowden, surveillance-state-fear era almost feels… quaint.

At 25? Where I settled now.

• Religion can provide a loving, peaceful philosophical framework to live by. Some of the most wholesome, kind, generous people I’ve known are devout.

• People’s brains are all wired differently, and this works well for some.

• It’s cultural. You can’t just throw away that huge part of someone’s background

But.

• Some of the most unspeakable things in my personal life happened in the name of religion.

• Ive seen it ruin families, and kick rationality out of groups and instill hate in its place. Not in news feeds; with my own two eyes.

• What’s more, some religions reinforce idolization and “worship” of people, which is extremely dangerous.

So I’ve settled on this:

• …I respect other people’s faith, especially in people I respect in person. People do what they do, you know? They have their own perspective of the world, and I’m not going to presume to know better.

• And I keep in mind that religion is more philosophical for many. And that kind, devout people won’t push it on you.

• But I am under no obligation to share it. I’m sure as hell going to push back against idol worship, anti-science thinking, bigotry, political cultism and so on, but not cross the line to their belief in God or the afterlife or whatever.

• …And I have no interest in it myself. It doesn’t fit my brain.

This was a journey, though. For a long time I was an “apathetic Christian” because it felt like an obligation, even though Christianity made no sense to my systemic view of the world. I would have never dared admit I was agnostic or atheist when I was 18, not even to myself.

Good to know, thanks.

I mean, whatever “hip” is, I am the farthest thing from that.

I was thinking it was part of my… more antisocial tendencies.

I feel like an alien in these comments.

I… “subscribe” to YouTubers. But I watch videos à la carte, only if the subject seems interesting.

I don’t follow them.

I sympathize when they open up about personal stuff mid-video, but that aside I have zero interest in their lives/feed. Why should I? I don’t have a relationship with them.

So I never had the chance to drop any because I don’t follow them in the first place.

…Is this a neurodivergence thing?

I feel like it is.

???

Unfortunately condensation is, indeed, an intractable issue there.

Sometimes people put a heat pump in water cooling loops, where condensation along the pipe can be mitigated with insulation, but even that’s a little risky with a 5090 these days.

Enjoy your lovely greenery!

Duct it!

I have a 400W 3090 with zero case fans.

Its always cool, because I bought like $10 of weather stripping to “seal” its intakes against the edge of an SFF case. So it’s always sucking in ambient air:

You can also severely undervolt a 5090 to like 250-300W, with very little performance impact. Honestly its stock speeds are kind of crazy.

…But again, you aren’t gaining much over a 4090. A 4090 + DDR4 threadripper would be way faster than a 5090 + occulink, for many reasons. And TR CPUs are pretty reasonably priced compared to GPUs these days.

But even if you do go 5090, I’d highly recommend finding some way to shove it in the case and duct some air into its intakes. Its going to be way faster on a PCIe slot.

You could even get a riser and mount it somewhere else in the case, theoretically.

First of all, I mean zero offense with any purchase decision. A 5090 is very good.

…But if I were paying that kind of money, I’d probably get a 4090 and a new motherboard/CPU instead. Maybe a used DRR4 threadripper system.

Hybrid (CPU + GPU) inference is where it’s at these days. It opens up a whole world of huge MoE models, whereas on an 5090 you are stuck with Qwen 27B.

Having a fast CPU, with lots of RAM channels, with full PCIe bandwidth is much more important for that than having a 5090, where a 3090 or 4090 will get the job done.

Even if pure speed is your primary concern, you can tune a sparse 120B model (like Laguna) to run almost as fast as Qwen 27B on a 5090, and get at-least-good results.

It’s more finicky and involved, though. For sure.

Running an LLM on a 5090 is a task. Hybrid CPU + GPU inference is a hobby.

Be aware that you pay a significant performance penalty for going over occulink.

The hit modest for fully offloaded dense models (like Qwen 27B), but dramatic for hybrid inference of big MoEs.

Even my old 3090 got a noticeable performance gain going from a PCIe 3.0 x16 riser to a PCIe 4.0 one.

• It’s just under 300B, trained at FP4; absolutely the perfect size for servers with 128GB-192GB CPU RAM to spare.

• Its fast. I’m getting 17 tokens/sec on a single RTX 3090 GPU, all experts offloaded to RAM; for a 300B model this smart, that’s crazy fast.

• Its attention mechanism is cutting edge, good for long context without too much processing time.

• The benchmarks for coding/agenic usage are absolutely bonkers, within margin of error of frontier models or Deepseek Pro in some cases: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731

• …Though I don’t put much stock in benchmarks. And I haven’t tested it enough to tell you if it lives up to that hype for specific use cases.

• Deepseek also publishes its base model. That means I can “unfry” the model with a merge if I have to.

I am afraid of the the model being “overfit” to coding and agenic stuff.

For reference, my previous favorite model was Xiaomi MiMo V2.5 310B. It benched well, but it also feels “smart” outside of benchmarks, like in knowledge of trivia without tool usage/internet access or comprehension of weird questions.

[AIT] I know this isn’t everyone’s cup of tea, but I’m excited about Deepseek V4 flash. It’s (for me) the perfect size and architecture to self-host an LLM.

My box (and brain) are chugging through a queue:

• Figure out why my swap is going crazy, and how to ban processes from it [Done].

• Figure out why Code OSS is unhappy [Partially Done].

• Make an ik_llama.cpp iMatrix for Deepseek V4 [Done].

• Figure out why quantization isn’t working [Done].

• Make a test IQ2_KL/MXFP4_R8 quant to see how it does squeezed onto my box [in progress].

• Test. Tune. Inevitably troubleshoot the dozen other things that go wrong. Figure out how much spare RAM that leaves me.

• Make a higher quality IQ3_KT quantization. This will take all night on my CPU.

• KLD test both of them vs the full precision, to quantify quantization loss. Likely an overnight task, too.

• Try merging the new model release with the base model, 50/50, for a less “deep fried” model. imatrix, quant, test.

The goal is to host it on a single RTX 3090, Ryzen 7000 with 128GB RAM, for anyone curious. Though I may try smaller models too, like Laguna S1.