28
submitted 10 hours ago by achille225@jlai.lu to c/linux@lemmy.ml

Hello everyone,

I have an issue with my desktop, which I really don't understand.

It is a desktop PC, with a Nvidia GPU, which I use for development (of AI, but like the image analysis part, not the slop part). I usually let it always run, and my previous machine was working fine like this.

However, on this machine, I get crashes after either a few days or a few weeks.

These "crashes" are weird : the machine is still up (and I can ping it), however I can't ssh into it, I can't connect to cockpit either, and can't login physically on it (the display is frozen).

The only way to get it back up is to forcefully shut it down, wait a little and then powr it back up; but this isn't ideal, since it interrupts computations etc

The only crashes shown in journalctl are related to irrelevant (I believe) programs : KDEConnect, DrKronqi, etc; nothing right before the crash.

Do you have any idea what could cause this ?

I tried logging temperatures, but nothing abnormal showed up. I ran memtest86+, nothing showed up either. Smart tells me everything is alright for my drives as well.

Right now I'm thinking about changing the alimentation or the motherboard, but frankly I don't know what's going on and it's really puzzling me.

top 17 comments
sorted by: hot top new old
[-] brucethemoose@lemmy.world 1 points 21 minutes ago* (last edited 21 minutes ago)

Get your AI tool to write its output to a log on disk.

Get another program to log ram and vram usage periodically as well.

As my top suspicion is your application has a memory leak, like many such applications do, and it just gets the system to hang when it runs too long.

There are ways to fix this too, like PyTorch allocation variables, inserting some manual garbage collection, or just periodically restarting it.

[-] eldavi@lemmy.ml 1 points 25 minutes ago

does the caps lock or num lock lights not light up when you're in this situation.

if no: then you must go through the logs to figure out your problem.

if yes: then your system is in a recoverable state and there are many actions you can to take other than a forced reboot.

if it's headless, plug in a keyboard.

[-] fozid@lem.radiantfig.fyi 5 points 6 hours ago

without knowing what you are running and your hardware, it's hard to say. The symptoms sound similar to when I was running AI on a small server with 32gb ram only, and I hot oom, I'd be able to ping it but nothing else would work and would require a hard reset.

[-] Buffalox@lemmy.world 12 points 9 hours ago

Sounds like a long tedious elimination process is ahead.
But since the only errors you get regard KDE, I'd try installing another desktop environment. Afterwards you can generally choose which desktop to log into at the login screen. And when it's resolved whether or not KDE is the problem, you can easily switch back if you want. So it's very easy to try.
But each elimination will take 5 days!! If the computer behaves the same each time it crashes, it is definitely NOT random. If it was random it would be different things each time, and then it could be RAM or even CPU problems. But this sounds like a software problem.

[-] achille225@jlai.lu 2 points 9 hours ago

Thank you for your answer ! I'll try it (nothing to lose), but more often than not I don't login to the desktop; but maybe de login screen is enough ? I don't know, I'll try using gnome anyway.

[-] bad1080@piefed.social 1 points 22 minutes ago

i'd be interested in how that goes!

[-] akunohana@piefed.blahaj.zone 10 points 10 hours ago

I've had similar issues when I ran out of system memory. It also didn't leave any traces in the journaling program, but I think it did say something about it in dmesg. Not sure though. But since you're probably using the VRAM and not the RAM, maybe this isn't it at all? Just spitballing.

[-] BananaTrifleViolin@lemmy.world 6 points 9 hours ago* (last edited 9 hours ago)

Well drkronqi is a crash handler, and KDE connect has its fingers in multiple pies? You say theyre not relevant but who do you know when the crash is, if you only notice it when you try to use the PC and its unresponsive? I wouldn't dismiss the timing of these crashes if you can't say exactly when it stopped functioning. They may even by symptoms if not the actual cause.

I'd start by increasing the logging levels to make them more detailed. You change the kernel and system logs to make them more detailed - how will differ slightly on your distro but essentially you want debug level system logs and lowest severity kernel logs. You can also setup some extra logging such as outputting system memory and vram usage to a dedicated file every second or so. This will.give you more information to hunt for the culprit.

As others have said, my first thought from your useage and description is a memory issue. That could be RAM or vram - especially with the AI useage. I'd start by logging both to their own files; out of memory can crash without much trace if the logs aren't tracking the right things.

Also whatever process you are using - your AI tool for example - get that logging too.

[-] aSaabD00d@lemmy.today 6 points 9 hours ago* (last edited 9 hours ago)

I had a similar issue on bazzite and I think it had to do with the Out Of Memory service. This link might help if that's it.

Disclaimer* if you look at my account I have mentioned that I only joined linux this year and have only distro hopped once so beyond this post I can't really offer much assistance.

[-] Damage@feddit.it 1 points 6 hours ago

Is it a Ryzen CPU? Do you have data fabric sync flood errors in the journal?

[-] custard_swollower@lemmy.world 3 points 9 hours ago

I did have an old laptop with bad SSD that would have similar problem - cannot ssh, but can ping, and desktop quickly gets unresponsive.

On root device issues kernel remounts root drive to read-only, and that breaks everything, but the machine still works - yet you get no logs because /var/log is also read-only.

I did some googling and it seems SSH requires writable /tmp, so you might setup some in-memory one, if you haven’t already - you could check if your machine uses tmpfs (in-memory tmp) to reject this hypothesis.

[-] bad1080@piefed.social 2 points 9 hours ago

i am going to follow this as i am having a similar issue (on multiple distros even and with nothing helpful in the journal either). i went as far as to replace the entire PC, suspecting a hardware issue (it was still under warranty) but the problem remained the same.
all i could find on the internet is it may be related to a combination of wayland and KDE plasma iirc. i deactivated stuff recommended by users and tried other suggestions but nothing ever resolved the issue. i have a feeling it has to do with certain updates after which the issue ebbs and flows but this might just be because the problem only occurs randomly in the first place, so this is an entirely "vibes based observation".
my issue is definitely not an out of memory issue as i had btop open when it crashed and it showed memory usage of ~60%.

[-] CameronDev@programming.dev 2 points 9 hours ago
[-] achille225@jlai.lu 4 points 9 hours ago* (last edited 9 hours ago)

64G RAM, 8G Swap (i bought it about 2 years ago, and it's worth a lot more now...)

[-] CameronDev@programming.dev 2 points 4 hours ago

64GB sounds plenty, but is there perhaps a slow men leak in a process?

Leave your PC running, run this in a terminal, and leave it:

watch -n 3600 "date >> logfile.txt; free -m >> logfile.txt"

Its a script that writes the time, and then the memory stats to logfile.txt.

Let it run until the PC stops responding, and then leave the PC a couple more hours.

When you reboot, have a look at the logfile, and see if the memory was growing at all. Also see if you get any date stamps after the PC stopped responding, because that might mean it was not fully crashed.

If it is a memory leak, the next step would be narrowing down which process.

[-] eleijeep@piefed.social 0 points 9 hours ago
[-] bad1080@piefed.social 1 points 19 minutes ago

I ran memtest86+, nothing showed up either.

this post was submitted on 12 Nov 2026
28 points (93.8% liked)

Linux

68712 readers
542 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 7 years ago
MODERATORS