29
Random crashes on my machine
(jlai.lu)
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
Get your AI tool to write its output to a log on disk.
Get another program to log ram and vram usage periodically as well.
As my top suspicion is your application has a memory leak, like many such applications do, and it just gets the system to hang when it runs too long.
There are ways to fix this too, like PyTorch allocation variables, inserting some manual garbage collection, or just periodically restarting it.