Selfhosted

61003 readers

310 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

ROCm on older generation AMD gpu (sh.itjust.works)

submitted 6 months ago by roundup5381@sh.itjust.works to c/selfhosted@lemmy.world

23 comments fedilink hide all child comments

I'm curious if anyone has had much luck leveraging older AMD hardware to use ROCm, I have an 6700 xt that I've just begun inquiring about, and it seems it falls outside of official support.

Right now I intend to pass it through to my Debian Docker VM to support transcoding in some containers in addition to machine learning applications.

you are viewing a single comment's thread
view the rest of the comments

[–] panda_abyss@lemmy.ca 1 points 6 months ago (3 children)

God after buying an amd machine last year I'm never doing it again.

What are you trying to use rocm for? Their own guides don't work.

[–] despoticruin@lemmy.zip 2 points 6 months ago (1 children)

Their guides specifically call for an exact kernel version, distribution, and hardware. If you are trying to operate outside of the official requirements then it shouldn't come as a surprise when the official documentation doesn't work for you.

[–] panda_abyss@lemmy.ca 0 points 6 months ago

do you know how insane it is their official guides don’t work with kernel point updates?

https://github.com/ROCm/ROCm/issues/5824

This has been an issue for a long time.

I have to maintain a file of which specific kernel+os+firmware versions I’m on and have downgraded to just to get the most popular ML library in the world to du a matrix multiply.

I don’t get how this bug gets into production branch, let alone shipped requiring firmware downgrades, on their new line of GPUs/chips. How do they not test their latest hardware with their own firmware?

[–] roundup5381@sh.itjust.works 1 points 6 months ago (1 children)

mostly it is the hardware I have on hand; first project in mind is ROCm machine learning for immich. after that it's pretty much trying to understand the technology, I'm sure I'll come up with something fun.

[–] panda_abyss@lemmy.ca 3 points 6 months ago (1 children)

I don’t know how the immich ml works, but if you’re going LLMs stick to llama.cpp.

going beyond that, I’ve had serious kernel bugs with PyTorch and onnx that are still unresolved. The most popular ML/AI frameworks basically don’t work due to drivers for me.

Vulkan flows are fine and generally comparable in speed so far, so if there’s a vulkan option try rock first then revert to vulkan.

[–] roundup5381@sh.itjust.works 1 points 6 months ago

thanks for the heads up, in truth I'd probably be headed to vulkan now if it were compatible with immich. I'll put llama.cpp on my radar.