1160
you are viewing a single comment's thread
view the rest of the comments
[-] merc@sh.itjust.works 1 points 37 minutes ago

NPUs are low-power hardware devices for running very small AI models.

So-called "GPU"s are the devices used for similar things for the very large models that are the "hotness" right now.

A general purpose GPU still contains silicon for display, and video en/decoding

No it doesn't. The modern datacenter-style "GPU"s that nVidia has been making and selling for use in AI datacenters have stripped out all the video related elements. They're purpose built for doing only AI work these days. They can't even do standard matrix multiplication work anymore because they're so narrowly designed for AI models where they use a specialized form of lossy matrix multiplication.

The name has stuck around, but the things nVidia has been building and selling to the AI companies no longer has anything to do with graphics.

this post was submitted on 22 Sep 2026
1160 points (98.7% liked)

Funny

16272 readers
1904 users here now

General rules:

Exceptions may be made at the discretion of the mods.

founded 3 years ago
MODERATORS