this post was submitted on 12 Jan 2025
658 points (98.0% liked)
Technology
60456 readers
4098 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
As vlc is open source, can we expect this technology to also be available for, say, jellyfin, so that I can for once and for all have subtitles.done right?
Edit: I think it's great that vlc has this, but this sounds like something many other apps could benefit from
It's already available for anyone to use. https://github.com/openai/whisper
They're using OpenAI's Whisper model for this: https://code.videolan.org/videolan/vlc/-/merge_requests/5155
Note that openai's original whisper models are pretty slow; in my experience the distil-whisper project (via a tool like whisperx) is more than 10x faster.
Has there been any estimated minimal system requirements for this yet, since it runs locally?
It's actually using whisper.cpp
From the README:
Memory usage Model Disk Mem tiny 75 MiB ~273 MB base 142 MiB ~388 MB small 466 MiB ~852 MB medium 1.5 GiB ~2.1 GB large 2.9 GiB ~3.9 GiB
Those are the model sizes
Oh wow those pretty tiny memory requirements for a decent modern system! That's actually very impressive! :D
Many people can probably even run this on older media servers or even just a plain NAS! That's awesome! :D
crunchyroll is currently using AI subtitles. it's obvious because when someone says "mothra. Funky..." it captions "mother fucker"
That explains why their subtitles have seemed worse to me lately. Every now and then I see something obviously wrong and wonder how it got by anyone who looked at it. Now I know why. No one looked at it.
my wife and I love laughing at the dumbass mistakes it makes.
some characters name is Asura Halls?
instead of "That's Asura Halls!" you get "That asshole!"
but if I was actually hearing impaired I'd be really pissed that I'm being treated as second class even though Sony still took my money like everyone else.
Malevolent Kitchen Intensifies
I hope it's available for Stash App. I wanna know what this JAV girls are saying.
( ͡° ͜ʖ ͡°)
In the *arr suite, bazarr has a plugin called Subgen which you can add and you can set it to generate subtitles on your entire library if you want, or only missing subtitles. The sync is spot on compared to 90% of what Opensubtitles delivers. I sometimes re-gen them with this plugin just because opensubtitles is so constantly out of sync (e.g. highly rated subtitles 4 lines will be at breakneck pace and the next 10 will be super slow and then everything is 3 seconds off)
It isn't in-player but it works. The downside is it is a larger model and takes ~20 minutes to generate a movie length of subtitles.
Ooooh I like this