34

Are there any free/open-source TTS options out there that are on the same level as Google Cloud's? I tried a lot of free ones, but they are absolutely awful and still sound like my Amiga did 30 years ago. With LLMs being available as open source, I am hoping there's also a good TTS offering I just haven't found yet.

you are viewing a single comment's thread
view the rest of the comments
[-] tal@lemmy.today 11 points 2 years ago* (last edited 2 years ago)

Festival -- not cutting edge -- will definitely be better than your Amiga, and can handle long text. Last time I set it up, IIRC I wanted some voices generated by Tokyo University or something, which took some setting up. It'll probably be packaged in your Linux distro.

You can listen to a demo here.

https://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html

It's not LLM-based.

For short snippets, offline, one can use Tortoise TTS -- which is LLM based. But it's slow and can only generate clips of a limited length. Whether it's reasonable for you will depend a lot on your application. It will let one clone -- or make a voice sounding more-or-less similar -- a voice using some sound samples from them speaking.

https://github.com/neonbjb/tortoise-tts

Examples at:

https://nonint.com/static/tortoise_v2_examples.html

I haven't used Google's, but I'd assume, given that Google is paying people to work on it full time, that whatever they've done probably sounds nicer. But, then not open source, so...shrugs

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn't try it. Festival I tried and the results were bad. Not so much for the voice, but for intonation and pronunciation.

[-] tal@lemmy.today 4 points 2 years ago* (last edited 2 years ago)

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn’t try it.

I use it on an AMD GPU.

EDIT: Wait, let me make sure. I was using an Nvidia GPU for a while and switched to AMD.

EDIT2: Oh, yeah, it uses transformers, and that doesn't work on rocm presently, IIRC.

this post was submitted on 13 Nov 2023
34 points (90.5% liked)

Selfhosted

62096 readers
116 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS