Recent searches
Search options
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching! The quality is pretty impressive for open source, and it even supports mps for Mac! I was able to get it going on my Mac with no problem. #TTS #ML #AI
https://github.com/SWivid/F5-TTS
@ZBennoui
@esoteric_programmer @chikim @ZBennoui
It converts the following text:
Every time I see someone light up, um, because of something I’ve made, it’s like, wow, a little piece of my inner child gets healed, you know? And, um, when...snip
To the attached speech.
@esoteric_programmer @chikim @ZBennoui
You can easily plug this into an open-source LLM and get something akin to NotebookLM.
Totally free and open-source, with very high quality.
@mush42 @chikim @ZBennoui so, this does text completion and then generates speech using something like tts? is that correct so far? or do you attach audio of something, the model transcribes it and gets its meaning in whatever way that's considered meaning anyway, then concatenates your prompt text to that? that could create so, so many deepfakes, it's not even funny, if what I'm imagining is actually what's happening
@mush42@hachyderm.io@esoteric_programmer @chikim @ZBennoui
Other than the text completion part, you are almost correct.
You give it some text, and an audio sample, and it tries to replicate the given voices characteristics.
Research is active in the areas of speaker verification and audio deep fake detection to combat misuse.
@esoteric_programmer @chikim @ZBennoui
Yes that's how you'd do it.