Other Languages ?

[Alekksander66]

Hello, is there a way that this model will support other languages ?

Do you have informations regarding RTF ?

[mogwai]

RTF varies on different gpus. On the 4090 I've got as high as 12x RTF

[mogwai]

Will will support other langauges

[Alekksander66]

Great, thanks ! Will you provide the trainings scripts also ? If yes, do you know when ?
Also, may i know which TTS are you using ?
Cant wait to try it with french !

[mogwai]

No planning to release training code as that wouldn't be that useful for a variety of reasons as you'd need several very important parts to train this model.

What do you mean what TTS are we using?

French definitely on the roadmap

[Alekksander66]

Ok great then, sorry for the last question i was tired, it's obviously your technology
I was just wondering from which base Text To Speech you started to get those results

Will we be able to finetune it or, directly clone voices ?

[mogwai]

There is no base, this was trained from scratch.

Yeah you clone voices now by running the demo.py

[Alekksander66]

OK great tank you very much !

[thewh1teagle]

Hi, very impressive work!
Any chance you can add Hebrew support?
Also, is the model trained on text or phonemes? Recently I wrote bert based G2P for Hebrew so maybe we can fine tune on that (almost all Hebrew phonemes exists in English). I also released 2 hours of clean speech with hand annotated text/phonemes

If the model is not trained on phonemes, I wonder how smart he is in matter of context - written Hebrew has a lot of missing phonetics (much more than English) and every word sounds depends on the whole sentence context. but large models like of Google was able to learn it almost perfectly

[mogwai]

At the moment we don't support other langauges or finetuning to new ones.

We're looking to support other langauges in the future!

The model is not trained on phonemes, I'm sure that the technique we use would work with hebrew! :)

[wenbindu]

So great work. Can I get the moment or schedule for other languages?