-
Notifications
You must be signed in to change notification settings - Fork 4.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] Letter-by-letter pronunciation not possible #2619
Comments
It is possible but needs a model that is capable of doing that. I close this since it is not a dev issue. |
The output is fine with the Espeak doesn't know about other letter sequences, like "ARD" or "ABCDEFGHIJKLMNOPQRSTUVWXYZ", and tries to read them as a word. I can force it to phonemize them as letter sequences by adding periods between each letter, but Coqui strips all punctuation before calling Espeak. Changing TTS/TTS/tts/utils/text/phonemizers/base.py Line 104 in bc0a532
return [text], [] fixes this and results in correct letter-by-letter output for "A.R.D" and "A.B.C.D.E.F.G.H.I.J.K.L.M.N.O.P.Q.R.S.T.U.V.W.X.Y.Z". But I'm not sure if there is a specific reason that Coqui strips the punctuation there and changing it wouldn't cause other issues?
|
Previously, the text was wrapped in an additional set of quotes that was passed to Espeak. This could result in different phonemization in certain edges and caused the insertion of an initial separator "_" that had to be removed. Compare: $ espeak-ng -q -b 1 -v en-us --ipa=1 '"A"' _ˈɐ $ espeak-ng -q -b 1 -v en-us --ipa=1 'A' ˈeɪ Fixes coqui-ai#2619
Previously, the text was wrapped in an additional set of quotes that was passed to Espeak. This could result in different phonemization in certain edges and caused the insertion of an initial separator "_" that had to be removed. Compare: $ espeak-ng -q -b 1 -v en-us --ipa=1 '"A"' _ˈɐ $ espeak-ng -q -b 1 -v en-us --ipa=1 'A' ˈeɪ Fixes #2619
Describe the bug
I'd like to force the TTS model to pronounce a word letter by letter, e.g. "ARD" should be pronounced "A R D" (/ˌeɪˌɑːɹdˈiː/). In systems with SSML support (#752) you could use
<speak><say-as interpret-as="verbatim">ard</say-as></speak>
, but another way would be fine as well.Espeak supports this even for words not in its dictionary by adding periods between the characters:
espeak-ng --ipa -v en-us "A.R.D."
is read /ˌeɪˌɑːɹdˈiː/.This doesn't work in Coqui because the input for Espeak is split at punctuation characters and each chunk
["A", "R", "D"]
is phonemized separately:TTS/TTS/tts/utils/text/phonemizers/base.py
Line 129 in bc0a532
This results in the word, not the letter pronunciation of "a" being chosen (ɐ instead of eɪ). I could change
_phonemize_preprocess()
to pass the input to Espeak with punctuation included, but I'm not sure about the side effects. Is there a specific reason to do it this way?To Reproduce
Output:
'ˈɐ.ˈɑːɹ.d|ˈiː.'
Expected behavior
Expected output:
ˌeɪˌɑːɹdˈiː
Logs
No response
Environment
Additional context
No response
The text was updated successfully, but these errors were encountered: