Text-to-speech/speech-to-text

[omolewah]

Good day,

I am building a chatbot into my web app on anvil. I need help with text-to-speech and speech-to-text. I will really appreciate any simple example…

Thank you

[josemari.taleno]

Welcome @omolewah! Haven’t done something like that yet. But Anvil has lots of packages available for free!

[meredydd]

Hi @omolewah, and welcome to the forum!

To use speech synthesis and recognition from the browser, you’ll need to interface with Javascript and use the browser’s SpeechRecognition and SpeechSynthesis interfaces.

You can learn more about using Javascript from Anvil here:

https://anvil.works/docs/client/javascript

And you can learn more about the web speech APIs from Mozilla here:

SpeechRecognition

---

As we’re still on our holiday break, I’m going to resist the temptation to put together a demo. But if someone feels inspired to wrap this up into a library that can be imported as an Anvil dependency, that would make a very worthy contribution to the Anvil Library!

[codeman]

Besides the javascript, is this all there is to text-to-speech? See top image.
If I just want to experiment with it in the Anvil designer without publishing, do I still need to use javascript?
I can’t find much on the web about how to use javascript to interface for python for tts.
What about Pyttsx? I have the code on the bottom, it seems very simple. I tried “import pyttsx” in the anvil designer, it said no such module.

[stucork]

You could definitely work out how to record the audio on the client and then send that to a server module, then handle the speech recognition in python

You might find this related post useful

Converting audio file to text

Hi @soadadfarhan, The second example on the speech_recognition home page looks like it would do what you want. In particular, it seems that you need to ‘record’ the contents of the audio file using the Recognizer: r = sr.Recognizer() with anvil.media.TempFile(AudioFile) as file_name: with sr.AudioFile(file_name) as source: audio = r.record(source) response = r.recognize_google(audio) Hopefully that should do roughly what you want! If you still see errors, then @stuco…

Here is a small example that takes the example script from MDN
and makes it python/anvil using https://anvil.works/docs/client/javascript
(It only works on Chrome)

Login

[CyCy]

Stu - could you make a quickie example of how Anvil can speak “Hello World” or point me in the right direction? I am also trying to get Anvil to talk ! Thank you!

[stucork]

Here’s a quick demo of text to speech

it uses the demo from MDN as a reference:

Login

And here’s the live app:

Forum Text to Speech

[CyCy]

wow thank you Stu - going through this app now - amazing!

[CyCy]

Which dependency is it trying to load? Seems to be trouble…

[stucork]

Sorry about that - try now - should be fixed

[CyCy]

this is awesome - works perfectly… thanks again Stu!