You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
I am working on a chatbot interface and a typical user request is to be able to just talk instead of typing. Holoviz has the SpeechToText widget, but it is currently not-so-easy to integrate into ChatInterface. (Or at least, when I've tried, I've had to do plenty of workarounds, I may be doing something wrong).
Using SpeechToText has the advantage of being free (mostly), and is already integrated in the browser.
Bonus: Reading out loud text would be interesting too given there is a TextToSpeech widget too. Maybe a little button next to the chat messages.
Describe the solution you'd like
I would like to have, next to the text input a microphone icon to give speech input, and that the recognized text would appear in the text input (extra cool if the recognized text appears as it is being transcribed? I think that depends on the browser, if it is even supported). Autosend should be optional.
Describe alternatives you've considered
Using third party services (marvin was mentioned in this thread) can be used, however, this implies that by default you must be running the app in the same computer with the microphone.
Otherwise, recording with JS browser APIs and sending it to some service (be it local or cloud) would be a good alternative too. The examples found in this thread seem good: https://stackoverflow.com/questions/16413063/html5-record-audio-to-file However, I'm not versed enough with JS, and new to Panel, to be able to do this myself at the moment.
Additional context
My workarounds make it look like this, which is more or less what I would expect:
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
I am working on a chatbot interface and a typical user request is to be able to just talk instead of typing. Holoviz has the SpeechToText widget, but it is currently not-so-easy to integrate into ChatInterface. (Or at least, when I've tried, I've had to do plenty of workarounds, I may be doing something wrong).
Using SpeechToText has the advantage of being free (mostly), and is already integrated in the browser.
Bonus: Reading out loud text would be interesting too given there is a TextToSpeech widget too. Maybe a little button next to the chat messages.
Describe the solution you'd like
I would like to have, next to the text input a microphone icon to give speech input, and that the recognized text would appear in the text input (extra cool if the recognized text appears as it is being transcribed? I think that depends on the browser, if it is even supported). Autosend should be optional.
Describe alternatives you've considered
Using third party services (marvin was mentioned in this thread) can be used, however, this implies that by default you must be running the app in the same computer with the microphone.
Otherwise, recording with JS browser APIs and sending it to some service (be it local or cloud) would be a good alternative too. The examples found in this thread seem good: https://stackoverflow.com/questions/16413063/html5-record-audio-to-file However, I'm not versed enough with JS, and new to Panel, to be able to do this myself at the moment.
Additional context
My workarounds make it look like this, which is more or less what I would expect:
The text was updated successfully, but these errors were encountered: