Road Map

Sock Road Map

Just Down The Road

• Documentation
• Multiple profiles for the settings to allow the storage of different puppets.
• Twitch.JS chat integration so the puppet can read from and respond to Twitch stream chats.
• A TTS mode where either the chat through redeems or the user can make the puppet speak typed text.
• GPT4All support as an alternate LLM source than OpenAI's ChatGPT.
• Including more Coqui-AI supported models in the speech synthesis options.

Enhancements To Look At

• Replacing react-mic with a better audio capture package. (Possibly with use-whisper or something similar).
• More natural transcription timing, including the ability to sense pauses (and stop sending to transcription to prevent Whisper from hallucinating text) as well as updating the transcription each time you pause to capture whole sentences at once.
• ChatGPT streaming mode support to decrease LLM response times.

Aspirations Farther Out

• An expanded personality trait editor to provide more complex personality traits and responsiveness from the bot.
• More to come