Road Map

Sock Road Map

Just Down The Road

• Documentation
• ComfyJS chat integration so the puppet can read from and respond to Twitch stream chats.
• Ollama support as an alternate LLM source than OpenAI's ChatGPT.

Enhancements To Look At

• An expanded personality trait editor to provide more complex personality traits and responsiveness from the bot.
• Additional speech synthesis options.
• Replacing react-mic with a better audio capture package. (Possibly with use-whisper or something similar).
• More natural transcription timing, including the ability to sense pauses (and stop sending to transcription to prevent Whisper from hallucinating text) as well as updating the transcription each time you pause to capture whole sentences at once.
• ChatGPT streaming mode support to decrease LLM response times.

Aspirations Farther Out

• An executable program version of the application.
• More to come