Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation instead of Wakeword with StreamAssist is working #52

Open
Coketrd opened this issue Sep 28, 2024 · 3 comments
Open

Conversation instead of Wakeword with StreamAssist is working #52

Coketrd opened this issue Sep 28, 2024 · 3 comments
Labels
question Further information is requested

Comments

@Coketrd
Copy link

Coketrd commented Sep 28, 2024

Hi Alexx,

i combined youre great StreamAssist (thanks for this great integration) with my mp3-time-extract-script.
Now its possible to do a normal conversation with the StreamAssist instead of needing everytime a wakeword.
the conversationmode can be activated and disabled.
But i have one thing i cant found to make the conversation better. How i can make the listentime by the sst start longer? Because now we must react very fast after the beep sound. And maybe i can delete the another beep by conversation mode then.

if my solution is finish i will share it.

Thanks for youre help.

@Coketrd Coketrd changed the title Conversation without a wakeword possible? Conversation instead of Wakeword with StreamAssist is working Sep 29, 2024
@AlexxIT AlexxIT added the question Further information is requested label Oct 6, 2024
@AlexxIT
Copy link
Owner

AlexxIT commented Oct 6, 2024

StreamAssist does not have its own conversation logic. It simply invokes the Home Assistant's built-in mechanics.
It's pretty hard to get involved there:

pipeline_input = PipelineInput(
run=pipeline_run,
stt_metadata=stt.SpeechMetadata(
language="", # set in async_pipeline_from_audio_stream
format=stt.AudioFormats.WAV,
codec=stt.AudioCodecs.PCM,
bit_rate=stt.AudioBitRates.BITRATE_16,
sample_rate=stt.AudioSampleRates.SAMPLERATE_16000,
channel=stt.AudioChannels.CHANNEL_MONO,
),
stt_stream=stt_stream,
intent_input=assist.get("intent_input"),
tts_input=assist.get("tts_input"),
conversation_id=assist.get("conversation_id"),
device_id=assist.get("device_id"),
)

@Coketrd
Copy link
Author

Coketrd commented Oct 6, 2024

StreamAssist does not have its own conversation logic. It simply invokes the Home Assistant's built-in mechanics. It's pretty hard to get involved there:

Yes, unfortunately I have already noticed that. In this fork here they reached this step. but unfortunately without the wakeword detection inside. https://github.com/asmsaifs/StreamAssist
i tried to combined it but i havent enough knowledge to integrated the wakeword there.
thanks for youre replay.

@Coketrd
Copy link
Author

Coketrd commented Oct 7, 2024

I have now managed to get the VoiceCommandSegmenter integrated. It is not a visually appealing solution as you currently only have to change the values in the script and restart HA to apply them.
Also, the settings are currently global and cannot be evaluated for every device. But it is a start and looks like it works.

You can adjust the following values:
vad_mode
vad_silence_second
vad_speech_second
vad_timeout_seconds vad_reset_seconds

Best regards

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants