Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C4GT] Adding a microphone button for voice input #15

Open
14 tasks
Tracked by #10
aashutosh-samagra opened this issue Apr 4, 2023 · 1 comment
Open
14 tasks
Tracked by #10

[C4GT] Adding a microphone button for voice input #15

aashutosh-samagra opened this issue Apr 4, 2023 · 1 comment

Comments

@aashutosh-samagra
Copy link

aashutosh-samagra commented Apr 4, 2023

Project Details

UCI is created with a vision to make the conversation flow creation configurable to a level, that it can be done by program owners, without the intervention of any engineers at all. At the same time, it also envisions reducing the redundant coding required for enabling the same business logic for different channels.

UCI aims to democratize the use of different communication channels such as WhatsApp, Telegram, SMS, email and more across all governance use cases.

UCI is being used to create 2 ways communication channels via chatbots between lakhs of teachers in Uttar Pradesh & the state. These chatbots are configured from an admin panel and trigger notifications to the teachers. Teachers then click on the notifications on their Android phones and talk to the chatbot. This is making day to day communication realtime & very effective between teachers and the state.

UCI-WEB-CHANNEL is a frontend application which uses UCI backend for communication.

Features to be implemented

Add a microphone button that allows users to input text using their voice. The microphone button should be placed on the left side of the chatbot interface, inside the search box. Also add an option to choose whether to send the audio or use audio to convert it to text.

What exists

Currently we are using chatui as local-pacakge in our repo and it has support for audio input but it not properly setup.

What needs to be built

  1. Enable input toggle button.
  2. Add voice input button.
  3. Add voice to text.
  4. Add option to upload audio file.
  5. Create a WAV File.
  6. Upload this to minio bucket and get a signed URL.
  7. Send signed URL back to transport socket.

Learning Path

Complexity

Medium

Skills Required

Javascript, Typescript, React ,minio .

Name of Mentors:

@geeky-abhishek

Repo Link

https://github.com/samagra-comms/uci-web-channel

Project size

8 Weeks

Acceptance Criteria

  • add Input toggle to switch between voice / keyboard input
  • get signed url by uploading the wav file
  • proper speech to text conversation (including different locales).
  • validation for file size

Milestones

  • Understanding the requirements
  • Understanding turbo repo
  • Understanding UCI-WEB-CHANNEL
  • Understanding chat-ui
  • Setting up UCI-WEB-CHANNEL locally
  • adding input toggle switch.
  • adding voice to text support.
  • adding audio file upload support.
  • sending audio file.
  • Adding proper test cases.

C4GT

This issue is nominated for Code for GovTech (C4GT) 2023 edition.
C4GT is India's first annual coding program to create a community that can build and contribute to global Digital Public Goods. If you want to use Open Source GovTech to create impact, then this is the opportunity for you! More about C4GT here: https://codeforgovtech.in/

@aashutosh-samagra aashutosh-samagra mentioned this issue Apr 4, 2023
9 tasks
@aashutosh-samagra aashutosh-samagra added this to the Beta milestone Apr 11, 2023
@ChakshuGautam ChakshuGautam moved this to Backlog in AKAI Board Apr 12, 2023
@prtkjakhar prtkjakhar moved this from Backlog to In Progress in AKAI Board Apr 17, 2023
@ChakshuGautam ChakshuGautam removed this from the Beta milestone Apr 18, 2023
@prtkjakhar prtkjakhar mentioned this issue Apr 18, 2023
3 tasks
@prtkjakhar prtkjakhar moved this from In Progress to Backlog in AKAI Board Apr 18, 2023
@geeky-abhishek geeky-abhishek changed the title Adding a microphone button for voice input [C4GT] Adding a microphone button for voice input May 8, 2023
@prtkjakhar prtkjakhar moved this from Backlog to C4GT in AKAI Board May 8, 2023
@Prakhar-commits
Copy link

Prakhar-commits commented May 12, 2023

I would like to work on this issue, I am a frontend developer with experience in React and javascript.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: C4GT
Development

No branches or pull requests

4 participants