-
Notifications
You must be signed in to change notification settings - Fork 2.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Chat Interface flagging and chatbot feedback #10272
Conversation
🪼 branch checks and previews
Install Gradio from this PR pip install https://gradio-pypi-previews.s3.amazonaws.com/936988dbbfd3cb1431ecd59fd7061e0217fe66f1/gradio-5.9.1-py3-none-any.whl Install Gradio Python Client from this PR pip install "gradio-client @ git+https://github.com/gradio-app/gradio@936988dbbfd3cb1431ecd59fd7061e0217fe66f1#subdirectory=client/python" Install Gradio JS Client from this PR npm install https://gradio-npm-previews.s3.amazonaws.com/936988dbbfd3cb1431ecd59fd7061e0217fe66f1/gradio-client-1.8.0.tgz Use Lite from this PR <script type="module" src="https://gradio-lite-previews.s3.amazonaws.com/936988dbbfd3cb1431ecd59fd7061e0217fe66f1/dist/lite.js""></script> |
🦄 change detectedThis Pull Request includes changes to the following packages.
With the following changelog entry.
Maintainers or the PR author can modify the PR title to modify this entry.
|
Nice implementation @aliabid94! I tested it and everything looks good aside from one minor thing: the index gets flagged as a tuple For example, after flagging a couple of messages, here's what my csv looked like: conversation,index,value,flag,timestamp
"[{""role"": ""user"", ""metadata"": {""title"": null}, ""content"": ""abc"", ""options"": null}, {""role"": ""assistant"", ""metadata"": {""title"": null}, ""content"": ""Yes"", ""options"": null}]","[1, 1]",Like,2024-12-31 20:35:57.236605
"[{""role"": ""user"", ""metadata"": {""title"": null}, ""content"": ""abc"", ""options"": null}, {""role"": ""assistant"", ""metadata"": {""title"": null}, ""content"": ""Yes"", ""options"": null}, {""role"": ""user"", ""metadata"": {""title"": null}, ""content"": ""def"", ""options"": null}, {""role"": ""assistant"", ""metadata"": {""title"": null}, ""content"": ""No"", ""options"": null}]","[3, 3]",incorrect,2024-12-31 20:36:00.349117
"[{""role"": ""user"", ""metadata"": {""title"": null}, ""content"": ""abc"", ""options"": null}, {""role"": ""assistant"", ""metadata"": {""title"": null}, ""content"": ""Yes"", ""options"": null}, {""role"": ""user"", ""metadata"": {""title"": null}, ""content"": ""def"", ""options"": null}, {""role"": ""assistant"", ""metadata"": {""title"": null}, ""content"": ""No"", ""options"": null}]","[3, 3]",other,2024-12-31 20:36:58.068836 Notice the |
Oh and we should create a demo showcasing this & include this in the ChatInterface docs! |
… into chatbot_feedback
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
Co-authored-by: Abubakar Abid <[email protected]>
… into chatbot_feedback
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm great PR @aliabid94! I'll go ahead and merge this in once CI is green to avoid conflicts with #10191
Allows chatbot and chatinterface to provide additional feedback. In chat interface, feedback is flagged to a CSV file.