Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-ordered plug-in result to be included _after_ chat-history #182

Merged
merged 3 commits into from
Aug 18, 2023

Conversation

crickman
Copy link
Contributor

@crickman crickman commented Aug 15, 2023

Motivation and Context

Customer reported stale plug-in results. Re-ordering prompt to include plug-in results last may impact prioritizing this data for certain cases. (Isolated testing indicates that the model can respond to priority hints via ordering, but other factors may influence model behavior as well...such as chat history or memory presenting stronger semantic context.)

Description

Move planner results to after chat-history:

[SOURCE START]

This is the result of invoking the functions listed after "PLUGINS USED:" to retrieve additional information outside of the data you were trained on. You can use this data to help answer the user's query.

PLUGINS USED: ListPluginPlugin.GetList.

RESULT: {
"content": "eba26d18-b4bb-46d4-b6b6-cbf60d4312e8\n12ed4781-5b22-48a0-b4e9-a351e546e7ff\n90605eb2-51ce-4058-8ae0-dfbe5ed455f7\nf51d2923-f97a-41b8-97d4-991b9f46e260",
"contentType": "text/plain"
}

[SOURCE END]

Contribution Checklist

@github-actions github-actions bot added webapi Pull requests that update .net code PR: ready for review labels Aug 15, 2023
@crickman crickman changed the title Updated Re-ordered plug-in result to be included _after_ chat-history Aug 15, 2023
alliscode
alliscode previously approved these changes Aug 15, 2023
@crickman crickman marked this pull request as ready for review August 15, 2023 20:51
@crickman crickman self-assigned this Aug 15, 2023
@crickman crickman added this pull request to the merge queue Aug 18, 2023
Merged via the queue into main with commit 7384f29 Aug 18, 2023
6 checks passed
@crickman crickman deleted the fix-151-custom-plugin-ignored branch August 18, 2023 00:15
teamleader-dev pushed a commit to vlink-group/chat-copilot that referenced this pull request Oct 7, 2024
…oft#182)

### Motivation and Context

<!-- Thank you for your contribution to the copilot-chat repo!
Please help reviewers and future users, providing the following
information:
  1. Why is this change required?
  2. What problem does it solve?
  3. What scenario does it contribute to?
  4. If it fixes an open issue, please link to the issue here.
-->

Customer reported stale plug-in results. Re-ordering prompt to include
plug-in results last may impact prioritizing this data for certain
cases. (Isolated testing indicates that the model can respond to
priority hints via ordering, but other factors may influence model
behavior as well...such as chat history or memory presenting stronger
semantic context.)

### Description
<!-- Describe your changes, the overall approach, the underlying design.
These notes will help understanding how your code works. Thanks! -->

Move planner results to after chat-history:

```
[SOURCE START]

This is the result of invoking the functions listed after "PLUGINS USED:" to retrieve additional information outside of the data you were trained on. You can use this data to help answer the user's query.

PLUGINS USED: ListPluginPlugin.GetList.

RESULT: {
"content": "eba26d18-b4bb-46d4-b6b6-cbf60d4312e8\n12ed4781-5b22-48a0-b4e9-a351e546e7ff\n90605eb2-51ce-4058-8ae0-dfbe5ed455f7\nf51d2923-f97a-41b8-97d4-991b9f46e260",
"contentType": "text/plain"
}

[SOURCE END]
```

### Contribution Checklist

<!-- Before submitting this PR, please make sure: -->

- [x] The code builds clean without any errors or warnings
- [x] The PR follows the [Contribution
Guidelines](https://github.com/microsoft/copilot-chat/blob/main/CONTRIBUTING.md)
and the [pre-submission formatting
script](https://github.com/microsoft/copilot-chat/blob/main/CONTRIBUTING.md#development-scripts)
raises no violations
- [x] All unit tests pass, and I have added new tests where possible
- [x] I didn't break anyone 😄
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
webapi Pull requests that update .net code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Custom Plugin in Chat-Copilot Fetching Outdated Data Instead of Up-to-Date Results
4 participants