Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Improve actions samples random selection #799

Merged
merged 2 commits into from
Dec 3, 2024

Conversation

dievardump
Copy link
Contributor

Improve the action samples random selection by ensuring a bigger variety of actions are represented in the selection (as long as there is enough place, at least one example per action should be added)

Relates to:

#798

Risks

low, but it makes LLM sometimes not understand that they can trigger an action because they don't have any example corresponding

Background

What does this PR do?

This PR changes the algorithm that selects the actions examples that are sent to the model

What kind of change is this?

Improvements

Documentation changes needed?

My changes do not require a change to the project documentation.

Testing

not really testable except if you do console logs but the difference is there.

    Improve the action samples random selection by ensuring a bigger variety of actions are represented in the selection (as long as there is enough place, at least one example per action should be added)
Copy link
Collaborator

@odilitime odilitime left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very smart, like the thinking

@tcm390
Copy link
Collaborator

tcm390 commented Dec 2, 2024

Yes, it has improved :)

But relying on randomness doesn't seem ideal to me. If we integrate the actions, we should ensure they are reliably triggerable rather than dependent on randomness.

@shakkernerd shakkernerd changed the title Improve actions samples random selection refactor: Improve actions samples random selection Dec 3, 2024
shakkernerd
shakkernerd previously approved these changes Dec 3, 2024
Copy link
Member

@shakkernerd shakkernerd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Totally agree!
Looks good to me.

@shakkernerd shakkernerd merged commit 184e0bb into elizaOS:main Dec 3, 2024
3 checks passed
dsldsl pushed a commit to dsldsl/eliza that referenced this pull request Dec 7, 2024
refactor: Improve actions samples random selection
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants