Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Sim, ppss] Define average stake amount and accuracy, *per feed* #1202

Closed
2 tasks
trizin opened this issue Jun 12, 2024 · 1 comment
Closed
2 tasks

[Sim, ppss] Define average stake amount and accuracy, *per feed* #1202

trizin opened this issue Jun 12, 2024 · 1 comment
Labels
Type: Enhancement New feature or request

Comments

@trizin
Copy link
Contributor

trizin commented Jun 12, 2024

Background / motivation

Status quo: ppss enables the user to set a single average accuracy (of other traders) overall. This is the setting predictoor_ss.sim_only.others_accuracy. Same for stake; setting is others_stake.

Datapoint: average accuracy makes a huge difference to profitability of predictoor. Eg value of 50% makes it easier to be profitable, value of 53% makes it much harder, 56% harder yet

Datapoint: in practice, average accuracy is quite different per feed. On some feeds it might be 51.8%, on others 53%, on others 56%. These accuracies tend to be fairly stable over the weeks, and slowly increasing due to an arms race among predictoors.

The datapoints above lead to a problem: when we simulate, if we change the feed, we have to update the single average accuracy to be reflective of the given feed we're predicting. It's a pain.

Towards a solution

We need to enable users to define average stake amount and accuracy, per feed. This will help sim give more realistic profitabilities for prediction bots.

TODO

  • ppss.yaml enables user to define average accuracy and stake amount, per feed. Add unit tests accordingly
  • reflect this upwards in the code to the level of the simulator
@trizin trizin added the Type: Enhancement New feature or request label Jun 12, 2024
@trentmc trentmc changed the title [simengine] Feature to define average stake amount and accuracy per feed [Simengine] Feature to define average stake amount and accuracy per feed Jun 13, 2024
@trentmc trentmc changed the title [Simengine] Feature to define average stake amount and accuracy per feed [Simengine, ppss] Feature to define average stake amount and accuracy per feed Jun 13, 2024
@trentmc trentmc changed the title [Simengine, ppss] Feature to define average stake amount and accuracy per feed [Sim, ppss] Define average stake amount and accuracy per feed Jun 22, 2024
@trentmc trentmc changed the title [Sim, ppss] Define average stake amount and accuracy per feed [Sim, ppss] Define average stake amount and accuracy, *per feed* Jun 22, 2024
@trizin
Copy link
Contributor Author

trizin commented Aug 6, 2024

#1257 is a better solution, don't think is needed anymore. Closing...

@trizin trizin closed this as completed Aug 6, 2024
@trizin trizin closed this as not planned Won't fix, can't repro, duplicate, stale Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant