gptme often tries to use python instead of ipython to execute python code

[Miyou]

I feel like this could be solved by adding some extra prompting around this

[ErikBjare]

We used to just use ```python and ```bash for python and shell tool, but had to change it since it kept trying/asking to run non-runnable code snippets/examples it showed using the same markup. I later changed it to just ipython/shell respectively, and it works much better, but it sometimes messes it up still. Tried different prompts, but hard to measure what has impact since it's somewhat rare/random.

See #67 for backstory

[Miyou]

We used to just use python and bash for python and shell tool, but had to change it since it kept trying/asking to run non-runnable code snippets/examples it showed using the same markup. I later changed it to just ipython/shell respectively, and it works much better, but it sometimes messes it up still. Tried different prompts, but hard to measure what has impact since it's somewhat rare/random.

See #67 for backstory

Perhaps not using ``` for tool execution could be a solution. Maybe use XML tags instead?

[ErikBjare]

@Miyou you can try that with the --tool-format xml parameter

[bjsi]

Maybe changing the name of the tool from python -> ipython?

[ErikBjare]

@bjsi Yeah I think that might help, could eval some small model which struggles and see if it helps.

[ErikBjare]

@Miyou Try using latest gptme master with --tool-format tool now that we merged #306

Since it skips the markdown format altogether, it shouldn't suffer from this issue.