Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

EXAMPLE ISSUE: Allow repomix configuration to be passed in as an option #1

Open
kjanoudi opened this issue Feb 5, 2025 · 9 comments · Fixed by #2
Open

EXAMPLE ISSUE: Allow repomix configuration to be passed in as an option #1

kjanoudi opened this issue Feb 5, 2025 · 9 comments · Fixed by #2

Comments

@kjanoudi
Copy link

kjanoudi commented Feb 5, 2025

Would it be possible to allow us to configure repomix, or is it integral to be configured the way it is today? It looks like right now we're using a cl100k tokenizer, but with gemini is there a better one that can be used?
@eastlondoner
Copy link
Owner

for sure - what are you aiming to do? right now the tokeniser is just used to estimate the token count for switching between models but you can explicitly specify the model so it's kind of a non-essential feature

@eastlondoner
Copy link
Owner

OK this is what we have learned!

Image

Image

Image

Image

Image

eastlondoner added a commit that referenced this issue Feb 5, 2025
@eastlondoner
feat: switch default tokenizer to o200k_base for better Gemini compat…
64f6d1f 
…ibility

- Changed default tokenizer to o200k_base for better compatibility with Gemini models

- Added configurable tokenizer support through tokenCount.encoding in config file

- Updated documentation to reflect new tokenizer configuration options

Fixes #1
@eastlondoner eastlondoner mentioned this issue Feb 5, 2025
Merged
@eastlondoner
Copy link
Owner

Image

@eastlondoner
Copy link
Owner

OK I am keeping this issue open because it is a GREAT demonstration of how to use cursor-tools

@eastlondoner eastlondoner changed the title Allow repomix configuration to be passed in as an option EXAMPLE ISSUE: Allow repomix configuration to be passed in as an option Feb 5, 2025
@eastlondoner eastlondoner reopened this Feb 5, 2025
@alii
Copy link

alii commented Feb 5, 2025

🤯

@kjanoudi
Copy link
Author

kjanoudi commented Feb 5, 2025

wow, amazing work. Thank you

@chufucious
Copy link

chufucious commented Feb 6, 2025 •
edited
Loading

I love the tool thank you. I am having problems getting Cursor to reliably call the tools when I prompt it. Any suggestions on best practices?

This is the latest prompt that doesn't seem to be working.

- Pair program with Gemini
- When you have a question you don't understand or want more information, ask Perplexity to research the web for the question

@eastlondoner
Copy link
Owner

@chufucious could you open a new issue and provide some more details ?

Screenshots of the ui with your prompt and whatever it's doing would help

@chufucious
Copy link

@chufucious could you open a new issue and provide some more details ?

Screenshots of the ui with your prompt and whatever it's doing would help

Actually I noticed that the .cursorrules example has been updated in the latest; I'm gonna try using that and I'll let you know if I am still having problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: switch default tokenizer to o200k_base for better Gemini compat… eastlondoner/cursor-tools
4 participants
@chufucious @kjanoudi @eastlondoner @alii