Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New Feature]: Multiple AI Model Support #3

Closed
riverma opened this issue Aug 14, 2024 · 1 comment
Closed

[New Feature]: Multiple AI Model Support #3

riverma opened this issue Aug 14, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@riverma
Copy link
Collaborator

riverma commented Aug 14, 2024

Checked for duplicates

Yes - I've already checked

Alternatives considered

Have you considered alternative solutions to your feature request?

Yes - and alternatives don't suffice

Related problems

Is your feature request related to any problems? Please help us understand if so, including linking to any other issue tickets.

Currently only a single model is supported at a time, even if the model is not accessible to the user.

Describe the feature request

A clear and concise description of your request.

It'd be great to have the following type of user interaction:

python slim-cli.py ... --use-ai <MODEL_ID>

Where, <MODEL_ID> is one of:

  • openai-chatgpt4o
  • azure-chatgpt4o
  • llama3.1-70b
  • llama3.1-400b

For each of the above, there should be a check to ensure required environment variables are set, and if they are not, the program should exit. For example, the first model, the environment variable OPENAI_KEY should be set.

Additionally, the argparse usage and the README should document the models and when to use which.

@riverma riverma added the enhancement New feature or request label Aug 14, 2024
@yunks128
Copy link
Contributor

This is integrated, and an error message is included when OPENAI_KEY is missing.
Example:

python slim-cli.py ... --use-ai openai/gpt-4o
python slim-cli.py ... --use-ai azure/gpt-4o
python slim-cli.py ... --use-ai ollama/llama3.1:70b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants