Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Groq Inference Extension #2263

Merged
merged 13 commits into from
Mar 17, 2024
Merged

feat: Groq Inference Extension #2263

merged 13 commits into from
Mar 17, 2024

Conversation

metaspartan
Copy link
Contributor

@metaspartan metaspartan commented Mar 7, 2024

Describe Your Changes

  • Adds a new extension and functionality for inference with the new Groq APIs

This is the implementation of #2229

Self Checklist

  • [✔️ ] Added groq inference extension
  • Updated docs (for new feature)
  • Added new default mixtral-8x7b and llama2-70b models from Groq

@metaspartan
Copy link
Contributor Author

Will this ever be reviewed/ack? It has been up for a week now...

@0xHieu01 0xHieu01 requested review from a team and Van-QA March 17, 2024 02:27
Copy link
Contributor

@louis-menlo louis-menlo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@louis-menlo
Copy link
Contributor

Just a few linter issues left. Please help fix so we can proceed. @metaspartan

@metaspartan
Copy link
Contributor Author

Just a few linter issues left. Please help fix so we can proceed. @metaspartan

Resolved ✔️

@louis-menlo louis-menlo merged commit 0348aa3 into janhq:dev Mar 17, 2024
6 of 7 checks passed
@louis-menlo louis-menlo mentioned this pull request Mar 22, 2024
28 tasks
@Van-QA Van-QA added this to the v0.4.10 milestone Mar 26, 2024
@Van-QA
Copy link
Contributor

Van-QA commented Mar 26, 2024

Linking to #2227

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

3 participants