Overview

A standalone Python Qt6 application to chat with Groq AI by using various open-source models. An API key is required to chat, which is free.

Dark Mode

Light Mode

Features

• Model Selection Dropdown. Currently available models:

  *Llama 3.1 405B (NOT AVAILABLE IN THE GROQ API YET)

  • Llama 3.1 70B (Preview) by Meta
  • Llama 3.1 8B (Preview) by Meta
  • Llama 3 Groq 70B Tool Use (Preview) by Meta, refined by Groq
  • Llama 3 Groq 8B Tool Use (Preview) by Meta, refined by Groq
  • Meta Llama 3 70B (Default) by Meta
  • Meta Llama 3 8B by Meta
  • Mixtral 8x7B by Mistral AI
  • Gemma 7B by Google
  • Gemma 2 9B by Google

• Dark/Light mode switcher

• Configuring the "System Prompt" (from the config.py file)

• Markdown Support

• Chat area and input box obviously

Prerequisites

• Python (3.6 or higher) Use the commands below to install the following libraries: Groq, PyQt6, Markdown2
  • Groq Library

    pip install groq
    

  • PyQt6 Library

    pip install PyQt6
    

  • Markdown2 Library

    pip install markdown2
    

Installation

Download directly from GitHub or by using the git command:

> git clone https://github.com/FurtherSecrets24680/GroQt.git
> cd GroQt
> python main.py

If you are running this for the first time, you must provide your Groq API key in the config.py folder, then run main.py to start chatting.

Getting the API Key

• Go to https://console.groq.com/keys and sign up or log in to your account.

• Click Create API Key, then enter a name for the key.

  

• Click Submit , copy he key, then put it in the config.py file. (MAKE SURE TO COPY THE KEY IMMEDIATELY, IT WONT SHOW IT AFTER CLOSING THE BOX.)

  

Planned Features

• Chat history - View/Delete/Export Chat history
• Clear chat
• Ability to provide API key within the app
• Ability to provide System Prompt within the app
• Custom bots with custom system prompts
• More UI improvements and More...

Known issues

• When asked to write poem or code, it tries to do it within one line/paragraph. Seems like a markdown issue.

Not So Frequently Asked Questions

• Q: Why should I even use this?
• A: It's your choice. If you like open-source AI models, too lazy to open a browser and don't have high end PC to run it locally, this application is just for you. Also, Groq is something special. It uses an LPU (Language Processing Unit) , which has a greater capacity than CPU or GPU. As a result, the replies of the models are as fast as instant. Learn more at https://wow.groq.com/why-groq
• Q: Why isn't [Put a model name here] working? I have active internet connection and also provided an API key.
• A: Maybe that specific model(s) got removed, or changed to a new name. Just go to the Groq models documentation to find the changes, then modify the code; or wait for me to update the app.

Credits

• Inspired by vn33's PyQt6-Groq-Chatbot - https://github.com/vn33/PyQt6-Groq-Chatbot

References

• Groq API documentation - https://console.groq.com/docs
• Groq-python GitHub repo - https://github.com/groq/groq-python