Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update supported_examples #825

Merged
merged 17 commits into from
Sep 18, 2024
Merged

Update supported_examples #825

Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
d9c105c
Update supported_examples
kevinintel Sep 18, 2024
4aa82b7
Update supported_examples.md
kevinintel Sep 18, 2024
12742ba
Update supported_examples.md
kevinintel Sep 18, 2024
8cf2cc8
Update supported_examples.md
kevinintel Sep 18, 2024
ee2c650
Update supported_examples.md
kevinintel Sep 18, 2024
1d78107
Update supported_examples.md
kevinintel Sep 18, 2024
4202691
Update supported_examples.md
kevinintel Sep 18, 2024
0bfdb25
Update supported_examples.md
kevinintel Sep 18, 2024
4e39379
Update supported_examples.md
kevinintel Sep 18, 2024
13166a6
Update supported_examples.md
kevinintel Sep 18, 2024
d98312e
Update supported_examples.md
kevinintel Sep 18, 2024
d05ef0e
Update supported_examples.md
kevinintel Sep 18, 2024
16f0591
Update supported_examples.md
kevinintel Sep 18, 2024
4fb774b
Update supported_examples.md
kevinintel Sep 18, 2024
fc7b737
Merge branch 'main' into kevinintel-patch-1
kevinintel Sep 18, 2024
31b4c72
add examples for faqgen
XinyaoWa Sep 18, 2024
6587ce2
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Sep 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
97 changes: 89 additions & 8 deletions supported_examples.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,58 @@ This document introduces the supported examples of GenAIExamples. The supported

[ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval augmented generation (RAG).

| Framework | LLM | Embedding | Vector Database | Serving | HW | Description |
| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------- | ------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------- | --------------- | ----------- |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2/GPU | Chatbot |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Chroma](https://www.trychroma.com/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Qdrant](https://qdrant.tech/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Chatbot |
<table>
<tr>
<th>Framework</th>
<th>LLM</th>
<th>Embedding</th>
<th>Vector Database</th>
<th>Serving</th>
<th>HW</th>
<th>Description</th>
</tr>
<tr>
<td rowspan="6"><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai/">LlamaIndex</a></td>
<td> <a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td>
<td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
<td> <a href="https://redis.io/">Redis</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
<td> Xeon/Gaudi2/GPU</td>
<td> Chatbot</td>
</tr>
<tr>
<td> <a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td>
<td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
<td> <a href="https://www.trychroma.com/">Chroma</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
<td> Xeon/Gaudi2</td>
<td> Chatbot</td>
</tr>
<tr>
<td> <a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td>
<td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
<td> <a href="https://redis.io/">Redis</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
<td> Xeon/Gaudi2</td>
<td> Chatbot</td>
</tr>
<tr>
<td> <a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td>
<td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
<td> <a href="https://qdrant.tech/">Qdrant</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
<td> Xeon/Gaudi2</td>
<td> Chatbot</td>
</tr>
<tr>
<td> <a href="https://huggingface.co/Qwen/Qwen2-7B">Qwen2-7B</a></td>
<td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
<td> <a href="https://redis.io/">Redis</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a></td>
<td> Xeon/Gaudi2</td>
<td> Chatbot</td>
</tr>
</table>

### CodeGen

Expand Down Expand Up @@ -101,7 +146,7 @@ The DocRetriever example demonstrates how to match user queries with free-text r

| Framework | Embedding | Vector Database | Serving | HW | Description |
| ------------------------------------------------------------------------------ | --------------------------------------------------- | -------------------------- | --------------------------------------------------------------- | ----------- | -------------------------- |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Document Retrieval Service |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Document Retrieval service |

### AgentQnA

Expand All @@ -110,3 +155,39 @@ The AgentQnA example demonstrates a hierarchical, multi-agent system designed fo
Worker agent uses open-source websearch tool (duckduckgo), agents use OpenAI GPT-4o-mini as llm backend.

> **_NOTE:_** This example is in active development. The code structure of these use cases are subject to change.

### AudioQnA

The AudioQnA example demonstrates the integration of Generative AI (GenAI) models for performing question-answering (QnA) on audio files, with the added functionality of Text-to-Speech (TTS) for generating spoken responses. The example showcases how to convert audio input to text using Automatic Speech Recognition (ASR), generate answers to user queries using a language model, and then convert those answers back to speech using Text-to-Speech (TTS).

<table>
<tr>
<th>ASR</th>
<th>TTS</th>
<th>LLM</th>
<th>HW</th>
<th>Description</th>
</tr>
<tr>
<td> <a href="https://huggingface.co/openai/whisper-small">openai/whisper-small</a></td>
<td> <a href="https://huggingface.co/microsoft/speecht5_tts">microsoft/SpeechT5</a></td>
<td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a></td>
<td> Xeon/Gaudi2</td>
<td> Talkingbot service</td>
</tr>
</table>

### FaqGen

FAQ Generation Application leverages the power of large language models (LLMs) to revolutionize the way you interact with and comprehend complex textual data. By harnessing cutting-edge natural language processing techniques, our application can automatically generate comprehensive and natural-sounding frequently asked questions (FAQs) from your documents, legal texts, customer queries, and other sources. In this example use case, we utilize LangChain to implement FAQ Generation and facilitate LLM inference using Text Generation Inference on Intel Xeon and Gaudi2 processors.
| Framework | LLM | Serving | HW | Description |
| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ----------- |
| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot |

### MultimodalQnA

[MultimodalQnA](./MultimodalQnA/README.md) addresses your questions by dynamically fetching the most pertinent multimodal information (frames, transcripts, and/or captions) from your collection of videos.

### ProductivitySuite

[Productivity Suite](./ProductivitySuite/README.md) streamlines your workflow to boost productivity. It leverages the OPEA microservices to provide a comprehensive suite of features to cater to the diverse needs of modern enterprises.
Loading