Update supported_examples (#825)

Signed-off-by: Xinyao Wang <[email protected]> Co-authored-by: Xinyao Wang <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
opea-project · Sep 18, 2024 · 96d5cd9 · 96d5cd9
1 parent 0bb0abb
commit 96d5cd9
Showing 1 changed file with 89 additions and 8 deletions.
diff --git a/supported_examples.md b/supported_examples.md
@@ -6,13 +6,58 @@ This document introduces the supported examples of GenAIExamples. The supported
 
 [ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval augmented generation (RAG).
 
-| Framework                                                                      | LLM                                                               | Embedding                                           | Vector Database                      | Serving                                                                                                                         | HW              | Description |
-| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------- | ------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------- | --------------- | ----------- |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/)           | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2/GPU | Chatbot     |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [NeuralChat-7B](https://huggingface.co/Intel/neural-chat-7b-v3-3) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Chroma](https://www.trychroma.com/) | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2     | Chatbot     |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1)    | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/)           | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2     | Chatbot     |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Mistral-7B](https://huggingface.co/mistralai/Mistral-7B-v0.1)    | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Qdrant](https://qdrant.tech/)       | [TGI](https://github.com/huggingface/text-generation-inference) [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2     | Chatbot     |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B)                  | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/)           | [TEI](https://github.com/huggingface/text-embeddings-inference)                                                                 | Xeon/Gaudi2     | Chatbot     |
+<table>
+    <tr>
+        <th>Framework</th>
+        <th>LLM</th>
+        <th>Embedding</th>
+        <th>Vector Database</th>
+        <th>Serving</th>
+        <th>HW</th>
+        <th>Description</th>
+    </tr>
+    <tr>
+        <td rowspan="6"><a href="https://www.langchain.com">LangChain</a>/<a href="https://www.llamaindex.ai/">LlamaIndex</a></td>
+        <td> <a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td>
+        <td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
+        <td> <a href="https://redis.io/">Redis</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
+        <td> Xeon/Gaudi2/GPU</td>
+        <td> Chatbot</td>
+    </tr>
+    <tr>
+        <td> <a href="https://huggingface.co/Intel/neural-chat-7b-v3-3">NeuralChat-7B</a></td>
+        <td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
+        <td> <a href="https://www.trychroma.com/">Chroma</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
+        <td> Xeon/Gaudi2</td>
+        <td> Chatbot</td>
+    </tr>
+    <tr>
+        <td> <a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td>
+        <td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
+        <td> <a href="https://redis.io/">Redis</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
+        <td> Xeon/Gaudi2</td>
+        <td> Chatbot</td>
+    </tr>
+    <tr>
+        <td> <a href="https://huggingface.co/mistralai/Mistral-7B-v0.1">Mistral-7B</a></td>
+        <td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
+        <td> <a href="https://qdrant.tech/">Qdrant</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a> <a href="https://github.com/huggingface/text-embeddings-inference">TEI</a></td>
+        <td> Xeon/Gaudi2</td>
+        <td> Chatbot</td>
+    </tr>
+    <tr>
+        <td> <a href="https://huggingface.co/Qwen/Qwen2-7B">Qwen2-7B</a></td>
+        <td> <a href="https://huggingface.co/BAAI/bge-base-en">BGE-Base</a></td>
+        <td> <a href="https://redis.io/">Redis</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a></td>
+        <td> Xeon/Gaudi2</td>
+        <td> Chatbot</td>
+    </tr>
+</table>
 
 ### CodeGen
 
@@ -101,7 +146,7 @@ The DocRetriever example demonstrates how to match user queries with free-text r
 
 | Framework                                                                      | Embedding                                           | Vector Database            | Serving                                                         | HW          | Description                |
 | ------------------------------------------------------------------------------ | --------------------------------------------------- | -------------------------- | --------------------------------------------------------------- | ----------- | -------------------------- |
-| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Document Retrieval Service |
+| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [BGE-Base](https://huggingface.co/BAAI/bge-base-en) | [Redis](https://redis.io/) | [TEI](https://github.com/huggingface/text-embeddings-inference) | Xeon/Gaudi2 | Document Retrieval service |
 
 ### AgentQnA
 
@@ -110,3 +155,39 @@ The AgentQnA example demonstrates a hierarchical, multi-agent system designed fo
 Worker agent uses open-source websearch tool (duckduckgo), agents use OpenAI GPT-4o-mini as llm backend.
 
 > **_NOTE:_** This example is in active development. The code structure of these use cases are subject to change.
+
+### AudioQnA
+
+The AudioQnA example demonstrates the integration of Generative AI (GenAI) models for performing question-answering (QnA) on audio files, with the added functionality of Text-to-Speech (TTS) for generating spoken responses. The example showcases how to convert audio input to text using Automatic Speech Recognition (ASR), generate answers to user queries using a language model, and then convert those answers back to speech using Text-to-Speech (TTS).
+
+<table>
+    <tr>
+        <th>ASR</th>
+        <th>TTS</th>
+        <th>LLM</th>
+        <th>HW</th>
+        <th>Description</th>
+    </tr>
+    <tr>
+        <td> <a href="https://huggingface.co/openai/whisper-small">openai/whisper-small</a></td>
+        <td> <a href="https://huggingface.co/microsoft/speecht5_tts">microsoft/SpeechT5</a></td>
+        <td> <a href="https://github.com/huggingface/text-generation-inference">TGI</a></td>
+        <td> Xeon/Gaudi2</td>
+        <td> Talkingbot service</td>
+    </tr>
+</table>
+
+### FaqGen
+
+FAQ Generation Application leverages the power of large language models (LLMs) to revolutionize the way you interact with and comprehend complex textual data. By harnessing cutting-edge natural language processing techniques, our application can automatically generate comprehensive and natural-sounding frequently asked questions (FAQs) from your documents, legal texts, customer queries, and other sources. In this example use case, we utilize LangChain to implement FAQ Generation and facilitate LLM inference using Text Generation Inference on Intel Xeon and Gaudi2 processors.
+| Framework | LLM | Serving | HW | Description |
+| ------------------------------------------------------------------------------ | ----------------------------------------------------------------- | --------------------------------------------------------------- | ----------- | ----------- |
+| [LangChain](https://www.langchain.com)/[LlamaIndex](https://www.llamaindex.ai) | [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | [TGI](https://github.com/huggingface/text-generation-inference) | Xeon/Gaudi2 | Chatbot |
+
+### MultimodalQnA
+
+[MultimodalQnA](./MultimodalQnA/README.md) addresses your questions by dynamically fetching the most pertinent multimodal information (frames, transcripts, and/or captions) from your collection of videos.
+
+### ProductivitySuite
+
+[Productivity Suite](./ProductivitySuite/README.md) streamlines your workflow to boost productivity. It leverages the OPEA microservices to provide a comprehensive suite of features to cater to the diverse needs of modern enterprises.