Skip to content

Commit

Permalink
[Doc]Add a micro/mega service WorkFlow for DocSum (#537)
Browse files Browse the repository at this point in the history
* Update README.md

added a micro/megaservice workflow for Doc Sum

Signed-off-by: Tsai, Louie <[email protected]>

* Update README.md

Signed-off-by: Tsai, Louie <[email protected]>

* fix format issue

Signed-off-by: Tsai, Louie <[email protected]>

---------

Signed-off-by: Tsai, Louie <[email protected]>
  • Loading branch information
louie-tsai authored Aug 21, 2024
1 parent 87617e7 commit 343d614
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions DocSum/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,29 @@ Install Helm (version >= 3.15) first. Refer to the [Helm Installation Guide](htt

Refer to the [DocSum helm chart](https://github.com/opea-project/GenAIInfra/tree/main/helm-charts/docsum) for instructions on deploying DocSum into Kubernetes on Xeon & Gaudi.

### Workflow of the deployed Document Summarization Service

The workflow of the Document Summarization Service, from user's input query to the application's output response, is as follows:

```mermaid
flowchart LR
subgraph DocSum
direction LR
A[User] <--> |Input query| B[DocSum Gateway]
B <--> |Post| Megaservice
subgraph Megaservice["Megaservice"]
direction TB
C([ Microservice : llm-docsum-tgi <br>9000]) -. Post .-> D{{TGI Service<br>8008}}
end
Megaservice --> |Output| E[Response]
end
subgraph Legend
X([Micsrservice])
Y{{Service from industry peers}}
Z[Gateway]
end
```

## Consume Document Summarization Service

Two ways of consuming Document Summarization Service:
Expand Down

0 comments on commit 343d614

Please sign in to comment.