-
Notifications
You must be signed in to change notification settings - Fork 144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add no_proxy env for embedding-tei-server container #140
Conversation
After discussion with @huiyan2021 rerank container has the same issue, add no_proxy for both embedding and rerank |
please also help to add no_proxy env for other microservices? thanks. |
Hello, @lvliang-intel, changes in GenAIComps docker_compose.yaml has no impact on GenAIExamples execution because each GenAIExample has its own docker_compose.yaml, no_proxy here is NOT necessary change for GenAIExample execution. To keep alignment, I will try to add no_proxy along with http/https proxy setting in GenAIComps. |
ae7c2b7
to
934efd2
Compare
Signed-off-by: Zhou Ting <[email protected]> Singed-off-by: Cao Huiyan <[email protected]>
@lvliang-intel Done. Please review. Thanks! |
Singed-off-by: Cao Huiyan <[email protected]> Signed-off-by: Zhou Ting <[email protected]> Co-authored-by: lvliang-intel <[email protected]> Signed-off-by: sharanshirodkar7 <[email protected]>
Singed-off-by: Cao Huiyan <[email protected]> Signed-off-by: Zhou Ting <[email protected]> Co-authored-by: lvliang-intel <[email protected]> Signed-off-by: Yogesh Pandey <[email protected]>
Singed-off-by: Cao Huiyan <[email protected]> Signed-off-by: Zhou Ting <[email protected]> Co-authored-by: lvliang-intel <[email protected]> Signed-off-by: Daniel Whitenack <[email protected]>
Signed-off-by: chensuyue <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Description
Add no_proxy env for embedding-tei-server container
Issues
In a proxy r&d or deployment environment ( need proxy to access external network, no proxy to access internal network)
we need to pass no_proxy setting to embedding-tei-server, otherwise by following https://github.com/opea-project/GenAIExamples/blob/main/ChatQnA/docker/xeon/README.md
"TEI embedding service" access is OK, but inside "Embedding Microservice", it failed to access "Embedding Microservice".
some discussion in opea-project/GenAIExamples#251
TEI Embedding Service
curl ${host_ip}:6006/embed
-X POST
-d '{"inputs":"What is Deep Learning?"}'
-H 'Content-Type: application/json'
Embedding Microservice
curl http://${host_ip}:6000/v1/embeddings
-X POST
-d '{"text":"hello"}'
-H 'Content-Type: application/json'
Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
No dependency.
Tests
[Describe the tests that you ran to verify your changes.]
Follow (https://github.com/opea-project/GenAIExamples/blob/main/ChatQnA/docker/xeon/README.md) to set up ChatQnA in a proxy environment
TEI Embedding Service ok
curl ${host_ip}:6006/embed
-X POST
-d '{"inputs":"What is Deep Learning?"}'
-H 'Content-Type: application/json'
Embedding Microservice ko
curl http://${host_ip}:6000/v1/embeddings
-X POST
-d '{"text":"hello"}'
-H 'Content-Type: application/json'