Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TEI embedding error with Milvus data-prep link upload #565

Closed
CharleneHu-42 opened this issue Aug 26, 2024 · 1 comment
Closed

TEI embedding error with Milvus data-prep link upload #565

CharleneHu-42 opened this issue Aug 26, 2024 · 1 comment
Assignees
@letonghan
Labels
DEV features

Comments

@CharleneHu-42
Copy link

When uploading links to Milvus db with:

curl -X POST \
    -F 'link_list=["https://www.ces.tech/"]' \
    http://localhost:6010/v1/dataprep

TEI throws validation error:

text_embeddings_core::infer: core/src/infer.rs:303: Input validation error: `inputs` must have less than 512 tokens. Given: 809

Need to implement file chunk for link ingestion.
@letonghan letonghan self-assigned this Aug 27, 2024
@preethivenkatesh preethivenkatesh added the DEV features label Aug 28, 2024
@letonghan letonghan mentioned this issue Aug 28, 2024
Merged
4 tasks
@letonghan
Copy link
Collaborator

Fixed by PR #570. Will close this issue.

lkk12014402 pushed a commit that referenced this issue Sep 19, 2024
@daisy-ycguo
improve manifest chaqna test (#565)
a072441 
Signed-off-by: Yingchun Guo <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@letonghan letonghan

Labels
DEV features
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@preethivenkatesh @CharleneHu-42 @letonghan