Add indexing function for indexing files to vector search#532

Merged

JohnMoutafis merged 26 commits intomainfrom npapa/sc-42043/vector-search-ingestion

Jun 6, 2024

+540-24

Commits on Jun 6, 2024

Add ingestion fuction for ingesting files to vector search

NikolaosPapailiou
authored and
JohnMoutafis
committed
Format

NikolaosPapailiou
authored and
JohnMoutafis
committed
Format

NikolaosPapailiou
authored and
JohnMoutafis
committed
Address review comments

NikolaosPapailiou
authored and
JohnMoutafis
committed
Format

NikolaosPapailiou
authored and
JohnMoutafis
committed
Add support for OpenAI embeddings and consolidate directory listing args

NikolaosPapailiou
authored and
JohnMoutafis
committed
Address review comments

NikolaosPapailiou
authored and
JohnMoutafis
committed
Fix param

NikolaosPapailiou
authored and
JohnMoutafis
committed
Address review comments

NikolaosPapailiou
authored and
JohnMoutafis
committed
Removed default arg dicts

NikolaosPapailiou
authored and
JohnMoutafis
committed
Fix function name

NikolaosPapailiou
authored and
JohnMoutafis
committed
Fix typoand remove create_index argument

NikolaosPapailiou
authored and
JohnMoutafis
committed
Apply code restructure suggestion

NikolaosPapailiou
authored and
JohnMoutafis
committed
Address review comments

NikolaosPapailiou
authored and
JohnMoutafis
committed
Fix format

NikolaosPapailiou
authored and
JohnMoutafis
committed
Unit test file indexing methods.
JohnMoutafis
committed
Attempt to resolve dependecy issues with vecotr-search.
JohnMoutafis
committed
Try to install vector-search without dependencies.
JohnMoutafis
committed
Attempt to differenciate test files to avoid "collisions".
JohnMoutafis
committed
Fix test file/array name collisions.
JohnMoutafis
committed
Skip create&update indexing test as it is extremely slow.
JohnMoutafis
committed
Set all the default dag.Modes to BATCH.
JohnMoutafis
committed
Add control over BATCH resources and sensible defaults.
JohnMoutafis
committed
Fix import error.
JohnMoutafis
committed
Final follow-ups.
JohnMoutafis
committed
Fix vector-search install issue for testing.
JohnMoutafis
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add indexing function for indexing files to vector search#532

Commits on Jun 6, 2024

Add ingestion fuction for ingesting files to vector search

Format

Format

Address review comments

Format

Add support for OpenAI embeddings and consolidate directory listing args

Address review comments

Fix param

Address review comments

Removed default arg dicts

Fix function name

Fix typoand remove create_index argument

Apply code restructure suggestion

Address review comments

Fix format

Unit test file indexing methods.

Attempt to resolve dependecy issues with vecotr-search.

Try to install vector-search without dependencies.

Attempt to differenciate test files to avoid "collisions".

Fix test file/array name collisions.

Skip create&update indexing test as it is extremely slow.

Set all the default dag.Modes to BATCH.

Add control over BATCH resources and sensible defaults.

Fix import error.

Final follow-ups.

Fix vector-search install issue for testing.