Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PineconeDocumentStore #2254

Merged
merged 80 commits into from
Mar 21, 2022
Merged

Add PineconeDocumentStore #2254

Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
827d6f8
added core install and functionality of pinecone doc store (init, ups…
jamescalam Feb 5, 2022
d9702f8
Merge branch 'master' of github.com:deepset-ai/haystack into pinecone…
jamescalam Feb 13, 2022
c4d21a9
implemented core functionality of Pinecone doc store
jamescalam Feb 13, 2022
2699808
Merge branch 'deepset-ai:master' into pinecone-doc-store
jamescalam Feb 14, 2022
925630f
merge with upstream master
jamescalam Feb 24, 2022
4eff62b
Update Documentation & Code Style
github-actions[bot] Feb 24, 2022
15debe7
updated filtering to use Haystack filtering and reduced default batch…
jamescalam Feb 26, 2022
42c9510
added haystack filter conversion and reduced default batch_size
jamescalam Feb 26, 2022
9657c48
Update Documentation & Code Style
github-actions[bot] Feb 26, 2022
50202bb
merge pinecone-doc-store with upstream changes
jamescalam Feb 27, 2022
92e4a0c
Merge branch 'pinecone-doc-store' of github.com:pinecone-io/haystack …
jamescalam Feb 27, 2022
5e06721
removed debugging code
jamescalam Feb 27, 2022
a7ed9ba
updated Pinecone filtering to use filter_utils
jamescalam Mar 2, 2022
dc2b80f
removed uneeded methods and minor tweaks to current methods
jamescalam Mar 2, 2022
227da6d
fixed typing issues
jamescalam Mar 2, 2022
384391b
Update Documentation & Code Style
github-actions[bot] Mar 2, 2022
bd9c355
Allow filters in al methods except get_embedding_count
bogdankostic Mar 2, 2022
c9823f2
Fix skipping document store tests
bogdankostic Mar 2, 2022
b124925
Update Documentation & Code Style
github-actions[bot] Mar 2, 2022
8526342
Fix handling of Milvus1 and Milvus2 in tests
bogdankostic Mar 2, 2022
632832f
Merge remote-tracking branch 'origin/fix_docstore_tests' into fix_doc…
bogdankostic Mar 2, 2022
ebf5344
Update Documentation & Code Style
github-actions[bot] Mar 2, 2022
422f82e
Fix handling of Milvus1 and Milvus2 in tests
bogdankostic Mar 2, 2022
b63f1b1
Merge remote-tracking branch 'origin/fix_docstore_tests' into fix_doc…
bogdankostic Mar 2, 2022
66f7dd0
Update Documentation & Code Style
github-actions[bot] Mar 2, 2022
1bcf759
Remove SQL from tests requiring embeddings
bogdankostic Mar 3, 2022
2da29ae
Merge remote-tracking branch 'origin/fix_docstore_tests' into fix_doc…
bogdankostic Mar 3, 2022
34c29ff
Update Documentation & Code Style
github-actions[bot] Mar 3, 2022
4cc08c4
Fix get_embedding_count of Milvus2
bogdankostic Mar 3, 2022
2b91993
Make sure to start Milvus2 tests with a new collection
bogdankostic Mar 3, 2022
e8eafa0
Merge branch 'fix_docstore_tests' into pr/2254
bogdankostic Mar 3, 2022
e8aa414
Add pinecone to test suite
bogdankostic Mar 4, 2022
581f298
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 4, 2022
4f28bb3
Update Documentation & Code Style
github-actions[bot] Mar 6, 2022
b44dc33
Fix typing
bogdankostic Mar 6, 2022
9948b30
Merge remote-tracking branch 'github-desktop-pinecone-io/pinecone-doc…
bogdankostic Mar 6, 2022
c80246d
Update Documentation & Code Style
github-actions[bot] Mar 6, 2022
e0995ad
Add pinecone to docstores dependendcy
bogdankostic Mar 6, 2022
8966922
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 7, 2022
8efa2b4
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 10, 2022
71ba098
Add PineconeDocStore to API Documentation
bogdankostic Mar 10, 2022
2cc268d
Add missing comma
bogdankostic Mar 10, 2022
d635baa
Update Documentation & Code Style
github-actions[bot] Mar 10, 2022
5cc6df6
Adapt format of doc strings
bogdankostic Mar 10, 2022
476dad2
Merge remote-tracking branch 'github-desktop-pinecone-io/pinecone-doc…
bogdankostic Mar 10, 2022
7bb62b9
Update Documentation & Code Style
github-actions[bot] Mar 10, 2022
9df1436
Set API key as environment variable
bogdankostic Mar 10, 2022
e0ec8b6
Merge remote-tracking branch 'github-desktop-pinecone-io/pinecone-doc…
bogdankostic Mar 10, 2022
e2e5da4
Skip Pinecone tests in forks
bogdankostic Mar 14, 2022
97ce7e6
Add sleep after deleting index
bogdankostic Mar 14, 2022
9c967f6
Add sleep after deleting index
bogdankostic Mar 14, 2022
3bb7751
Add sleep after creating index
bogdankostic Mar 14, 2022
58550e9
Add check if index ready
bogdankostic Mar 14, 2022
b0ae486
Remove printing of index stats
bogdankostic Mar 14, 2022
4ade615
Create new index for each pinecone test
bogdankostic Mar 14, 2022
971abc5
Use RestAPI instead of Python API for describe_index_stats
bogdankostic Mar 14, 2022
05e8cfd
Fix accessing describe_index_stats
bogdankostic Mar 14, 2022
c4b956e
Remove usages of describe_index_stats
bogdankostic Mar 14, 2022
1795471
Run pinecone tests separately
bogdankostic Mar 14, 2022
2c7c3c7
Update Documentation & Code Style
github-actions[bot] Mar 14, 2022
50773e4
Add pdftotext to pinecone tests
bogdankostic Mar 14, 2022
fce96e2
Merge remote-tracking branch 'origin/pinecone_test' into pinecone_test
bogdankostic Mar 14, 2022
220f913
Remove sleep from doc store fixture
bogdankostic Mar 14, 2022
54f672f
Add describe_index_stats
bogdankostic Mar 14, 2022
fe5035a
Remove unused imports
bogdankostic Mar 15, 2022
2f0b383
Use pull_request_target trigger
bogdankostic Mar 15, 2022
452cc16
Revert use pull_request_target trigger
bogdankostic Mar 15, 2022
d6afb43
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 15, 2022
a904ff2
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 21, 2022
8822e9e
Remove set_config
bogdankostic Mar 21, 2022
7e9af75
Add os to conftest
bogdankostic Mar 21, 2022
c88a305
Integrate review comments
bogdankostic Mar 21, 2022
77fb60a
Set include_values to False
bogdankostic Mar 21, 2022
a2eb6cd
Remove quotation marks from pinecone.Index type
bogdankostic Mar 21, 2022
756f298
Update Documentation & Code Style
github-actions[bot] Mar 21, 2022
2c6ff82
Merge branch 'master' into pinecone-doc-store
bogdankostic Mar 21, 2022
e95c556
Merge remote-tracking branch 'origin/master' into pr/2254
bogdankostic Mar 21, 2022
8bdb974
Merge remote-tracking branch 'github-desktop-pinecone-io/pinecone-doc…
bogdankostic Mar 21, 2022
d9ef404
Update Documentation & Code Style
github-actions[bot] Mar 21, 2022
cbd8c16
Fix number of args in error messages
bogdankostic Mar 21, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions haystack/document_stores/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@

SQLDocumentStore = safe_import("haystack.document_stores.sql", "SQLDocumentStore", "sql")
FAISSDocumentStore = safe_import("haystack.document_stores.faiss", "FAISSDocumentStore", "faiss")
PineconeDocumentStore = safe_import("haystack.document_stores.pinecone", "PineconeDocumentStore", "pinecone")
if os.getenv("MILVUS1_ENABLED"):
MilvusDocumentStore = safe_import("haystack.document_stores.milvus1", "Milvus1DocumentStore", "milvus1")
else:
Expand Down
Loading