Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VectorSearch] Update opensearch and update cluster configuration for memory management #602

Merged
merged 1 commit into from
May 24, 2024

Conversation

PierreGauthier
Copy link
Contributor

Q A
Branch? master for features / current stable version branch for bug fixes
Tickets #...
License OSL-3.0

@github-actions github-actions bot added the backend PR targets backend application label May 24, 2024
Copy link

Coverage report for commit: e2ee40e
File: api/coverage/coverage.xml

Summary - Lines: 87.10% 🔽 | Methods: 84.83% 🔽
FilesLinesMethodsBranches
/api/vendor/gally/gally-premium
   .php-cs-fixer.dist.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/DataPersister
   BoostDataPersister.php92.86%80.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/DataProvider
   BoostDataProvider.php94.12%80.00%100.00%
   ModelOptionDataProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/DataProvider/Source
   LimitationTypeOptionDataProvider.php100.00%100.00%100.00%
   QueryTextOperatorOptionDataProvider.php100.00%100.00%100.00%
   RequestTypeOptionDataProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Decoration/Search/Elasticsearch/Builder/Request/Query
   QueryBuilder.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/DependencyInjection
   Configuration.php100.00%100.00%100.00%
   GallyBoostExtension.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src
   GallyBoostBundle.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Migrations
   Version20230308134429_Add_Initial_Boost_Tables.php--100.00%
/api/vendor/gally/gally-premium/Boost/src/Model
   Boost.php100.00%100.00%100.00%
   BoostPreview.php62.50%57.14%100.00%
/api/vendor/gally/gally-premium/Boost/src/Model/Boost
   CategoryLimitation.php100.00%100.00%100.00%
   RequestType.php100.00%100.00%100.00%
   SearchLimitation.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/OpenApi
   BoostDecorator.php40.00%50.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Repository/Boost
   CategoryLimitationRepository.php100.00%100.00%100.00%
   RequestTypeRepository.php100.00%100.00%100.00%
   SearchLimitationRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Repository
   BoostRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Resolver
   BoostPreviewResolver.php98.65%80.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Service
   BoostApplier.php95.65%66.67%100.00%
   LimitationTypeProvider.php100.00%100.00%100.00%
   ModelProvider.php100.00%100.00%100.00%
   QueryTextOperatorProvider.php100.00%100.00%100.00%
   RequestTypeProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Service/Function/Provider
   DefaultProvider.php100.00%100.00%100.00%
   Exclude.php83.33%-100.00%
   FunctionProviderInterface.php100.00%100.00%100.00%
   Replace.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Service/Limitation
   CategoryLimitation.php100.00%100.00%100.00%
   LimitationInterface.php100.00%100.00%100.00%
   QueryTextLimitation.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Service/Model
   ConstantScore.php81.82%75.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Validator/ModelConfig
   ConstantScoreValidator.php100.00%100.00%100.00%
   ModelConfigValidatorInterface.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Boost/src/Validator
   ModelConfigConstraint.php100.00%100.00%100.00%
   ModelConfigConstraintValidator.php100.00%100.00%100.00%
   ModelConstraintValidator.php100.00%100.00%100.00%
   QueryTextOperatorConstraintValidator.php100.00%100.00%100.00%
   RequestTypeConstraintValidator.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/DataProvider
   ExplainProductDataProvider.php100.00%100.00%100.00%
   Paginator.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/DataProvider/Source
   RequestTypeOptionDataProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Decoration/GraphQl
   AddEntityTypeInContext.php100.00%100.00%100.00%
   AddExplainData.php100.00%100.00%100.00%
   AddExplainType.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/DependencyInjection
   Configuration.php100.00%100.00%100.00%
   GallyExplainExtension.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src
   GallyExplainBundle.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Model
   ExplainDocument.php100.00%100.00%100.00%
   ExplainProduct.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/OpenApi
   ExplainDecorator.php40.00%50.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Repository
   ExplainRepository.php30.56%33.33%100.00%
/api/vendor/gally/gally-premium/Explain/src/Serializer
   ExplainProductDenormalizer.php95.24%66.67%100.00%
/api/vendor/gally/gally-premium/Explain/src/Service/Collector
   CollectorInterface.php100.00%100.00%100.00%
   Position.php100.00%100.00%100.00%
   Synonym.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Service
   ExplainConfig.php66.67%50.00%100.00%
   RequestTypeProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Service/ExplainProduct
   DescriptionsGenerator.php100.00%100.00%100.00%
   Highlights.php89.29%50.00%100.00%
   SynonymManager.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Explain/src/Service/Hydrator
   ExplainProductHydrator.php89.60%71.43%100.00%
   ExplainProductHydratorFactory.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/DataPersister/Thesaurus
   ExpansionDataPersister.php89.66%80.00%100.00%
   SynonymDataPersister.php89.66%80.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/DataPersister
   ThesaurusDataPersister.php96.51%83.33%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Decoration/Index/Service
   IndexSettings.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Decoration/Search/Elasticsearch/Builder/Request/Query/Fulltext
   FulltextQueryBuilder.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/DependencyInjection
   Configuration.php100.00%100.00%100.00%
   GallyThesaurusExtension.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/EventSubscriber
   ReindexThesaurus.php100.00%100.00%100.00%
   SetThesaurusIndexerContext.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src
   GallyThesaurusBundle.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Migrations
   Version20230407155058_Add_Initial_Thesaurus_Tables.php--100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Model
   Thesaurus.php94.44%92.86%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Model/Thesaurus
   Expansion.php80.95%90.00%100.00%
   Locale.php100.00%100.00%100.00%
   Synonym.php77.78%87.50%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Model/Thesaurus/Expansion
   Term.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Model/Thesaurus/Synonym
   Term.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Repository/Thesaurus/Expansion
   TermRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Repository/Thesaurus
   ExpansionRepository.php100.00%100.00%100.00%
   LocaleRepository.php100.00%100.00%100.00%
   SynonymRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Repository/Thesaurus/Synonym
   TermRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Repository
   ThesaurusRepository.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Service
   Indexer.php100.00%100.00%100.00%
   ThesaurusManager.php93.14%76.92%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Service/Indexer
   ThesaurusIndexerContext.php87.50%66.67%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Service/ThesaurusConfiguration
   ThesaurusConfiguration.php100.00%100.00%100.00%
   ThesaurusConfigurationFactory.php100.00%100.00%100.00%
   ThesaurusConfigurationInterface.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/Thesaurus/src/Validator
   ThesaurusScopeConstraint.php100.00%100.00%100.00%
   ThesaurusScopeConstraintValidator.php100.00%100.00%100.00%
   ThesaurusTypeConstraint.php100.00%100.00%100.00%
   ThesaurusTypeConstraintValidator.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Command
   UploadModel.php--100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Controller
   DeployModel.php100.00%100.00%100.00%
   UndeployModel.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/DataPersister
   ModelDataPersister.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/DataProvider
   DocumentDataProvider.php--100.00%
   ModelDataProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/DataProvider/VectorConfiguration
   CollectionDataProvider.php100.00%100.00%100.00%
   ItemDataProvider.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Decoration
   AddEmbeddingFieldInMapping.php100.00%100.00%100.00%
   AddVectorSettingsInIndex.php66.67%57.14%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/DependencyInjection
   Configuration.php100.00%100.00%100.00%
   GallyVectorSearchExtension.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/EventSubscriber
   UpdatePipelineVectorSourceFieldData.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src
   GallyVectorSearchBundle.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Hydrator
   VectorConfigurationHydrator.php91.67%50.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Migrations
   Version20231117151709_Add_Vector_Search_Tables.php--100.00%
   Version20231130101656_Add_Vector_Position_Prompt_Tables.php--100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Model
   Model.php62.96%90.00%100.00%
   Task.php80.00%75.00%100.00%
   VectorConfiguration.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/OpenApi
   DocumentDecorator.php40.00%50.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Repository/Model
   ModelRepository.php88.17%44.44%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Repository/Task
   TaskRepository.php91.67%50.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/Repository
   VectorConfigurationRepository.php94.74%87.50%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/SearchClient/OpenSearch/Adapter/Common/Request/Query/Assembler
   Neural.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/SearchClient/OpenSearch/Builder/Request/Query
   VectorQueryBuilder.php100.00%100.00%100.00%
/api/vendor/gally/gally-premium/VectorSearch/src/SearchClient/OpenSearch/Endpoints/MachineLearning/Connectors
   CreateConnector.php--100.00%
   DeleteConnector.php--100.00%
Table truncated to fit comment

Backend Coverage compared to target branch

Copy link

Frontend Coverage of this branch

File Coverage
All files 24%
src/components/App/App.tsx 0%
src/components/Cms/Pages.tsx 0%
src/components/Facets/Facet.styled.ts 0%
src/components/Facets/Facet.tsx 0%
src/components/Facets/FacetBoolean.tsx 0%
src/components/Facets/FacetCategory.tsx 0%
src/components/Facets/FacetChoice.tsx 0%
src/components/Facets/FacetLoadMore.tsx 0%
src/components/Facets/FacetSlider.tsx 0%
src/components/Facets/Facets.tsx 0%
src/components/Header/Header.tsx 59%
src/components/Layout/Layout.tsx 0%
src/components/Menu/Menu.tsx 0%
src/components/Menu/MenuItem.tsx 0%
src/components/Menu/MenuList.tsx 0%
src/components/PageLayout/PageLayout.tsx 0%
src/components/PageTitle/PageTitle.tsx 0%
src/components/Products/ProductCard.tsx 0%
src/components/Products/Products.tsx 0%
src/components/Providers/AppProvider/AppProvider.tsx 0%
src/components/Providers/CatalogProvider/CatalogProvider.tsx 0%
src/components/Providers/CategoryProvider/CategoryProvider.tsx 0%
src/components/Providers/ConfigurationsProvider/ConfigurationsProvider.tsx 0%
src/components/Providers/ExtraBundlesProvider/ExtraBundlesProvider.tsx 0%
src/components/Providers/SchemaProvider/SchemaProvider.tsx 0%
src/components/Providers/SchemaProvider/RequestedPathProvider/RequestedPathProvider.tsx 0%
src/components/Providers/SearchProvider/SearchProvider.tsx 0%
src/components/Providers/UserProvider/UserProvider.tsx 0%
src/components/Search/Search.styled.tsx 0%
src/components/SearchBar/SearchBar.tsx 5%
src/components/Tabs/TabPanel.tsx 0%
src/components/Tabs/Tabs.tsx 0%
src/components/Tabs/a11yProps.tsx 0%
src/components/Title/Title.tsx 0%
src/components/TwoColsLayout/TwoColsLayout.tsx 0%
src/components/VectorSearch/ProductList.tsx 0%
src/hooks/index.ts 0%
src/hooks/useApi.ts 84%
src/hooks/useDocuments.ts 57%
src/hooks/useGraphql.ts 89%
src/hooks/useProducts.ts 53%
src/hooks/useUser.ts 95%
src/hooks/useVectorSearchDocuments.ts 57%
src/pages/Category/Category.tsx 0%
src/pages/Homepage/Homepage.tsx 0%
src/pages/Login/Login.tsx 0%
src/pages/Search/CmsSearch.tsx 0%
src/pages/Search/ProductSearch.tsx 0%
src/pages/Search/Search.tsx 0%
src/pages/VectorSearch/VectorSearch.tsx 0%

Minimum allowed coverage is 1%

Generated by 🐒 cobertura-action against e2ee40e

@botisSmile
Copy link
Contributor

As discussed, I think you can update the commit message according to the real content of your commit.

@PierreGauthier PierreGauthier changed the title [VectorSearch] Add more RAM to opensearch [VectorSearch] Update opensearch and update cluster configuration for memory management May 24, 2024
@PierreGauthier PierreGauthier merged commit 8eaf607 into 1.3.x May 24, 2024
2 of 3 checks passed
@PierreGauthier PierreGauthier deleted the fix-autoDeployModel branch May 24, 2024 15:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend PR targets backend application
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants