Skip to content

Commit

Permalink
Add Connectors and ML updates for 2.9 (opensearch-project#4554)
Browse files Browse the repository at this point in the history
* Add Connectors and ML updates for 2.9

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix code block

Signed-off-by: Naarcha-AWS <[email protected]>

* Add Connectors and ML updates for 2.9

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix code block

Signed-off-by: Naarcha-AWS <[email protected]>

* Add connector settings and examples

Signed-off-by: Naarcha-AWS <[email protected]>

* Add GA warning

Signed-off-by: Naarcha-AWS <[email protected]>

* Add final experimental warning

Signed-off-by: Naarcha-AWS <[email protected]>

* Address tech review. Fix typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix bad link. Add next steps section

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typo

Signed-off-by: Naarcha-AWS <[email protected]>

* Update cluster-settings.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _ml-commons-plugin/connectors.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Change cluster values for boolean. Fix typo.

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Fix cluser settings

Signed-off-by: Naarcha-AWS <[email protected]>

* Add missing config options. More technical feedback.

Signed-off-by: Naarcha-AWS <[email protected]>

* Adjust cluster setting description.

Signed-off-by: Naarcha-AWS <[email protected]>

* Add updated ChatGPT example

Signed-off-by: Naarcha-AWS <[email protected]>

* Add info and example for internal connector.

Signed-off-by: Naarcha-AWS <[email protected]>

* One last adjustment.

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Fix dead link

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix one last comment.

Signed-off-by: Naarcha-AWS <[email protected]>

* change ordered list to numbered.

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
  • Loading branch information
3 people authored and harshavamsi committed Oct 31, 2023
1 parent da5f0bb commit 2737893
Show file tree
Hide file tree
Showing 7 changed files with 502 additions and 26 deletions.
2 changes: 1 addition & 1 deletion STYLE_GUIDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ Use lowercase when referring to features, unless you are referring to a formally
**Remote-backed storage* is an experimental feature. Therefore, we do not recommend the use of *remote-backed storage* in a production environment.”
* “You can take and restore *snapshots* using the snapshot API.”
* “You can use the *VisBuilder* visualization type in OpenSearch Dashboards to create data visualizations by using a drag-and-drop gesture.” (You can refer to VisBuilder alone or qualify the term with “visualization type”.)
* “As of OpenSearch 2.4, the *model-serving framework* only supports text embedding models without GPU acceleration.”
* “As of OpenSearch 2.4, the *ML framework* only supports text-embedding models without GPU acceleration.”

#### Plugin names

Expand Down
25 changes: 20 additions & 5 deletions _ml-commons-plugin/cluster-settings.md
Original file line number Diff line number Diff line change
Expand Up @@ -148,7 +148,7 @@ plugins.ml_commons.allow_registering_model_via_url: false
### Values

- Default value: false
- Value range: [false, true]
- Valid values: `false`, `true`

## Register models using local files

Expand All @@ -163,7 +163,7 @@ plugins.ml_commons.allow_registering_model_via_local_file: false
### Values

- Default value: false
- Value range: [false, true]
- Valid values: `false`, `true`

## Add trusted URL

Expand Down Expand Up @@ -230,7 +230,7 @@ plugins.ml_commons.allow_custom_deployment_plan: false
### Values

- Default value: false
- Value range: [false, true]
- Valid values: `false`, `true`

## Enable auto redeploy

Expand All @@ -245,7 +245,7 @@ plugins.ml_commons.model_auto_redeploy.enable: false
### Values

- Default value: false
- Value range: [false, true]
- Valid values: `false`, `true`

## Set retires for auto redeploy

Expand Down Expand Up @@ -290,7 +290,22 @@ plugins.ml_commons.enable_inhouse_python_model: false
### Values

- Default value: false
- Value range: [false, true]
- Valid values: `false`, `true`

## Enable access control for connectors

When set to `true`, the setting allows admins to control access and permissions to the connector API using `backend_roles`.

### Setting

```
plugins.ml_commons.connector_access_control_enabled: true
```

### Values

- Default value: false
- Valid values: `false`, `true`



Expand Down
Loading

0 comments on commit 2737893

Please sign in to comment.