Explain Metadata implemention and usage in Pipelines vs Kubeflow core

[sarahmaddox]

Update the Metadata overview: There are discussions about merging the metadata UI (see section in the metadata overview) into the Pipelines UI - we need to design docs for UI metadata support. Contact: ajaygopinathan, prodonjs

[issue-label-bot]

Issue-Label Bot is automatically applying the label kind/feature to this issue, with a confidence of 0.84. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

[sarahmaddox]

From further discussions: Users will need metadata functionality for experimentation as well as for pipelines. It's possible that metadata will be implemented as an independent service that can be included in both pipelines and Kubeflow core. The UX team is working on a design for how the metadata service/UI will be exposed to users.

[jtfogarty]

/area docs
/priority p2

[sarahmaddox]

@animeshsingh Does this issue capture the required updates that you mentioned in today's Kubeflow community call?

@joeliedtke Is there someone from the Pipelines team who can comment from a Pipelines point of view?

@zhenghuiwang has done some excellent work on this doc to date. Zhenghui can you comment on the status of the doc (could it do with further updating) and also on the relationship to Pipelines Metadata? Is this something you may want to tackle during the February doc sprint?

[sarahmaddox]

/assign @zhenghuiwang

[zhenghuiwang]

I went through the metadata doc section with KF1.0 and updated it in #1641. The major change is to update the backend instruction to use gRPC service.

I think this covers how current Kubeflow metadata SDK, UI and backend work. I would leave it to @joeliedtke or @neuromage for Pipeline's view.

[sarahmaddox]

I went through the metadata doc section with KF1.0 and updated it in #1641. The major change is to update the backend instruction to use gRPC service.

I think this covers how current Kubeflow metadata SDK, UI and backend work. I would leave it to @joeliedtke or @neuromage for Pipeline's view.

Thanks @zhenghuiwang your Metadata update is great. I've created issue #1651 to cover the Metadata update for KF1.0. I think your PR can close that issue. Let's restyle this current issue to request a doc explaining the Metadata implemention and usage in Pipelines vs Kubeflow core.

/assign @neuromage
/unassign @zhenghuiwang
/cc @joeliedtke

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[animeshsingh]

/reopen
related discussion in kubeflow/metadata#225

[k8s-ci-robot]

@animeshsingh: Reopened this issue.

In response to this:

/reopen
related discussion in kubeflow/metadata#225

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.