Skip to content
This repository was archived by the owner on Dec 2, 2021. It is now read-only.

Define metadata service API #5

Closed
zhenghuiwang opened this issue Apr 8, 2019 · 7 comments
Closed

Define metadata service API #5

zhenghuiwang opened this issue Apr 8, 2019 · 7 comments

Comments

@zhenghuiwang
Copy link
Contributor

zhenghuiwang commented Apr 8, 2019

For v0.6 CUJ, we need to define metadata service API:

  1. It should provide endpoints to create, read, update and delete metadata.
  2. It should be able to connect related metadata in a machine learning workflow.
  3. A UI for the CUJ can be built on top of this API and the built-in metadata(Define a set of metadata specifications for v0.6 #4),
  4. It can handle customized metadata in a similar way to built-in metadata.
@zhenghuiwang zhenghuiwang changed the title Define metadata server API Define metadata service API Apr 8, 2019
@zhenghuiwang
Copy link
Contributor Author

@jlewi
Copy link
Contributor

jlewi commented Apr 22, 2019

@zhenghuiwang How's this coming?

@zhenghuiwang
Copy link
Contributor Author

@neuromage and I should be able to send out a proposal this week.

@zhenghuiwang
Copy link
Contributor Author

zhenghuiwang commented May 11, 2019

#24 adds initial API and data model definitions

@jlewi
Copy link
Contributor

jlewi commented Jun 10, 2019

@zhenghuiwang What is the remaining work to be done on this issue?

@zhenghuiwang
Copy link
Contributor Author

An update on 4 items in this issue:

  1. It should provide endpoints to create, read, update and delete metadata.

It is almost done. We have CRUD endpoints for artifact, artifact type, execution and execution types.
Some API changes for artifact proto definition need to do.

  1. It should be able to connect related metadata in a machine learning workflow.

This is a stretch goal for logging the input/output relation between artifact and its execution. We may finish it later for artifact tracking with SDK and UI after this release.

  1. The CUJ can be built on top of this API and the built-in metadata(Define a set of metadata specifications for v0.6 #4),

It is done. Built-in metadata definitions for this CUJ are merged and can be loaded during service start.

4.It can handle customized metadata in a similar way to built-in metadata.

It is done. Built-in metadata are registered by the artifact type and execution type endpoints.

@zhenghuiwang
Copy link
Contributor Author

lineage tracking API is also added to the backend.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants