Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ingest): type stubs for boto3 #2975

Merged
merged 56 commits into from
Jul 29, 2021
Merged

feat(ingest): type stubs for boto3 #2975

merged 56 commits into from
Jul 29, 2021

Conversation

kevinhu
Copy link
Contributor

@kevinhu kevinhu commented Jul 28, 2021 •
edited
Loading

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable)

kevinhu added 30 commits July 15, 2021 09:17
@kevinhu
Init endpoint models
4753f74
@kevinhu
Init lineage extractor
3c8e7e4
@kevinhu
Refactor model endpoint extraction
ef2f664
@kevinhu
Add model groups
f2e1d50
@kevinhu
Add model group lineage extraction
057a455
@kevinhu
Init endpoint stubs
393f8ec
@kevinhu
Successful endpoint ingestion
a6e2173
@kevinhu
Endpoint lineage stubs
821994a
@kevinhu
Add endpoint field to model schema
4612045
@kevinhu
Stubs for model group lineage
18a9001
@kevinhu
Ingest model-group lineage
4eda319
@kevinhu
Formatting
77640af
@kevinhu
More comments
4ad6638
@kevinhu
Refactor status types
0220e7f
@kevinhu
Merge branch 'master' of github.com:kevinhu/datahub into sagemaker-mo…
11546c2 
…del-endpoints
@kevinhu
Merge
61db239
@kevinhu
Fix context typo
160edab
@kevinhu
Init model group entity
0ae0ed8
@kevinhu
Ingest model groups
698940c
@kevinhu
Reorder models and groups
d8931db
@kevinhu
Successful model group lineage ingestion
1fc4461
@kevinhu
Ingest dataowners
7c3628f
@kevinhu
Sort
7f1bf48
@kevinhu
Ingest model group description
4875083
@kevinhu
Init hyperparams and metrics aspects
581dfd9
@kevinhu
External links for Glue jobs
471f8c5
@kevinhu
SageMaker job URLs
4469e37
@kevinhu
Add external URLs to models
4cf997b
@kevinhu
Ingest model URLs
2a36fb6
@kevinhu
Hyperparam ingestion
444525e
kevinhu and others added 23 commits July 19, 2021 10:26
@kevinhu
Rename endpoint -> deployment
a6aaef5
@kevinhu
Merge branch 'master' of github.com:kevinhu/datahub into sagemaker-mo…
c44bff2 
…del-endpoints
@kevinhu
Metrics ingestion
9a72890
@kevinhu
Merge
5713172
@kevinhu
Merge
02b1289
@kevinhu
Add external URLs for endpoints
063e247
@kevinhu
Ingest endpoint URLs
cd43b58
@kevinhu
Remove unnecessary aspects
54b1496
@kevinhu
Set hyperparameter type to string
dea8883
@kevinhu
Strip quotes
c7e85fb
@kevinhu
Merge branch 'sagemaker-model-metrics' of github.com:kevinhu/datahub …
fbec85d 
…into boto-stubs
@kevinhu
Working types
d937be0
@kevinhu
Use proper types for models
f963701
@kevinhu
Use proper types for sagemaker lineage
16bcf44
@kevinhu
Use proper types for sagemaker feature groups
f185c34
@kevinhu
Stubs for jobs
984f463
@kevinhu
Merge branch 'linkedin:master' into boto-stubs
0d80da4
@kevinhu
Merge branch 'master' of github.com:kevinhu/datahub into boto-stubs
67241ca
@kevinhu
Merge
5fb8b54
@kevinhu
Fix browse paths
84f2b47
@kevinhu
Remove unused
f11c624
@kevinhu
Fix literal type import
58a1682
@kevinhu
Remove print
dab1b0d
@kevinhu kevinhu marked this pull request as ready for review July 28, 2021 21:30
shirshanka
shirshanka approved these changes Jul 28, 2021
View reviewed changes
Copy link
Contributor

@shirshanka shirshanka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

shirshanka
shirshanka approved these changes Jul 29, 2021
View reviewed changes
Copy link
Contributor

@shirshanka shirshanka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@shirshanka shirshanka merged commit bf2775f into datahub-project:master Jul 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shirshanka shirshanka shirshanka approved these changes

@hsheth2 hsheth2 hsheth2 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@kevinhu @shirshanka @hsheth2