Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(tableau): avoid duplicate schema in URNs for upstream tables #4645

Conversation

maaaikoool
Copy link
Contributor

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

I've found that the URN of the redshift upstream tables have the schema duplicated. I tried the ingestion after this PR hoping it would be fixed but we still have the same issue.

Turns out that the upstream tables name and full name both contain already the schema, so we are duplicating it. With this PR we check if there is a schema, the name and the full name are equal and the schema is already contained within the name.

Copy link
Contributor

@gabe-lyons gabe-lyons left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

@github-actions
Copy link

github-actions bot commented Apr 12, 2022

Unit Test Results (build & test)

  96 files  ±0    96 suites  ±0   14m 26s ⏱️ - 10m 13s
689 tests ±0  630 ✔️ ±0  59 💤 ±0  0 ±0 

Results for commit 22b444f. ± Comparison against base commit 23ece3b.

♻️ This comment has been updated with latest results.

@github-actions
Copy link

github-actions bot commented Apr 12, 2022

Unit Test Results (metadata ingestion)

       5 files  ±  0         5 suites  ±0   1h 1m 53s ⏱️ + 3m 21s
   425 tests +  2     425 ✔️ +  2    0 💤 ±0  0 ±0 
2 050 runs  +10  2 006 ✔️ +10  44 💤 ±0  0 ±0 

Results for commit 22b444f. ± Comparison against base commit 23ece3b.

♻️ This comment has been updated with latest results.

@gabe-lyons gabe-lyons merged commit 9a950ef into datahub-project:master Apr 12, 2022
maggiehays pushed a commit to maggiehays/datahub that referenced this pull request Aug 1, 2022
…ahub-project#4645)

* fix(tableau): avoid duplicate schema in URNs for upstream tables

* Fix(lint)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants