Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/stripe updates q4 2022 #56

Merged
merged 115 commits into from
Jan 31, 2023
Merged

Conversation

fivetran-reneeli
Copy link
Contributor

Are you a current Fivetran customer?

Internal
What change(s) does this PR introduce?

Incoming stripe updates include the following:

  • Bring the source relation column downstream from the addition of the union feature
  • Downstream changes from introducing the pricing source table which may replace the plan table depending on whether customer migrated to the Price API (some column names have changed in stripe__invoice_line_items)
  • prefix variables with "stripe__" so they may be used globally
  • Add new models stripe__invoice_details and stripe__account_daily_overview
  • Update stripe__invoice_line_items with pricing data and subscription_item_id
  • Remove the stripe__subscription_line_items model

For more info see PRs #54 and #55

Did you update the CHANGELOG?

  • Yes

Does this PR introduce a breaking change?

  • Yes (please provide breaking change details below.)
  • No (please provide an explanation as to how the change is non-breaking below.)

Did you update the dbt_project.yml files with the version upgrade (please leverage standard semantic versioning)? (In both your main project and integration_tests)

  • Yes

Is this PR in response to a previously created Bug or Feature Request

  • Yes, Issue/Feature [link bug/feature number here]
  • No

How did you test the PR changes?

  • BuildKite
  • Local (please provide additional testing details below)

Select which warehouse(s) were used to test the PR

  • BigQuery
  • Redshift
  • Snowflake
  • Postgres
  • Databricks
  • Other (provide details below)

Provide an emoji that best describes your current mood

💃

Feedback

We are so excited you decided to contribute to the Fivetran community dbt package! We continue to work to improve the packages and would greatly appreciate your feedback on our existing dbt packages or what you'd like to see next.

Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli a few more comments, but we are getting close!

Additionally, I noticed the .DS_Store file is in this repo. Would you mind removing that since it is not technically necessary.

models/stripe__customer_overview.sql Show resolved Hide resolved
models/stripe__customer_overview.sql Show resolved Hide resolved
models/stripe.yml Outdated Show resolved Hide resolved
models/stripe__invoice_line_item_details.sql Outdated Show resolved Hide resolved
Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli thanks for making all the changes I requested and responding to my questions.

I believe this will be the last review where I request changes! I have a few comments and requests in my review. Additionally, please apply the same CHANGELOG and README updates from the source review into this one.

Finally, the biggest request I have is to address the issue in the daily_overview model where the weekends (days without transactions) are showing as null. We have a good roadmap in Recurly on how to address this issue. Let me know if you would like for me to elaborate more on this piece.

models/stripe__customer_overview.sql Outdated Show resolved Hide resolved
models/stripe__daily_overview.sql Outdated Show resolved Hide resolved
models/stripe__daily_overview.sql Show resolved Hide resolved
@fivetran-reneeli
Copy link
Contributor Author

  • docs regen
  • change package deps

Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli thanks for making those final updates! After reviewing, this looks ready to go! I just have a few super minor comments and suggestions, but otherwise this is good to ship!

Comment on lines +23 to +30
| using_invoices | stripe__using_invoices
| using_credit_notes | stripe__using_credit_notes
| using_payment_method | stripe__using_payment_method
| using_livemode | stripe__using_livemode
| using_invoice_line_sub_filter | stripe__using_invoice_line_sub_filter
| using_subscriptions | stripe__using_subscriptions
| using_subscription_history | stripe__using_subscription_history
| using_price | stripe__using_price
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also include the name change for the stripe__plan_metadata variable

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added-- mentioned in its own bullet point since these rows are just for variables that have been prefixed with stripe__

select
date_spine.date_day,
date_spine.account_id,
balance_transaction.source_relation,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This field is showing as null for the days without transactions. To be consistent, let's use the date_spine source_relation field. Let me know if you have any concerns with this suggestion.

Suggested change
balance_transaction.source_relation,
date_spine.source_relation,

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ooh good catch, updated

packages.yml Outdated
Comment on lines 2 to 6
# - package: fivetran/stripe_source
# version: [">=0.8.0", "<0.9.0"]
- git: https://github.com/fivetran/dbt_stripe_source.git
revision: stripe_updates
warn-unpinned: false
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reminder to switch before release

packages.yml Outdated
Comment on lines 2 to 3
# - package: fivetran/stripe_source
# version: [">=0.8.0", "<0.9.0"]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# - package: fivetran/stripe_source
# version: [">=0.8.0", "<0.9.0"]
# - package: fivetran/stripe_source
# version: [">=0.9.0", "<0.10.0"]

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated

@fivetran-reneeli fivetran-reneeli merged commit dd3a84d into main Jan 31, 2023
@fivetran-reneeli fivetran-reneeli deleted the feature/stripe-updates-q4-2022 branch January 31, 2023 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status:in_review Currently in review type:enhancement New functionality or enhancement update_type:models Primary focus requires model updates
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants