Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add patch data migration script for usage stats #12970

Merged

Conversation

ziqing26
Copy link
Contributor

Part of #12048

Outline of Solution

  • Batch select datastore entities, and then batch select SQL entities with the same start timestamps.
  • Compare the size of the two list, if is not equal, find the missing one in SQL and migrate it.

Copy link
Contributor

@FergusMok FergusMok left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for helping to investigate and fix this 👍

@ziqing26 ziqing26 merged commit 217ebc6 into TEAMMATES:v9-non-course-migration Mar 31, 2024
1 check passed
mingyuanc pushed a commit to mingyuanc/teammates that referenced this pull request Apr 14, 2024
* Add patch data migration script for usage stats

* Fix hibernate batch query

* Revert log
mingyuanc added a commit to mingyuanc/teammates that referenced this pull request Apr 14, 2024
weiquu added a commit that referenced this pull request Apr 17, 2024
* [#12048] Config prod settings and convenience scripts  for non course migration (#12959)

* Add fields

* Change based on feedback

* Add changes

* Add reverse data migration script for account (#12962)

* Add changes (#12965)

* V9 non course migration fix to check extra SQL accounts (#12966)

* Add changes

* Add isMarked script

* Add patch data migration script for usage stats (#12970)

* Add patch data migration script for usage stats

* Fix hibernate batch query

* Revert log

* Initial commit

* Revert "[#12048] Config prod settings and convenience scripts  for non course migration (#12959)"

This reverts commit 6df39c1.

* Revert "Add reverse data migration script for account (#12962)"

This reverts commit 0509982.

* Revert "V9 non course migration fix to check extra SQL accounts (#12966)"

This reverts commit 611b2cc.

* Revert "Add patch data migration script for usage stats (#12970)"

This reverts commit 239ae85.

* Revert "Add changes (#12965)"

This reverts commit 1292dbe.

* Fix lint

* Retry lint

---------

Co-authored-by: FergusMok <[email protected]>
Co-authored-by: Zhang Ziqing <[email protected]>
Co-authored-by: Wei Qing <[email protected]>
xenosf pushed a commit to xenosf/teammates that referenced this pull request Apr 17, 2024
* [TEAMMATES#12048] Config prod settings and convenience scripts  for non course migration (TEAMMATES#12959)

* Add fields

* Change based on feedback

* Add changes

* Add reverse data migration script for account (TEAMMATES#12962)

* Add changes (TEAMMATES#12965)

* V9 non course migration fix to check extra SQL accounts (TEAMMATES#12966)

* Add changes

* Add isMarked script

* Add patch data migration script for usage stats (TEAMMATES#12970)

* Add patch data migration script for usage stats

* Fix hibernate batch query

* Revert log

* Initial commit

* Revert "[TEAMMATES#12048] Config prod settings and convenience scripts  for non course migration (TEAMMATES#12959)"

This reverts commit 6df39c1.

* Revert "Add reverse data migration script for account (TEAMMATES#12962)"

This reverts commit 0509982.

* Revert "V9 non course migration fix to check extra SQL accounts (TEAMMATES#12966)"

This reverts commit 611b2cc.

* Revert "Add patch data migration script for usage stats (TEAMMATES#12970)"

This reverts commit 239ae85.

* Revert "Add changes (TEAMMATES#12965)"

This reverts commit 1292dbe.

* Fix lint

* Retry lint

---------

Co-authored-by: FergusMok <[email protected]>
Co-authored-by: Zhang Ziqing <[email protected]>
Co-authored-by: Wei Qing <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants