Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add base script for verifying migrated attributes #12841

Conversation

NicolasCwy
Copy link
Contributor

Outline of Solution
Add base script for verifying migrated attributes for the datastore migration

@NicolasCwy NicolasCwy self-assigned this Feb 26, 2024
@NicolasCwy NicolasCwy added a-Testing Testing-related traits such as efficiency, robustness, coverage c.Task Other non-user-facing works, e.g. refactoring, adding tests labels Feb 26, 2024
@NicolasCwy NicolasCwy merged commit ff9f3c8 into TEAMMATES:v9-non-course-data-migration Feb 26, 2024
1 check passed
ziqing26 added a commit that referenced this pull request Mar 10, 2024
* Add seed script

* [#12048] Add DataMigrationEntitiesBaseScriptSql and DataMigrationForAccountSql (#12766)

* Add hibernate connection

* Add DataMigrationEntitiesBaseScriptSql and example Account Migration

* [#12048] Add verify to seed db (#12767)

* Add verify

* Revert secrets

* Clean up seed script (#12768)

* Fix account migration script

* Add client property

* Add SQL notification migration script

* Modify seed script to persist to local database store

* Data migration for account

* Add seed data for data migration

* Add Account and Read Notification

* Remove comments

* [#12048] Add migration script for Usage Statistics (#12798)

* Add migration script for UsageStatistics

* Add seed script for usage statistics and add ofy support

* Set preview to true by default

* [#12048] Add migration script for Account Request (#12799)

* Add migration script for acc req

* Update migration script

* Add checks to notification script (#12836)

* Add checks to notification script

* Fix comments

* Create script to verify row count for non-course entities (#12824)

* Create script to verify row count

* Add read notification verification

* Add comment

* Add base script for verifying migrated attributes (#12841)

* Add datastore entity comparison function (except readNotification)

* Add verify attribute entity base script

Co-authored-by: Kevin Foong <[email protected]>

* Add verify usage statistics

* Add verification script for account request

* Amend base script to fetch lazily loaded keys

* Fix migration verification for notification

* Add migration verification script for account

* Save progress

* Add changes

* Fix bug

* Add changes

* Add support for pagination

* Add changes (#12846)

* Add a script to remove datastore non course entities and fix progress bar in seeddb

* Add warning for the script

* Add user check for removal script

* Revert remove script

* fix seed script to populate notification UUID correctly

* Remove unnecessary whitespace

* Add connection verification script

* Remove only one entity in Verify Connection Script

* Fix seeding of data for data migration (#12873)

* Fix notification and readNotification from having different endtime

* Fix seed data to create notification to nearest millisecond

* Remove commented out println

* Uncomment databundle persistance

* Remove unnecessary comments and fix format

* Revert logs in EntitesDb

* V9 Migration: Fix verification pagination, improve logging (#12874)

* Fix numPages division bug, add logging, testing paging

* Add logging

* Remove unnecessary function

* Remove unnecessary files, shift some functions

* Clean up branch

* Fix lint errors

* Fix lint errors v2

* Fix lint errors v3

* Fix spotBugsTest

---------

Co-authored-by: Nicolas Chang <[email protected]>
Co-authored-by: FergusMok <[email protected]>
Co-authored-by: Kevin Foong <[email protected]>
Co-authored-by: Kevin Foong <[email protected]>
Co-authored-by: Kevin Foong <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a-Testing Testing-related traits such as efficiency, robustness, coverage c.Task Other non-user-facing works, e.g. refactoring, adding tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants