Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tests-Only] Bump core test commit id to include new sharing tests #1184

Merged
merged 4 commits into from
Sep 23, 2020
Merged

[Tests-Only] Bump core test commit id to include new sharing tests #1184

merged 4 commits into from
Sep 23, 2020

Conversation

phil-davis
Copy link
Contributor

@phil-davis phil-davis commented Sep 18, 2020

  1. The ownCloud core API test suite is being sorted out so that there is a full suite of sharing test scenarios that follow the default reva workflow of:
    a) share a resource
    b) receiver accepts the shared resource
    c) receiver sees the resource in their /Shares folder
    ...

The relevant PRs today in core were:
owncloud/core#37916
owncloud/core#37918
owncloud/core#37919

Those add scenarios that do resharing.

  1. Split the ownCloud core API test suite into 6 parts so that each parrt has a reasonnable run time

  2. Adjust the names of some litmus drone steps so there is no confusion about which storage they test.

  3. Create separate storage-publiclink configs for owncloud and ocis storage so that these will be ready for anyone who wants to use them (or drone in the future)

@phil-davis
Copy link
Contributor Author

phil-davis commented Sep 18, 2020

Previous totals for core API scenarios was: https://cloud.drone.io/cs3org/reva/2586/7/7
1164 scenarios (420 passed, 744 failed)

There are a lot more sharing scenarios now - the run time reached 1 hour! I will split the pipeline...

https://cloud.drone.io/cs3org/reva/2594/7/7 - part 1, 7 min
runsh: Total 121 scenarios (56 passed, 65 failed)

https://cloud.drone.io/cs3org/reva/2594/8/7 - part 2, 8 min
runsh: Total 275 scenarios (106 passed, 169 failed)

https://cloud.drone.io/cs3org/reva/2594/9/7 - part 3, 48 min
runsh: Total 347 scenarios (28 passed, 319 failed)

https://cloud.drone.io/cs3org/reva/2594/10/7 - part 4, 12 min
runsh: Total 550 scenarios (230 passed, 320 failed)

Total so far: 1293 scenarios (420 passed, 873 failed)

There are so far 129 more scenarios that all fail. Need to also incude core change owncloud/core#37920

Part 3 takes by far the longest - most of the longer more complex scenarios are the sharing ones, and they happen to mostly fall into part 3.

@phil-davis
Copy link
Contributor Author

phil-davis commented Sep 20, 2020

Split into 6 parts now, that happens to split up the sharing suites a bit better:

  1. https://cloud.drone.io/cs3org/reva/2599/7/7 part 1, 6 min
    runsh: Total 70 scenarios (50 passed, 20 failed)

  2. https://cloud.drone.io/cs3org/reva/2599/8/7 part 2, 5 min
    runsh: Total 87 scenarios (22 passed, 65 failed)

  3. https://cloud.drone.io/cs3org/reva/2599/9/7 part 3, 18 min
    runsh: Total 315 scenarios (90 passed, 225 failed)

  4. https://cloud.drone.io/cs3org/reva/2599/10/7 part 4, 23 min
    runsh: Total 252 scenarios (0 passed, 252 failed)

  5. https://cloud.drone.io/cs3org/reva/2599/11/7 part 5, 8 min
    runsh: Total 175 scenarios (52 passed, 123 failed)

  6. https://cloud.drone.io/cs3org/reva/2599/12/7 part 6, 11 min
    runsh: Total 50 scenarios (1 passed, 49 failed)

Grand Total: 949 scenarios (215 passed, 734 failed)

@phil-davis
Copy link
Contributor Author

@ishank011 @labkode ready for review.

This includes resharing tests from ownCloud core in the API test pipelines.
The API tests are split into 4 separate pipelines so that the elapsed time
stays reasonable.
@ishank011 ishank011 merged commit 890e4c9 into cs3org:master Sep 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants