10.3. - smoke test results

[davitol]

Smoke test with 10.3. RC1 version

Previous requirements

Prepare two servers with ssl activated and trusted certificates.

Enable LDAP and external storage apps.

Have a LDAP server ready to be used with owncloud.

Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.

Scenarios to consider:

• OAuth2 and sync + mobile clients ( can be deployed remotely ) @davitol
• LDAP @davitol
• Shibboleth @davitol
• Windows Network Drive (also use it as sync target )
• Guests @davitol
• Impersonate @davitol
• Login with App Token Login @davitol
• TOTP @davitol

Testing setup

TestID	Test Case	Expected Result	Result	Related Comment
1	Enable encryption app and encryption default module	Encryption is enabled correctly	✔️
2	Populate owncloud server with users and groups	Users and groups are correctly created	✔️
3	Share a folder remotely using federated sharing with admin user of the other server.	folder can be opened in recipient server without problems	✔️	issue (no regression) #35042
4	Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar.	Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists.	✔️
5	Set up two external storages different, disable encryption in one of them.	No errors in this process	✔️

Testing functionality

TestID	Test Case	Expected Result	Result	Related Comment
1	Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2.	Admin user in server #2 can see the file.	✔️
2	Open internet explorer or edge and upload a new avatar for a regular user not LDAP	Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine.	✔️
3	Upload several files and folders inside external storages, open some.	No problems uploading, files can be downloaded and opened.	✔️	To be investigated. WebDAV storage seems to not work #35660
4	Delete files inside both external storages. Recover some after from the trashbin.	Files are correctly deleted and restored.	✔️
5	Using webdav upload a 100MiB file.	No errors in this process	✔️

[davitol]

Issues found while testing 10.3 alpha2 tarball

• api for public link share email notification does not obey Allow users to send mail notification for shared filesapi for public link share email notification does not obey Allow users to send mail notification for shared files #36156
• Deleting passcode doesn't disconnect the client Deleting passcode doesn't disconnect the client #36146
• webinstaller does not work with 10.3.0alpha2 webinstaller does not work with 10.3.0alpha2 #36149 @davitol
• app-external is not created on upgrade app-external is not created on upgrade #36151
• S3 files external mountpoints are no longer available when upgrading from oC 10.2.1 to 10.3 alpha2 S3 files external mountpoints are no longer available when upgrading from oC 10.2.1 to 10.3 alpha2 files_external_s3#235 @davitol
• Wrong share ID message is not shown properly Wrong share ID message is not shown properly #36181
• Thumbnail gets shifted when mousing over the 3 dots menu options using Chrome as browser Thumbnail gets shifted when mousing over the 3 dots menu options using Chrome as browser #36183 @davitol

[jesmrec]

Mobile tests

Sharing feature was deeply tested in 10.3alpha. You can check here the results:

https://github.com/owncloud/QA/blob/master/Mobile/GenericTPs/Sharing.md

Regarding alpha2:

• Checking different authentication situations, including SAML (only Android), redirections.
• Smoke test over the main features
• Sanity tests over Sharing.

Only was detected an issue in Android client when uploading files in guest app, but not a regression.

Here you have the tests performed:

Smoke test iOS

Device & iOS version: iPhoneXR v12.2
iOS app version: 1.0.4 (latest stable)
Server version: 10.3alpha2
OAuth2 version: 0.4.1

Login

Test Case	Expected Result	Result	Related Comment
Login basic	It is possible to access	✅
Login basic wrong credentials	Correct error	✅
Login OAuth2	It is possible to access	✅
OAuth2 revoked token	redirected to login	✅
Redirection 301	It is possible to access	✅
Redirection 302	It is possible to access	✅
Login Guest	It is possible to access	✅
Login App Password	It is possible to access	✅
SAML	It is possible to access	❌	SAML not available in iOS anymore
Issue #35888	No exception in core logs when creating OAuth2 session	✅

Folder

TestID	Test Case	Steps	Expected Result	Result	Related Comment
Create a new folder	1. Tap on create a new folder	The folder is created	✅ OAuth ✅ basic
Create a folder with special character	1. Tap on create a new folder 2. Use a name with special characters (e.g $%&¨)	The folder is created with special character	✅ OAuth ✅ basic
Rename a folder	1. Create a new folder 2. Rename the folder	Folder is renamed	✅ OAuth ✅ basic
Move a folder	1. Create a new folder 2. Move the folder	Folder is moved to the specifield location	✅ OAuth ✅ basic
Upload a file into a folder	1. Create a new folder 2. Upload a file	File is uploaded into the folder	✅ OAuth ✅ basic
Delete a folder	1. Access to a folder, the folder has deep structure inside 2. Download some files 3. Select delete that folder	2. The files are downloaded 3. The folder is removed	✅ OAuth ✅ basic
Copy Folder	1. Long press to copy a folder 2. Select a location to paste	The folder and all its content is copied in the location, and remains too in the original	✅ OAuth ✅ basic

File

Test Case	Steps	Expected Result	Result	Related Comment
Upload a new file	1. Upload a new file	The file is uploaded	✅ OAuth ✅ basic
Upload many files	1. Upload many files at the time	Files are uploaded	✅ basic ✅ basic ✅ OAuth2
Rename a file	1. Create a new file 2. Rename the file	The file is renamed	✅ OAuth ✅ basic
Duplicate a file	1. Create a new file 2. Duplicate the file	The file is duplicated	✅ OAuth ✅ basic
Move a file	1. Create a new file 2. Move the file	The file is renamed	✅ OAuth ✅ basic
Copy a file	1. Create a new file 2. Copy the file	The file is copied to the selected location	✅ OAuth ✅ basic
Delete a file	1. Create a new file 2. Delete the file	The file is deleted	✅ OAuth ✅ basic
Download a file	1. Tap to download a large file	The file is downloaded and marked with green tick	✅ OAuth ✅ basic

Sharing (OAuth2)

Test Case	Result	Related Comment
Share file with a user	✅
Share folder with a user	✅
Share with a group	✅
Share file with only edit	✅
Share file with only share	✅
Share file with no permissions	✅
Edit share permissions file	✅
Remove share	✅
Resharing	✅
Resharing no permissions	✅
Name	✅
Down / view perm	✅
Down / view / edit perm	✅
upload only perm	✅
Password	✅
Expiration date	✅
Password enforced	✅
Expiration date default	✅
Expiration date enforced	✅
Passw & Expiration date enforced	✅
Remove public link	✅

Smoke test Android

Device & Android version: Xiaomi MI v9
Android app version: 2.12
Server version: 10.3alpha2
OAuth2 version: 0.4.1
SAML version: 3.3.0

Login

Test Case	Expected Result	Result	Related Comment
Login basic	It is possible to access	✅
Login basic wrong credentials	Correct error	✅
Login OAuth2	It is possible to access	✅
OAuth2 revoked token	redirected to login	✅
Redirection 301	It is possible to access	✅
Redirection 302	It is possible to access	✅
Login Guest	It is possible to access	✅	login OK, but uploads... owncloud/android#2653
Login App Password	It is possible to access	✅
Login SAML	It is possible to access	✅	LDAP server
Issue #35888	No exception in core logs when creating OAuth2 session	✅

Folder

Test Case	Steps	Expected Result	Result	Related Comment
Create a new folder	1. Tap on create a new folder	The folder is created	✅ basic ✅ OAuth2
Create a folder with special character	1. Tap on create a new folder 2. Use a name with special characters (e.g $%&¨)	The folder is created with special character	✅ basic ✅ OAuth2
Rename a folder	1. Create a new folder 2. Rename the folder	Folder is renamed	✅ basic ✅ OAuth2
Move a folder	1. Create a new folder 2. Move the folder	Folder is moved to the specifield location	✅ basic ✅ OAuth2
Upload a file into a folder	1. Create a new folder 2. Upload a file	File is uploaded into the folder	✅ basic ✅ OAuth2
Delete a folder	1. Access to a folder, the folder has deep structure inside 2. Download some files 3. Select delete that folder	2. The files are downloaded 3. The folder is removed	✅ basic ✅ OAuth2
Copy Folder	1. Long press to copy a folder 2. Select a location to paste	The folder and all its content is copied in the location, and remains too in the original	✅ basic ✅ OAuth2
Sync a folder	1. Create a folder 2. In web app, upload some files in the folder 3. Long press to sync the folder	The folder is sync with the content on server	✅ basic ✅ OAuth2

File

Test Case	Steps	Expected Result	Result	Related Comment
Upload a new file	1. Upload a new file	The file is uploaded	✅ basic ✅ OAuth2
Upload many files	1. Upload many files at the time	Files are uploaded	✅ basic ✅ basic ✅ OAuth2
Rename a file	1. Create a new file 2. Rename the file	The file is renamed	✅ basic ✅ OAuth2
Move a file	1. Create a new file 2. Move the file	The file is renamed	✅ basic ✅ OAuth2
Copy a file	1. Create a new file 2. Copy the file	The file is copied to the selected location	✅ basic ✅ OAuth2
Delete a file	1. Create a new file 2. Delete the file	The file is deleted	✅ basic ✅ OAuth2
Download a file	1. Tap to download a file	The file is downloaded and marked with green arrow	✅ basic ✅ OAuth2
Av Offline file	1. Long press to set as Av Offline a file	The file is downloaded and set as Av Offline with the yellow arrow	✅ basic ✅ OAuth2
Av Offline file	1. Long press to unset an Av Offline a Av Offline file	The file has no more the yellow arrow	✅ basic ✅ OAuth2

Sharing (OAuth2)

Test Case	Result	Related Comment
Share file with a user	✅
Share folder with a user	✅
Share with a group	✅
Share file with only edit	✅
Share file with only share	✅
Share file with no permissions	✅
Edit share permissions file	✅
Remove share	✅
Resharing	✅
Resharing no permissions	✅
Name	✅
Down / view perm	✅
Down / view / edit perm	✅
upload only perm	✅
Password	✅
Expiration date	✅
Password enforced	✅
Expiration date default	✅
Expiration date enforced	✅
Passw & Expiration date enforced	✅
Remove public link	✅

[micbar]

@davitol @HanaGemela
#36193 will be in RC.

Issue: #36107

Needs testing:

• Server: Resharing permissions
• Server: Transfer ownership (occ command)
• Desktop: Resharing permissions

[davitol]

Tested Community and Enterprise Final Tarballs

Smoke test

Previous requirements

Prepare two servers with ssl activated and trusted certificates.

Enable LDAP and external storage apps.

Have a LDAP server ready to be used with owncloud.

Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.

Scenarios to consider:

• OAuth2 and sync + mobile clients ( can be deployed remotely ) @davitol
• LDAP @davitol
• Shibboleth @davitol (Tested with autoprovision Mode)
• Windows Network Drive (also use it as sync target ) @davitol
• Guests @davitol
• Impersonate @davitol
• Login with App Token Login @davitol
• TOTP @davitol

Testing setup

TestID	Test Case	Expected Result	Result	Related Comment
1	Enable encryption app and encryption default module	Encryption is enabled correctly	✔️
2	Populate owncloud server with users and groups	Users and groups are correctly created	✔️
3	Share a folder remotely using federated sharing with admin user of the other server.	folder can be opened in recipient server without problems	✔️	issue (no regression) #35042
4	Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar.	Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists.	✔️
5	Set up two external storages different, disable encryption in one of them.	No errors in this process	✔️

Testing functionality

TestID	Test Case	Expected Result	Result	Related Comment
1	Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2.	Admin user in server #2 can see the file.	✔️
2	Open internet explorer or edge and upload a new avatar for a regular user not LDAP	Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine.	✔️
3	Upload several files and folders inside external storages, open some.	No problems uploading, files can be downloaded and opened.	❌	To be investigated. WebDAV storage seems to not work #35660
4	Delete files inside both external storages. Recover some after from the trashbin.	Files are correctly deleted and restored.	✔️
5	Using webdav upload a 100MiB file.	No errors in this process	✔️

[davitol]

Mobile tests

Login

Test Case	Expected Result	Result	Related Comment
Login basic	It is possible to access	✅
Login basic wrong credentials	Correct error	✅
Login OAuth2	It is possible to access	✅
OAuth2 revoked token	redirected to login	❓	Android client. oauth2 + app token. Account is deleted from Android Client
Redirection 301	It is possible to access	✅
Redirection 302	It is possible to access	✅
Login Guest	It is possible to access	✅
Login App Password	It is possible to access	✅

Folder

TestID	Test Case	Steps	Expected Result	Result	Related Comment
Create a new folder	1. Tap on create a new folder	The folder is created	✅ OAuth ✅ basic
Create a folder with special character	1. Tap on create a new folder 2. Use a name with special characters (e.g $%&¨)	The folder is created with special character	✅ OAuth ✅ basic
Rename a folder	1. Create a new folder 2. Rename the folder	Folder is renamed	✅ OAuth ✅ basic
Move a folder	1. Create a new folder 2. Move the folder	Folder is moved to the specifield location	✅ OAuth ✅ basic
Upload a file into a folder	1. Create a new folder 2. Upload a file	File is uploaded into the folder	✅ OAuth ✅ basic
Delete a folder	1. Access to a folder, the folder has deep structure inside 2. Download some files 3. Select delete that folder	2. The files are downloaded 3. The folder is removed	✅ OAuth ✅ basic
Copy Folder	1. Long press to copy a folder 2. Select a location to paste	The folder and all its content is copied in the location, and remains too in the original	✅ OAuth ✅ basic

File

Test Case	Steps	Expected Result	Result	Related Comment
Upload a new file	1. Upload a new file	The file is uploaded	✅ OAuth ✅ basic
Upload many files	1. Upload many files at the time	Files are uploaded	✅ basic ✅ basic ✅ OAuth2
Rename a file	1. Create a new file 2. Rename the file	The file is renamed	✅ OAuth ✅ basic
Duplicate a file	1. Create a new file 2. Duplicate the file	The file is duplicated	✅ OAuth ✅ basic
Move a file	1. Create a new file 2. Move the file	The file is renamed	✅ OAuth ✅ basic
Copy a file	1. Create a new file 2. Copy the file	The file is copied to the selected location	✅ OAuth ✅ basic
Delete a file	1. Create a new file 2. Delete the file	The file is deleted	✅ OAuth ✅ basic
Download a file	1. Tap to download a large file	The file is downloaded and marked with green tick	✅ OAuth ✅ basic

Sharing (OAuth2)

Test Case	Result	Related Comment
Share file with a user	✅
Share folder with a user	✅
Share with a group	✅
Share file with only edit	✅
Share file with only share	✅
Share file with no permissions	✅
Edit share permissions file	✅
Remove share	✅
Resharing	✅
Resharing no permissions	✅
Name	✅
Down / view perm	✅
Down / view / edit perm	✅
upload only perm	✅
Password	✅
Expiration date	✅
Password enforced	✅
Expiration date default	✅
Expiration date enforced	✅
Passw & Expiration date enforced	✅
Remove public link	✅

Smoke test Android

Device & Android version: Xiaomi MI A2
Android app version: 2.12
Server version: 10.3.0 EE final version
OAuth2 version: 0.4.1

Login

Test Case	Expected Result	Result	Related Comment
Login basic	It is possible to access	✅
Login basic wrong credentials	Correct error	✅
Login OAuth2	It is possible to access	✅
OAuth2 revoked token	redirected to login	✅
Redirection 301	It is possible to access	✅
Redirection 302	It is possible to access	✅
Login Guest	It is possible to access	✅	login OK, but uploads... owncloud/android#2653
Login App Password	It is possible to access	✅
Login SAML	It is possible to access	✅	LDAP server

Folder

Test Case	Steps	Expected Result	Result	Related Comment
Create a new folder	1. Tap on create a new folder	The folder is created	✅ basic ✅ OAuth2
Create a folder with special character	1. Tap on create a new folder 2. Use a name with special characters (e.g $%&¨)	The folder is created with special character	✅ basic ✅ OAuth2
Rename a folder	1. Create a new folder 2. Rename the folder	Folder is renamed	✅ basic ✅ OAuth2
Move a folder	1. Create a new folder 2. Move the folder	Folder is moved to the specifield location	✅ basic ✅ OAuth2
Upload a file into a folder	1. Create a new folder 2. Upload a file	File is uploaded into the folder	✅ basic ✅ OAuth2
Delete a folder	1. Access to a folder, the folder has deep structure inside 2. Download some files 3. Select delete that folder	2. The files are downloaded 3. The folder is removed	✅ basic ✅ OAuth2
Copy Folder	1. Long press to copy a folder 2. Select a location to paste	The folder and all its content is copied in the location, and remains too in the original	✅ basic ✅ OAuth2
Sync a folder	1. Create a folder 2. In web app, upload some files in the folder 3. Long press to sync the folder	The folder is sync with the content on server	✅ basic ✅ OAuth2

File

Test Case	Steps	Expected Result	Result	Related Comment
Upload a new file	1. Upload a new file	The file is uploaded	✅ basic ✅ OAuth2
Upload many files	1. Upload many files at the time	Files are uploaded	✅ basic ✅ basic ✅ OAuth2
Rename a file	1. Create a new file 2. Rename the file	The file is renamed	✅ basic ✅ OAuth2
Move a file	1. Create a new file 2. Move the file	The file is renamed	✅ basic ✅ OAuth2
Copy a file	1. Create a new file 2. Copy the file	The file is copied to the selected location	✅ basic ✅ OAuth2
Delete a file	1. Create a new file 2. Delete the file	The file is deleted	✅ basic ✅ OAuth2
Download a file	1. Tap to download a file	The file is downloaded and marked with green arrow	✅ basic ✅ OAuth2
Av Offline file	1. Long press to set as Av Offline a file	The file is downloaded and set as Av Offline with the yellow arrow	✅ basic ✅ OAuth2
Av Offline file	1. Long press to unset an Av Offline a Av Offline file	The file has no more the yellow arrow	✅ basic ✅ OAuth2

Sharing (OAuth2)

Test Case	Result	Related Comment
Share file with a user	✅
Share folder with a user	✅
Share with a group	✅
Share file with only edit	✅
Share file with only share	✅
Share file with no permissions	✅
Edit share permissions file	✅
Remove share	✅
Resharing	✅
Resharing no permissions	✅
Name	✅
Down / view perm	✅
Down / view / edit perm	✅
upload only perm	✅
Password	✅
Expiration date	✅
Password enforced	✅
Expiration date default	✅
Expiration date enforced	✅
Passw & Expiration date enforced	✅
Remove public link	✅

[HanaGemela]

10.3.0 EE server smoke test has passed on the desktop sync client 2.5.4, macOS 10.15 and in iOS app 1.1.1, iOS 13.1.2, iPhone XS

Shibboleth testing is blocked by missing docker images with new Ubuntu

10.3.0 server smoke test via iOS app.pdf
10.3.0 server smoke test via desktop clinet 2.5.4.pdf

[davitol]

Shibboleth testing is blocked by missing docker images with new Ubuntu

Tested with Shibboleth and Autoprovision Mode and works with Desktop 2.5.4 in Ubuntu and MacOSX using oC 10.3.0 EE Tarball.

Also checked that Shibboleth is no longer supported in Desktop Client 2.6.0 (as intended and documented in the changelog) but maybe we should consider a nicest warning (@michaelstingl jfyi)