Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Manual test run on Linux for 1.7.x - Release #9123

Closed
41 of 43 tasks
kjozwiak opened this issue Apr 9, 2020 · 1 comment
Closed
41 of 43 tasks

Manual test run on Linux for 1.7.x - Release #9123

kjozwiak opened this issue Apr 9, 2020 · 1 comment
Assignees
@btlechowski
Labels
OS/Linux QA Pass-Linux QA/Yes release-notes/exclude tests
Milestone
1.7.x - Release

Comments

@kjozwiak
Copy link
Member

kjozwiak commented Apr 9, 2020 •
edited by btlechowski
Loading

Per release specialty tests

Installer

  • Check that installer is close to the size of last release
  • Check signature: If OS Run spctl --assess --verbose /Applications/Brave-Browser-Beta.app/ and make sure it returns accepted. If Windows right click on the brave_installer-x64.exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window

Data(Upgrade from previous release)

  • Make sure that data from the last version appears in the new version OK
  • With data from the last version, verify that
    • Bookmarks on the bookmark toolbar and bookmark folders can be opened
    • Cookies are preserved
    • Installed extensions are retained and work correctly
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Unpinned tabs can be pinned
    • Sync chain created in previous version is retained
    • Social media blocking buttons changes are retained

Widevine

  • Verify Widevine Notification is shown when you visit Netflix for the first time
  • Test that you can stream on Netflix on a fresh profile after installing Widevine

Brave Ads

  • Verify when you enable Rewards from panel or brave://rewards, Ads are enabled by default
  • Verify Ads UI (panel, settings, etc) shows when in a region with Ads support
  • Verify Ads UI (panel, settings, etc) does not show when in a region without Ads support. Verify the Ads panel does show the 'Sorry! Ads are not yet available in your region.' message.
  • Verify when the system language is English, the Browser language is French, and you are in one of the supported regions, Ad notifications are still served to you.
  • Verify you are served Ad notifications when Ads are enabled
  • Windows only: Verify when Focus Assist is set to alarms only, Ads are not served to the user but are available in the Notification Center
  • Verify when Ads are toggled off, there are no Ad messages in the logs
  • Verify when Rewards are toggled off (but Ads were not explicitly toggled off), there are no Ads logs recorded
  • Verify view/click/dismiss/landed ad notifications show in confirmations.json
  • Verify pages you browse to are being classified in the logs
  • Verify tokens are redeemed by viewing the logs (you can use --rewards=debug=true to shorten redemption time)
  • Verify Ad is not shown if a tab is playing media and is only shown after it stops playing
  • Upgrade Cases
    • Verify when updating from the previous version Ads info in the panel is not lost
    • Update to latest version from 0.62.51 (or a version without Ads available). Verify you are notified to try ads via a BAT logo notification but Ads are not automatically turned on for you.
    • Update to latest version from some Ads enabled versions (0.63.x, 0.64.x). Verify Ads status (on/off) is the same as it was prior to update.

Sync

  • Verify you are able to create a sync chain and add a mobile/computer to the chain
  • Verify you are able to join an existing sync chain using code words
  • Verify the device name is shown properly when sync chain is created
  • Verify you are able to add a new mobile device to the chain via QR code/code words
  • Verify newly created bookmarks get sync'd to all devices on the sync chain
  • Verify existing bookmarks on current profile gets sync'd to all devices on the sync chain
  • Verify folder structure is retained after sync completes
  • Verify bookmarks don't duplicate when sync'd from other devices
  • Verify removing bookmark from device gets sync'd to all devices on the sync chain
  • Verify adding/removing a bookmark in offline mode gets sync'd to all devices on the sync chain when device comes online
  • With only two device in chain, verify removing the other device resets the sync on b-c as well

Update tests

  • Verify visiting brave://settings/help triggers update check
  • Verify once update is downloaded, prompts to Relaunch to install update
@kjozwiak kjozwiak added this to the 1.7.x - Release milestone Apr 9, 2020
@kjozwiak kjozwiak assigned btlechowski and unassigned srirambv Apr 9, 2020
@btlechowski
Copy link

LGTM

Verification passed on

Brave 1.7.92 Chromium: 80.0.3987.163 (Official Build) (64-bit)
Revision e7fbe071abe9328cdce4ffedac9822435fbd3656-refs/branch-heads/3987@{#1037}
OS Ubuntu 18.04 LTS

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@btlechowski btlechowski

Labels
OS/Linux QA Pass-Linux QA/Yes release-notes/exclude tests
Projects
None yet
Milestone
1.7.x - Release
Development

No branches or pull requests
3 participants
@kjozwiak @srirambv @btlechowski