Test plan for Beta fix 1.46.1 (iOS only)

[fluiddot]

This plan describes the steps to be executed to ensure that the beta fix 1.46.1 is safe to be released in WordPress version 16.7.

This plan will be executed only on iOS because Android was already tested in a beta version that included the same changes, the results can be checked in the issue.

• Writing flow tests - @ceyhun
• Random tests from the sanity check test suites (preferably one test from each section to cover a wide range) - @fluiddot
• Smoke test the editor flow in general by doing: @fluiddot
  • Entering exiting the editor
  • Rotate the device in various cases
  • Open and dismiss the bottom sheet
  • Background the app and foreground it again

[ceyhun]

Writing Flow checklist 🟢

General

• TC001 - Paste formatted text copied from website
• TC001 - Multiline components

Rich Text Format

• TC001 - Bold, Italic, strikethrough buttons
• TC002 - Alignment buttons
• TC003 - Alignment Split
• TC004 - Link button works without selection
• TC005 - Link button works with a selected word
• TC006 - Adding a link from a copied URL
• TC007 - Test format detection under the cursor
• TC008 - Test formatting doesn't remove leading or trailing whitespace

Splitting and merging

• TC001 - Merge after writing
• TC002 - Merge after selection
• TC003 - Merge after deleting text
• TC004 - Merge after deleting all
• TC005 - Merge multiple blocks
• TC006 - Splitting/merge list block

Undo / Redo - Test Cases

• TC001 - Undo/redo block actions
• TC002 - Undo/redo text
• TC003 - Undo/redo text format

^{Tested with iPhone 11 Pro, iOS 14.3, WPiOS 42199}

[fluiddot]

Sanity Tests 🟡

WPiOS 16.7 - build 42258, iPhone 11 - iOS 14.2

Gallery-1

• Gallery block - Close/Re-open post with an ongoing image upload - steps

MediaText-1

• Media Text block - Insert image from device (failing) - steps

MultipleUpload-1

• Simultaneous uploads - steps

DarkMode-1

• Gallery block - Dark mode - steps

Shortcode-1

• Shortcode block - Add a youtube link - steps

Spacer-1

• Spacer block - Spacer is rendered without crash - steps

Buttons-1

• Buttons block - Buttons block is added with focused Button with gray background color and white text color - steps

Group-1

• Group - AppenderButton is rendered - steps

Cover-1

• Cover - Add image background from WordPress Media library - steps
• Cover - Image focal point is rendered properly - steps

Columns - 1 🟡

• Columns - Columns percentage mechanism - column's preview - steps
• Columns - Columns percentage mechanism - column's slider input - steps
  • NaN value when using , char, this depends on the device's region but on mine (Spain) the only option in the keyboard is that one.
• Columns - Columns percentage mechanism - predefined percentage values are rendered correctly on frontend- steps
  • When picking 30/70 or 70/30 layouts, the width values are 33.3% and 66.6% instead of the ones picked.
• Columns percentage mechanism - custom percentage values are rendered correctly on frontend- steps
• Columns - Multiple slider in columns parent - steps
• Columns - Columns block is added with default number of Column - steps
• Columns - Adding Column with AppenderButton - steps
• Columns - Adding and removing Column with BottomSheet Stepper control - steps

Editor Theme - 1

• Default Colors - Check that default colors still load - steps

Color Settings - 1

• Colors Segmented Controls - steps

Social Icons - 1

• The newly created Social Icons block is added with 4 icons - steps

[fluiddot]

iOS: Smoke test checklist 🟡

WPiOS 16.7 - build 42258, iPhone 11 - iOS 14.2

• Entering exiting the editor
• Rotate the device in various cases
  • Rotate with no block selected
  • Rotate with a block selected
  • Rotate with the keyboard opened 🟡
    • On landscape, tapping on a paragraph with text doesn't position the view properly
  • Rotate with the bottom sheet opened
• Open and dismiss the bottom sheet
  • Open the bottom sheet
  • Dismiss it by tapping outside
  • Dismiss it by dragging it to the bottom
• Background the app and foreground it again
  • Go to opened apps and back to the app
  • Go to home screen and back to the app
  • Close the app and open it again
• Make some changes in a post, close the app, open it again and verify that the changes are saved

[fluiddot]

I've tried to reproduce the spotted issues so far on the current version of the AppStore (version 16.6.1) and I managed to reproduce all of them so they're not new regressions.