MsgBubbles: User Testing (and)

[daniellekirkwood]

Your use case

Run a thorough community testing session to verify that works as intended on a range of different systems and there are no major usability problems

What we need going into the session

• List of test cases based on requirements
• Spreadsheet for recording results during testing
• Allow people to sign up to spreadsheet ahead of time
• Pick a time when Product, Design and lead developer for the platform can attend
• 90% or more of P0 tasks are complete
• Smoke testing has happened and majority of issues found during smoke testing have been resolved
• Pick a time and update room topic
• Create event in company calendar
• Publicise
  • Twitter/Mastodon
  • TWIM
  • Channel
• Check and update docs on wiki as needed

During the session

• Lay out standard paths to follow to achieve tasks (test cases with steps)
• Run through some exploratory test cases (tasks to achieve without steps)
• Monitor testing to track if testers are naturally taking expected paths in achieving tasks
• Collect defects and enhancements which are found, and make sure to collect accurate reproductions steps with screenshots and screen recordings as needed
• Compare product against designs

Outputs from the session

• All defects have been reviewed
• All new defects have been filed
• All repeat defects have been linked to existing issues
• All enhancements have been reviewed
• All new enhancement requests have been filed
• All enhancement requests have been responded to (including links to existing ones)
• Design reviews any designs to update for findings from session (especially around actual usage)
• Acceptance criteria on issues updated as needed (by design, product or development)

Have you considered any alternatives?

No response

Additional context

No response

[daniellekirkwood]

We won't be running this type of testing for bubbles on android