Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New Screenshot tests for Continuous User Interface Testing #4087

Closed
diosmosis opened this issue Aug 18, 2013 · 12 comments
Closed

New Screenshot tests for Continuous User Interface Testing #4087

diosmosis opened this issue Aug 18, 2013 · 12 comments
Labels
c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Milestone
2.0

Comments

@diosmosis
Copy link
Member

One thing remains to for Piwik's QA suite to be complete: testing the UI. This can be done by generating screenshots of URLs after injecting JavaScript and comparing w/ expected screenshots. This ticket is for the creation of this system.

TODO:

  • Create screenshot compare tests for all of Piwik.
  • Enable screenshot comparison on travis. (Need to make sure screenshots on different machines are the same.)
@anonymous-matomo-user
Copy link

In 1c274da: Refs #4087, rewrote UI integration tests to use phantomjs or slimerjs and added (disabled) UI tests to travis build config.

Notes:

  • Modified main page-loading JavaScript to use ajaxHelper so it's possible to know when all AJAX requests are made.
  • Add setUrl method to ajaxHelper so it can be used when a doing AJAX w/ a URL instead of an object containing query parameters.

@anonymous-matomo-user
Copy link

In cee9bc6: Refs #4087, fixing typo.

@anonymous-matomo-user
Copy link

In 78723a8: Refs #4087, fixing logic error.

@anonymous-matomo-user
Copy link

In 8bb5f17: Refs #4087, fix bug in capture.js and allow multiple UI test cases to be written.

@anonymous-matomo-user
Copy link

In 01e5881: Refs #4087, remove recursive links and create/remove them only when doing UI tests.

@anonymous-matomo-user
Copy link

In d57f4a8: Refs #4087, add UI screenshot tests to new repository, enable tests on travis and make sure new repo is built every time integration tests pass on piwik build.

@anonymous-matomo-user
Copy link

In 7770c12: Refs #4087, tweak tests README.

@anonymous-matomo-user
Copy link

In 07d058f: Refs #4087, adding new screenshot tests for visitor profile, transitions and user settings admin page.

@mattab
Copy link
Member

mattab commented Oct 7, 2013

Congrats on closing this ticket!!

@mattab
Copy link
Member

mattab commented Oct 16, 2013

See this informative blog post about our screenshot tests suite

@mattab
Copy link
Member

mattab commented Oct 24, 2013

In fdb2cba: Documenting required imagick lib for screenshot comparison generate refs #4087

@mattab
Copy link
Member

mattab commented Nov 22, 2013

In 5e644be: Refs #4087 #4189 We would like ui tests build to run every commit even when the Integration tests fail. This will help know exactly which commit introduced a regression.

@diosmosis diosmosis added this to the 2.0 - Piwik 2.0 milestone Jul 8, 2014
@mattab mattab mentioned this issue Nov 22, 2013
Closed
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, rewrote UI integration tests to use phantomjs o…
1c274da 
…r slimerjs and added (disabled) UI tests to travis build config.

Notes:
  * Modified main page-loading JavaScript to use ajaxHelper so it's possible to know when all AJAX requests are made.
  * Add setUrl method to ajaxHelper so it can be used when a doing AJAX w/ a URL instead of an object containing query parameters.
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, fixing typo.
cee9bc6
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, fixing logic error.
78723a8
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, fix bug in capture.js and allow multiple UI tes…
8bb5f17 
…t cases to be written.
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, remove recursive links and create/remove them o…
01e5881 
…nly when doing UI tests.
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, add UI screenshot tests to new repository, enab…
d57f4a8 
…le tests on travis and make sure new repo is built every time integration tests pass on piwik build.
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, tweak tests README.
7770c12
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
Refs matomo-org#4087, adding new screenshot tests for visitor profile…
07d058f 
…, transitions and user settings admin page.
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
@mattab
Documenting required imagick lib for screenshot comparison generate r…
fdb2cba 
…efs matomo-org#4087
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
@mattab
Refs matomo-org#4087 matomo-org#4189 We would like ui tests build to …
5e644be 
…run every commit even when the Integration tests fail. This will help know exactly which commit introduced a regression.
@mattab mattab added the c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. label Oct 12, 2014
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Projects
None yet
Milestone
2.0
Development

No branches or pull requests
3 participants
@diosmosis @mattab @anonymous-matomo-user