Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky test: Screenshot Timeout system test in Firefox #29116

Closed
cacieprins opened this issue Mar 12, 2024 · 2 comments
Closed

Flaky test: Screenshot Timeout system test in Firefox #29116

cacieprins opened this issue Mar 12, 2024 · 2 comments
Labels
browser: firefox process: flaky test Related to test(s) that have flake in our internal tests stale no activity on this issue for a long period

Comments

@cacieprins
Copy link
Contributor

Link to Cypress Cloud or CircleCI failure

https://app.circleci.com/pipelines/github/cypress-io/cypress/60332/workflows/5722539d-d040-4f5b-9585-fbcba73ef471/jobs/2512142

Link to failing test in GitHub

https://github.com/cypress-io/cypress/blob/develop/system-tests/test/issue_5016_spec.js

Analysis

This system test was added to detect regressions due to a fix implemented for #5016. This test exhibits flake in Firefox, even when run against commits prior to the 5016 fix. The test that should be succeeding but fails in this system test clicks an anchor with target="_blank" and takes a screenshot of that anchor: https://github.com/cypress-io/cypress/blob/develop/system-tests/projects/config-screenshot-on-failure-enabled/cypress/e2e/issue-5016.cy.js

An unexpected erorr is thrown in the v2 extension:

  Error: An unexpected error occurred
      (No stack trace)
  From previous event:
      at takeScreenshot (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:20850:6)
      at ./app/v2/background.js/connect/invoke (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:20623:33)
  From previous event:
      at invoke (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:20622:20)
      at ./app/v2/background.js/connect (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:20651:16)
      at ../../node_modules/component-emitter/index.js/Emitter.prototype.emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:5736:20)
      at emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24813:15)
      at emitEvent (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24559:20)
      at onevent (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24546:18)
      at onpacket (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24510:22)
      at ../../node_modules/component-emitter/index.js/Emitter.prototype.emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:5736:20)
      at emitReserved (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24826:15)
      at ondecoded (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24096:14)
      at ../../node_modules/component-emitter/index.js/Emitter.prototype.emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:5736:20)
      at add (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:23404:23)
      at ondata (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:24088:22)
      at ../../node_modules/component-emitter/index.js/Emitter.prototype.emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:5736:20)
      at onPacket (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:21337:16)
      at ../socket/node_modules/engine.io-client/lib/socket.js/setTransport (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:21146:14)
      at ../../node_modules/component-emitter/index.js/Emitter.prototype.emit (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:5736:20)
      at onPacket (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:21738:10)
      at onData (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:21731:10)
      at ../socket/node_modules/engine.io-client/lib/transports/websocket.js/addEventListeners/this.ws.onmessage (moz-extension://701245c8-3fef-4fbb-aaae-a44f0c51660e/background.js:22722:36)

Cypress Version

13.6.7

Other

For now, we are disabling Firefox on this system test. This is likely indicative of .screenshot() intermittently failing with a timeout error in Firefox when the main Cypress tab is not focused.

@cypress-app-bot
Copy link
Collaborator

This issue has not had any activity in 180 days. Cypress evolves quickly and the reported behavior should be tested on the latest version of Cypress to verify the behavior is still occurring. It will be closed in 14 days if no updates are provided.

@cypress-app-bot cypress-app-bot added the stale no activity on this issue for a long period label Sep 9, 2024
@cypress-app-bot
Copy link
Collaborator

This issue has been closed due to inactivity.

@cypress-app-bot cypress-app-bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
browser: firefox process: flaky test Related to test(s) that have flake in our internal tests stale no activity on this issue for a long period
Projects
None yet
Development

No branches or pull requests

3 participants