Remove manual device verification which is not supported by the new cryptography stack #2945
Annotations
6 errors, 30 warnings, and 6 notices
settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
1) settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
1) settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read:
playwright/e2e/spaces/threads-activity-centre/index.ts#L379
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read
Error: locator.click: Error: strict mode violation: getByLabel('Mark all as read') resolved to 2 elements:
1) <div tabindex="0" role="button" aria-label="Mark all as read" class="mx_AccessibleButton mx_TopUnreadMessagesBar_markAsRead"></div> aka getByRole('main').getByLabel('Mark all as read')
2) <button tabindex="0" role="button" aria-labelledby=":r74:" class="_icon-button_bh2qc_17">…</button> aka locator('#thread-panel').getByLabel('Mark all as read')
Call log:
- waiting for getByLabel('Mark all as read')
at spaces/threads-activity-centre/index.ts:379
377 | */
378 | clickMarkAllThreadsRead() {
> 379 | return this.page.getByLabel("Mark all as read").click();
| ^
380 | }
381 | }
382 |
at Helpers.clickMarkAllThreadsRead (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:379:57)
at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:149:14
|
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read:
playwright/e2e/spaces/threads-activity-centre/index.ts#L283
1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read
Error: expect(locator).toHaveScreenshot(expected)
39 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-no-indicator-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-diff.png
Call log:
- expect.toHaveScreenshot(tac-no-indicator.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads')
- locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 39 pixels (ratio 0.04 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads')
- locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 39 pixels (ratio 0.04 of all image pixels) are different.
at spaces/threads-activity-centre/index.ts:283
281 | await expect(this.getTacButton().locator("[data-indicator='success']")).not.toBeVisible();
282 | await expect(this.getTacButton().locator("[data-indicator='critical']")).not.toBeVisible();
> 283 | await expect(this.getTacButton()).toMatchScreenshot("tac-no-indicator.png");
| ^
284 | }
285 |
286 | /**
at Helpers.assertNoTacIndicator (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:283:43)
at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:151:9
|
crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted:
playwright/e2e/crypto/event-shields.spec.ts#L309
1) crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon')
9 × locator resolved to <div tabindex="0" aria-labelledby=":r86:" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
- unexpected value "visible"
307 |
308 | const penultimate = page.locator(".mx_EventTile").filter({ hasText: "test encrypted from verified" });
> 309 | await expect(penultimate.locator(".mx_EventTile_e2eIcon")).not.toBeVisible();
| ^
310 | });
311 |
312 | test("should show correct shields on events sent by users with changed identity", async ({
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/event-shields.spec.ts:309:76
|
pinned-messages/pinned-messages.spec.ts:149:9 › Pinned messages › banner should listen to pinned message list:
playwright/e2e/pinned-messages/pinned-messages.spec.ts#L154
1) pinned-messages/pinned-messages.spec.ts:149:9 › Pinned messages › banner should listen to pinned message list
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('button', { name: 'View all' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('button', { name: 'View all' })
152 | await util.pinMessages(["Msg1", "Msg2"]);
153 |
> 154 | await expect(util.getViewAllButton()).toBeVisible();
| ^
155 |
156 | await util.openRoomInfo();
157 | await util.openPinnedMessagesList();
at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:154:47
|
Slow Test:
read-receipts/high-level.spec.ts#L1
read-receipts/high-level.spec.ts took 3.3m
|
Slow Test:
read-receipts/new-messages-in-threads.spec.ts#L1
read-receipts/new-messages-in-threads.spec.ts took 1.7m
|
Slow Test:
read-receipts/editing-messages-in-threads.spec.ts#L1
read-receipts/editing-messages-in-threads.spec.ts took 1.3m
|
Slow Test:
read-receipts/new-messages-main-timeline.spec.ts#L1
read-receipts/new-messages-main-timeline.spec.ts took 1.2m
|
Slow Test:
read-receipts/editing-messages-main-timeline.spec.ts#L1
read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
|
Slow Test:
read-receipts/redactions-in-threads.spec.ts#L1
read-receipts/redactions-in-threads.spec.ts took 2.6m
|
Slow Test:
read-receipts/redactions-main-timeline.spec.ts#L1
read-receipts/redactions-main-timeline.spec.ts took 2.1m
|
Slow Test:
read-receipts/read-receipts.spec.ts#L1
read-receipts/read-receipts.spec.ts took 1.1m
|
Slow Test:
read-receipts/reactions-in-threads.spec.ts#L1
read-receipts/reactions-in-threads.spec.ts took 59.7s
|
Slow Test:
read-receipts/redactions-thread-roots.spec.ts#L1
read-receipts/redactions-thread-roots.spec.ts took 57.0s
|
Slow Test:
spaces/spaces.spec.ts#L1
spaces/spaces.spec.ts took 1.1m
|
Slow Test:
right-panel/right-panel.spec.ts#L1
right-panel/right-panel.spec.ts took 58.9s
|
Slow Test:
settings/account-user-settings-tab.spec.ts#L1
settings/account-user-settings-tab.spec.ts took 47.4s
|
Slow Test:
right-panel/file-panel.spec.ts#L1
right-panel/file-panel.spec.ts took 41.5s
|
Slow Test:
settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 33.9s
|
Slow Test:
timeline/timeline.spec.ts#L1
timeline/timeline.spec.ts took 2.9m
|
Slow Test:
spotlight/spotlight.spec.ts#L1
spotlight/spotlight.spec.ts took 2.3m
|
Slow Test:
threads/threads.spec.ts#L1
threads/threads.spec.ts took 36.1s
|
Slow Test:
user-onboarding/user-onboarding-new.spec.ts#L1
user-onboarding/user-onboarding-new.spec.ts took 34.5s
|
Slow Test:
widgets/widget-pip-close.spec.ts#L1
widgets/widget-pip-close.spec.ts took 23.2s
|
Slow Test:
composer/RTE.spec.ts#L1
composer/RTE.spec.ts took 1.3m
|
Slow Test:
audio-player/audio-player.spec.ts#L1
audio-player/audio-player.spec.ts took 1.2m
|
Slow Test:
crypto/crypto.spec.ts#L1
crypto/crypto.spec.ts took 1.1m
|
Slow Test:
crypto/device-verification.spec.ts#L1
crypto/device-verification.spec.ts took 46.1s
|
Slow Test:
crypto/decryption-failure-messages.spec.ts#L1
crypto/decryption-failure-messages.spec.ts took 40.6s
|
Slow Test:
messages/messages.spec.ts#L1
messages/messages.spec.ts took 2.4m
|
Slow Test:
login/login.spec.ts#L1
login/login.spec.ts took 1.1m
|
Slow Test:
knock/knock-into-room.spec.ts#L1
knock/knock-into-room.spec.ts took 41.1s
|
Slow Test:
integration-manager/read_events.spec.ts#L1
integration-manager/read_events.spec.ts took 39.5s
|
Slow Test:
polls/polls.spec.ts#L1
polls/polls.spec.ts took 36.6s
|
🎭 Playwright Run Summary
32 skipped
50 passed (9.8m)
|
🎭 Playwright Run Summary
15 skipped
60 passed (10.0m)
|
🎭 Playwright Run Summary
1 flaky
settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
9 skipped
67 passed (10.0m)
|
🎭 Playwright Run Summary
1 flaky
spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read
3 skipped
68 passed (10.4m)
|
🎭 Playwright Run Summary
1 flaky
crypto/event-shields.spec.ts:274:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted
78 passed (12.0m)
|
🎭 Playwright Run Summary
1 flaky
pinned-messages/pinned-messages.spec.ts:149:9 › Pinned messages › banner should listen to pinned message list
1 skipped
77 passed (11.6m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
3.12 MB |
|
all-blob-reports-2
Expired
|
2.88 MB |
|
all-blob-reports-3
Expired
|
307 KB |
|
all-blob-reports-4
Expired
|
328 KB |
|
all-blob-reports-5
Expired
|
4.44 MB |
|
all-blob-reports-6
Expired
|
3.33 MB |
|
html-report
|
13.8 MB |
|
webapp
Expired
|
34.4 MB |
|