Shard playwright tests in CI #26
Annotations
8 errors and 1 notice
Test development build:
tests/autosave.spec.ts#L49
1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ────────────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/autosave.spec.ts#L49
1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry1/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry1/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/autosave.spec.ts#L49
1) [webkit] › autosave.spec.ts:3:5 › autosaves after every action ────────────────────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry2/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-webkit-retry2/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/autosave.spec.ts#L49
2) [mobile-webkit] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-mobile-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/autosave.spec.ts#L49
2) [mobile-webkit] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-mobile-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit-retry1/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit-retry1/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/autosave.spec.ts#L49
2) [mobile-webkit] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
651 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts-snapshots/autosaves-after-every-action-1-mobile-webkit-linux.png
Received: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit-retry2/autosaves-after-every-action-1-actual.png
Diff: /__w/bitauth-ide/bitauth-ide/test-results/autosave-autosaves-after-every-action-mobile-webkit-retry2/autosaves-after-every-action-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 651 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 651 pixels (ratio 0.01 of all image pixels) are different.
47 | await page.getByText('Paste a template below to import.').click();
48 | await expect(page.locator('.detected-link').first()).toBeVisible();
> 49 | await expect(page).toHaveScreenshot();
| ^
50 | await page.getByRole('button', { name: 'Import Template' }).click();
51 | await expect(page.locator('h1 .title')).toHaveText('Untitled');
52 | await page.getByRole('button', { name: 'Scratch Pad' }).click();
at /__w/bitauth-ide/bitauth-ide/tests/autosave.spec.ts:49:22
|
Test development build:
tests/routing.spec.ts#L163
3) [webkit] › routing.spec.ts:149:5 › displays errors when fetching from GitHub's API ────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('heading', { name: 'Choose a template to begin' })
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('heading', { name: 'Choose a template to begin' })
161 | await expect(
162 | page.getByRole('heading', { name: 'Choose a template to begin' }),
> 163 | ).toBeVisible();
| ^
164 | });
165 |
166 | test('gracefully handles outdated share links', async ({ page }) => {
at /__w/bitauth-ide/bitauth-ide/tests/routing.spec.ts:163:5
|
Test development build
Process completed with exit code 1.
|
Test development build
2 failed
[webkit] › autosave.spec.ts:3:5 › autosaves after every action ─────────────────────────────────
[mobile-webkit] › autosave.spec.ts:3:5 › autosaves after every action ──────────────────────────
1 flaky
[webkit] › routing.spec.ts:149:5 › displays errors when fetching from GitHub's API ─────────────
4 skipped
71 passed (9.6m)
|
The logs for this run have expired and are no longer available.
Loading