Skip to content

Smoke test daily

Smoke test daily #9

Triggered via schedule May 31, 2024 03:33
Status Failure
Total duration 1h 38m 55s
Artifacts 9

smoke-test-daily.yml

on: schedule
Matrix: E2E tests on nightly build
Matrix: test-plugins
API tests on nightly build
5m 4s
API tests on nightly build
Merge e2e test reports
1m 57s
Merge e2e test reports
k6 tests on nightly build
2m 16s
k6 tests on nightly build
Post Slack summary
7s
Post Slack summary
Publish report on smoke tests on nightly build
35s
Publish report on smoke tests on nightly build
Matrix: Publish report on Smoke tests on trunk with plugins
Fit to window
Zoom out
Zoom in

Annotations

24 errors, 42 warnings, and 5 notices
k6 tests on nightly build
Process completed with exit code 1.
k6 tests on nightly build
Process completed with exit code 99.
[Gutenberg] › merchant/products/block-editor/create-variable-product-block-editor.spec.js:194:3 › Variations tab › Create variable product › can edit a variation: plugins/woocommerce/tests/e2e-pw/tests/merchant/products/block-editor/create-variable-product-block-editor.spec.js#L251
1) [Gutenberg] › merchant/products/block-editor/create-variable-product-block-editor.spec.js:194:3 › Variations tab › Create variable product › can edit a variation Error: expect(received).toMatch(expected) Expected pattern: /Product updated/ Received string: "Regular price is required." 249 | .click(); 250 | const element = page.locator( 'div.components-snackbar__content' ); > 251 | await expect( await element.innerText() ).toMatch( | ^ 252 | /Product updated/ 253 | ); 254 | at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/merchant/products/block-editor/create-variable-product-block-editor.spec.js:251:46
[Gutenberg] › customize-store/loading-screen/loading-screen.spec.js:117:2 › Assembler - Loading Page › should hide loading screen and steps on subsequent runs: plugins/woocommerce/tests/e2e-pw/tests/customize-store/loading-screen/loading-screen.spec.js#L140
1) [Gutenberg] › customize-store/loading-screen/loading-screen.spec.js:117:2 › Assembler - Loading Page › should hide loading screen and steps on subsequent runs Error: expect(received).toEqual(expected) // deep equality - Expected - 2 + Received + 2 Array [ - false, - false, + true, + true, false, ] 138 | } 139 | > 140 | expect( Object.values( requestToSetupStore ) ).toEqual( [ | ^ 141 | false, 142 | false, 143 | false, at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/loading-screen/loading-screen.spec.js:140:50
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-1-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-2-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-3-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
E2E tests on nightly build (3, 3/5)
Process completed with exit code 1.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce PayPal Payments plugin installed (run 9)
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Unable to find an artifact with the name: Smoke tests on trunk with WooPayments plugin installed (run 9)
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce Shipping & Tax plugin installed (run 9)
Publish report on smoke tests on nightly build
Process completed with exit code 4.
API tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
k6 tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests on nightly build (5, 5/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js took 1.4m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js took 51.4s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js took 39.8s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js took 38.9s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js took 34.8s
E2E tests on nightly build (2, 2/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[default] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[default] › merchant/order-edit.spec.js took 1.0m
Slow Test: plugins/woocommerce/[default] › merchant/order-search.spec.js#L1
plugins/woocommerce/[default] › merchant/order-search.spec.js took 58.3s
Slow Test: plugins/woocommerce/[default] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[default] › merchant/page-loads.spec.js took 53.8s
Slow Test: plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js took 51.2s
Slow Test: plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js took 38.6s
E2E tests on nightly build (4, 4/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js took 1.5m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js took 1.1m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js took 59.0s
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js took 55.7s
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js took 52.0s
E2E tests on nightly build (3, 3/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js took 5.1m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js took 2.0m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
Slow Test: plugins/woocommerce/[default] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[default] › shopper/checkout-block.spec.js took 1.4m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js took 1.0m
E2E tests on nightly build (1, 1/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js took 5.1m
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
Slow Test: plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js took 1.4m
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js took 1.2m
Slow Test: plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js#L1
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js took 1.0m
Merge e2e test reports
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooCommerce PayPal Payments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooCommerce Shipping & Tax plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooPayments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Post Slack summary
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6, slackapi/slack-github-action@v1.23.0. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on smoke tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "api-daily--run-9", "k6-daily-update-site--run-9", "plugin-blocks". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
1 flaky [Gutenberg] › merchant/products/block-editor/create-variable-product-block-editor.spec.js:194:3 › Variations tab › Create variable product › can edit a variation 8 skipped 150 passed (14.0m)
🎭 Playwright Run Summary
6 skipped 160 passed (15.7m)
🎭 Playwright Run Summary
1 flaky [Gutenberg] › customize-store/loading-screen/loading-screen.spec.js:117:2 › Assembler - Loading Page › should hide loading screen and steps on subsequent runs 162 passed (16.8m)
🎭 Playwright Run Summary
1 failed [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend 5 skipped 151 passed (19.9m)
🎭 Playwright Run Summary
2 skipped 160 passed (22.4m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
218 KB
all-blob-reports-2 Expired
223 KB
all-blob-reports-3 Expired
42.2 MB
all-blob-reports-4 Expired
6.29 MB
all-blob-reports-5 Expired
3.89 MB
api-daily--run-9 Expired
7.03 MB
e2e-daily--run-9 Expired
107 MB
k6-daily-update-site--run-9 Expired
2.25 MB
plugin-blocks Expired
650 Bytes