Skip to content

Smoke test daily

Smoke test daily #16

Triggered via schedule June 7, 2024 03:34
Status Failure
Total duration 1h 39m 36s
Artifacts 9

smoke-test-daily.yml

on: schedule
Matrix: E2E tests on nightly build
Matrix: test-plugins
API tests on nightly build
6m 5s
API tests on nightly build
Merge e2e test reports
2m 3s
Merge e2e test reports
k6 tests on nightly build
2m 24s
k6 tests on nightly build
Post Slack summary
11s
Post Slack summary
Publish report on smoke tests on nightly build
1m 9s
Publish report on smoke tests on nightly build
Matrix: Publish report on Smoke tests on trunk with plugins
Fit to window
Zoom out
Zoom in

Annotations

23 errors, 42 warnings, and 5 notices
k6 tests on nightly build
Process completed with exit code 1.
k6 tests on nightly build
Process completed with exit code 99.
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-1-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-2-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-3-Gutenberg, writing actual. 164 | await expect( 165 | await element.getAttribute( 'class' ) > 166 | ).toMatchSnapshot( { | ^ 167 | name: `selected-homepage-blocks-class-frontend-${ index }`, 168 | } ); 169 | index++; at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
[Gutenberg] › customize-store/assembler/header.spec.js:91:2 › Assembler -> headers › The selected header should be applied on the frontend: plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/header.spec.js#L128
2) [Gutenberg] › customize-store/assembler/header.spec.js:91:2 › Assembler -> headers › The selected header should be applied on the frontend Error: expect(received).toContain(expected) // indexOf Expected substring: "wc-blocks-pattern-header-essential" Received string: "wp-block-group alignfull wc-blocks-pattern-header-minimal wc-blocks-header-pattern sticky-header is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-3 wp-block-group-is-layout-flex" 126 | .getAttribute( 'class' ); 127 | > 128 | expect( selectedHeaderClasses ).toContain( expectedHeaderClass ); | ^ 129 | } ); 130 | 131 | test( 'Picking a header should trigger an update on the site preview', async ( { at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/header.spec.js:128:35
E2E tests on nightly build (3, 3/5)
Process completed with exit code 1.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
E2E tests with WooPayments plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce Shipping & Tax plugin installed (run 16)
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Unable to find an artifact with the name: Smoke tests on trunk with WooPayments plugin installed (run 16)
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce PayPal Payments plugin installed (run 16)
Publish report on smoke tests on nightly build
Process completed with exit code 4.
API tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
k6 tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests on nightly build (5, 5/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js took 1.4m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js took 50.8s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js took 39.8s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js took 38.6s
Slow Test: plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js took 35.1s
E2E tests on nightly build (2, 2/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[default] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[default] › merchant/order-edit.spec.js took 1.0m
Slow Test: plugins/woocommerce/[default] › merchant/order-search.spec.js#L1
plugins/woocommerce/[default] › merchant/order-search.spec.js took 59.3s
Slow Test: plugins/woocommerce/[default] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[default] › merchant/page-loads.spec.js took 53.7s
Slow Test: plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js took 51.2s
Slow Test: plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js took 38.9s
E2E tests on nightly build (4, 4/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js took 1.4m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js took 1.0m
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js took 58.7s
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js took 56.0s
Slow Test: plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js took 50.1s
E2E tests on nightly build (3, 3/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js took 5.0m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js took 1.9m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
Slow Test: plugins/woocommerce/[default] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[default] › shopper/checkout-block.spec.js took 1.4m
Slow Test: plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js took 1.3m
E2E tests on nightly build (1, 1/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js took 5.0m
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
Slow Test: plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js took 1.5m
Slow Test: plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js took 1.2m
Slow Test: plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js#L1
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js took 1.2m
Merge e2e test reports
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooCommerce PayPal Payments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooPayments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E tests with WooCommerce Shipping & Tax plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Post Slack summary
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6, slackapi/slack-github-action@v1.23.0. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish report on smoke tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "api-daily--run-16", "k6-daily-update-site--run-16", "plugin-blocks". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
8 skipped 151 passed (13.6m)
🎭 Playwright Run Summary
6 skipped 160 passed (15.9m)
🎭 Playwright Run Summary
163 passed (16.3m)
🎭 Playwright Run Summary
1 failed [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend 1 flaky [Gutenberg] › customize-store/assembler/header.spec.js:91:2 › Assembler -> headers › The selected header should be applied on the frontend 5 skipped 150 passed (20.0m)
🎭 Playwright Run Summary
2 skipped 160 passed (22.4m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
218 KB
all-blob-reports-2 Expired
223 KB
all-blob-reports-3 Expired
52.4 MB
all-blob-reports-4 Expired
217 KB
all-blob-reports-5 Expired
232 KB
api-daily--run-16 Expired
7.03 MB
e2e-daily--run-16 Expired
108 MB
k6-daily-update-site--run-16 Expired
2.25 MB
plugin-blocks Expired
650 Bytes