Smoke test daily #2
smoke-test-daily.yml
on: schedule
Matrix: E2E tests on nightly build
Matrix: test-plugins
API tests on nightly build
5m 39s
Merge e2e test reports
2m 14s
Post Slack summary
12s
Publish report on smoke tests on nightly build
2m 12s
Matrix: Publish report on Smoke tests on trunk with plugins
Annotations
22 errors, 42 warnings, and 5 notices
k6 tests on nightly build
Process completed with exit code 1.
|
k6 tests on nightly build
Process completed with exit code 99.
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-1-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-2-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-3-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
E2E tests on nightly build (3, 3/5)
Process completed with exit code 1.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Unable to find an artifact with the name: Smoke tests on trunk with WooPayments plugin installed (run 2)
|
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce PayPal Payments plugin installed (run 2)
|
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce Shipping & Tax plugin installed (run 2)
|
Publish report on smoke tests on nightly build
Process completed with exit code 4.
|
API tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
k6 tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests on nightly build (5, 5/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js took 1.4m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js took 50.7s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js took 39.4s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js took 38.6s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js took 35.3s
|
E2E tests on nightly build (2, 2/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[default] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[default] › merchant/order-edit.spec.js took 1.0m
|
Slow Test:
plugins/woocommerce/[default] › merchant/order-search.spec.js#L1
plugins/woocommerce/[default] › merchant/order-search.spec.js took 59.2s
|
Slow Test:
plugins/woocommerce/[default] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[default] › merchant/page-loads.spec.js took 53.5s
|
Slow Test:
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js took 50.6s
|
Slow Test:
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js took 39.3s
|
E2E tests on nightly build (4, 4/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js took 1.5m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js took 1.0m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js took 59.8s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js took 55.3s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js took 50.6s
|
E2E tests on nightly build (3, 3/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js took 5.0m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js took 1.9m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
|
Slow Test:
plugins/woocommerce/[default] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[default] › shopper/checkout-block.spec.js took 1.4m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js took 59.1s
|
E2E tests on nightly build (1, 1/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js took 5.9m
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js took 2.0m
|
Slow Test:
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js took 1.7m
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js took 1.5m
|
Slow Test:
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js#L1
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js took 1.2m
|
Merge e2e test reports
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooCommerce PayPal Payments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooPayments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Post Slack summary
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6, slackapi/slack-github-action@v1.23.0. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "api-daily--run-2", "k6-daily-update-site--run-2", "plugin-blocks".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Publish report on smoke tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
🎭 Playwright Run Summary
8 skipped
151 passed (13.7m)
|
🎭 Playwright Run Summary
6 skipped
160 passed (15.9m)
|
🎭 Playwright Run Summary
163 passed (16.4m)
|
🎭 Playwright Run Summary
1 failed
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
5 skipped
151 passed (19.5m)
|
🎭 Playwright Run Summary
2 skipped
160 passed (25.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
219 KB |
|
all-blob-reports-2
Expired
|
224 KB |
|
all-blob-reports-3
Expired
|
41.7 MB |
|
all-blob-reports-4
Expired
|
217 KB |
|
all-blob-reports-5
Expired
|
232 KB |
|
api-daily--run-2
Expired
|
7.03 MB |
|
e2e-daily--run-2
Expired
|
86.6 MB |
|
k6-daily-update-site--run-2
Expired
|
2.25 MB |
|
plugin-blocks
Expired
|
650 Bytes |
|