Smoke test daily #14
smoke-test-daily.yml
on: schedule
Matrix: E2E tests on nightly build
Matrix: test-plugins
API tests on nightly build
11m 42s
Merge e2e test reports
2m 9s
Post Slack summary
11s
Publish report on smoke tests on nightly build
2m 40s
Matrix: Publish report on Smoke tests on trunk with plugins
Annotations
22 errors, 42 warnings, and 5 notices
k6 tests on nightly build
Process completed with exit code 1.
|
k6 tests on nightly build
Process completed with exit code 99.
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-0-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-1-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-2-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend:
plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js#L166
1) [Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: A snapshot doesn't exist at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js-snapshots/selected-homepage-blocks-class-frontend-3-Gutenberg, writing actual.
164 | await expect(
165 | await element.getAttribute( 'class' )
> 166 | ).toMatchSnapshot( {
| ^
167 | name: `selected-homepage-blocks-class-frontend-${ index }`,
168 | } );
169 | index++;
at /home/runner/work/woocommerce/woocommerce/plugins/woocommerce/tests/e2e-pw/tests/customize-store/assembler/homepage.spec.js:166:6
|
E2E tests on nightly build (3, 3/5)
Process completed with exit code 1.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooCommerce PayPal Payments plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
E2E tests with WooPayments plugin installed
The action has timed out.
|
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Unable to find an artifact with the name: Smoke tests on trunk with WooPayments plugin installed (run 14)
|
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce Shipping & Tax plugin installed (run 14)
|
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Unable to find an artifact with the name: Smoke tests on trunk with WooCommerce PayPal Payments plugin installed (run 14)
|
Publish report on smoke tests on nightly build
Process completed with exit code 4.
|
API tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
k6 tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests on nightly build (5, 5/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block.spec.js took 1.4m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/products/block-editor/disable-block-product-editor.spec.js took 50.4s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/checkout-block-coupons.spec.js took 39.3s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-block-coupons.spec.js took 38.4s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › shopper/cart-checkout-restricted-coupons.spec.js took 34.9s
|
E2E tests on nightly build (2, 2/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[default] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[default] › merchant/order-edit.spec.js took 1.1m
|
Slow Test:
plugins/woocommerce/[default] › merchant/order-search.spec.js#L1
plugins/woocommerce/[default] › merchant/order-search.spec.js took 58.5s
|
Slow Test:
plugins/woocommerce/[default] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[default] › merchant/page-loads.spec.js took 53.5s
|
Slow Test:
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js#L1
plugins/woocommerce/[default] › merchant/products/block-editor/disable-block-product-editor.spec.js took 51.4s
|
Slow Test:
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js#L1
plugins/woocommerce/[default] › shopper/cart-block-coupons.spec.js took 38.5s
|
E2E tests on nightly build (3, 3/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/color-picker.spec.js took 5.1m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/homepage.spec.js took 2.0m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.7m
|
Slow Test:
plugins/woocommerce/[default] › shopper/checkout-block.spec.js#L1
plugins/woocommerce/[default] › shopper/checkout-block.spec.js took 1.4m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js#L1
plugins/woocommerce/[Gutenberg] › customize-store/assembler/header.spec.js took 59.9s
|
E2E tests on nightly build (4, 4/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-restricted-coupons.spec.js took 1.5m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-edit.spec.js took 1.0m
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/order-search.spec.js took 59.3s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/page-loads.spec.js took 54.1s
|
Slow Test:
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js#L1
plugins/woocommerce/[Gutenberg] › merchant/create-shipping-zones.spec.js took 52.4s
|
E2E tests on nightly build (1, 1/5)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/color-picker.spec.js took 4.9m
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/logo-picker/logo-picker.spec.js took 1.6m
|
Slow Test:
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js#L1
plugins/woocommerce/[default] › merchant/create-restricted-coupons.spec.js took 1.4m
|
Slow Test:
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js#L1
plugins/woocommerce/[default] › customize-store/assembler/homepage.spec.js took 1.2m
|
Slow Test:
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js#L1
plugins/woocommerce/[default] › admin-analytics/analytics-data.spec.js took 1.1m
|
Merge e2e test reports
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooCommerce PayPal Payments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooCommerce Shipping & Tax plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests with WooPayments plugin installed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooPayments, woocommerce-payments)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooCommerce Shipping & Tax, woocommerce-serv...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on Smoke tests on trunk with plugins (WooCommerce PayPal Payments, woocommerce-pay...
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Post Slack summary
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6, slackapi/slack-github-action@v1.23.0. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Publish report on smoke tests on nightly build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "api-daily--run-14", "k6-daily-update-site--run-14", "plugin-blocks".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
🎭 Playwright Run Summary
8 skipped
151 passed (13.4m)
|
🎭 Playwright Run Summary
6 skipped
160 passed (15.8m)
|
🎭 Playwright Run Summary
1 failed
[Gutenberg] › customize-store/assembler/homepage.spec.js:124:2 › Assembler -> Homepage › Selected homepage should be applied on the frontend
5 skipped
151 passed (19.8m)
|
🎭 Playwright Run Summary
163 passed (16.3m)
|
🎭 Playwright Run Summary
2 skipped
160 passed (21.9m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
218 KB |
|
all-blob-reports-2
Expired
|
224 KB |
|
all-blob-reports-3
Expired
|
42.4 MB |
|
all-blob-reports-4
Expired
|
217 KB |
|
all-blob-reports-5
Expired
|
232 KB |
|
api-daily--run-14
Expired
|
7.03 MB |
|
e2e-daily--run-14
Expired
|
87.9 MB |
|
k6-daily-update-site--run-14
Expired
|
2.25 MB |
|
plugin-blocks
Expired
|
650 Bytes |
|