Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: Prolonged test suite exceeding CLI default timeout of 5 minutes displaying false positives #979

Open
Dnhem opened this issue Nov 12, 2024 · 2 comments
Open

bug: Prolonged test suite exceeding CLI default timeout of 5 minutes displaying false positives #979

Dnhem opened this issue Nov 12, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@Dnhem
Copy link

Dnhem commented Nov 12, 2024

Node.js version

18.20.2

NPM version

10.5.0

@checkly/cli version

4.9.1

Steps to reproduce

npx checkly test --timeout=1 --reporter=github

What is expected?

  • Test suite exceeding CLI default timeout of 5 minutes should not display failed test result(s) on GitHub MD report
  • Timeout should be flexible/increased to allow test suite to finish executing instead of displaying false positive on GitHub MD report

What is actually happening?

Misalignment - GitHub MD displays false positives while Test Sessions are displaying passed results

image

Any additional comments?

No response
@Dnhem Dnhem added the bug Something isn't working label Nov 12, 2024
@sorccu
Copy link
Collaborator

sorccu commented Nov 12, 2024

Thanks for the report, I'll look into this as soon as possible.

@everzel
Copy link

everzel commented Nov 26, 2024

@sorccu Hi, any updates?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sorccu @Dnhem @everzel