Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Script to run e2e test in loop to detect flaky test #274

Closed
wants to merge 2 commits into from

Conversation

izderadicka
Copy link
Contributor

I used this script to test if e2e test is not flaky - thought that it might be useful to have it around for future.

@ikatson
Copy link
Owner

ikatson commented Nov 9, 2024

This is just personal taste, but this script is a bit too complex for my liking. I'd rather not merge it in at all. At most a one-liner that we can paste into Makefile maybe?

I remember previously I showed a one-liner that I was using instead of a complex bash script that did the same job, wdyt of adding that to Makefile (to quickly run smth like make e2e_until_fail instead?

@izderadicka
Copy link
Contributor Author

OK - here are couple things, that makes it bit more complex - defined number of runs and measuring failure rate and storing log from all failures - especially last one was useful as I was able to see different failure modes.

@izderadicka
Copy link
Contributor Author

Closing as not fitting

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants