I have access to a CI Job Jenkins's JSON API. Here is how I have the sequence
- I crawl a CI job and look at all the builds
- I look for the latest test report and filter out the test reports which are older than the latest code of automation. This way I have narrowed down the number of builds.
Now I have a list of test results to compare for flakiness of test cases. I can successfully do this only if i know that the input is constant to all these tests and that only the test is different.
How can I find that the input is constant when its a complex piece of code like UI of web-page (like a hash?)
How can I Get that input data from Jenkins or other place? For UI automation of web-sites
How can i solve this problem of verification of input being constant in a general way.