Currently the requirement we have is to create defects automatically in JIRA when a test automation script fails.
However we are looking for approaches to avoid raising defects if it's an Environment issue or Automation Script/Framework issue.
Here are the approaches which we are thinking of:
- For Flaky Tests we will maintain a flag to not raise defects if those are failed
- We will raise defects only on failure of Assertion and not on any other type of failure
- Will raise defect depending upon presence of some words in the failure log trace/stack trace
While we understand no single approach or combination of approaches would be 100% accurate, it would be a great help if anyone has already achieved some level of accuracy with one or more approaches and can share their approach.