I have an doubt regarding how to create a automation report like how we do a Manual report with the help of test cases.

E.g. Here is one scenario " Email sign up"

In manual test case, we will cover all the conditions like Empty value, Boundary value analysis, valid, invalid cases and finally we can make a report based upon all the test case like Total cases teste, total failed cases, total passed cases.

So, like above scenario, could any one let me know how to combine or create the Total cases tested, total failed cases, total passed cases after running the automation testing.

  • 2
    What tools are you using for automated testing? Most have reporting functionalities built in.
    – FDM
    Commented Mar 8, 2016 at 10:24
  • 1
    We cannot answer this unless you specify which test framework you use. If you are asking hypothetically, @FDM's comment is your answer. If you are using a test framework now but do not which framework you use, please find out. Whoever knows which test framework you use probably knows how to determine those aggregate statistics, too.
    – user246
    Commented Mar 8, 2016 at 13:07
  • FYI, We use TestNG framework in APPIUM tool @FDM. Commented Mar 9, 2016 at 4:52
  • TestNG automatically creates a HTML report, and also in XML format if I'm not mistaken... What is your problem?
    – FDM
    Commented Mar 9, 2016 at 6:32
  • Sorry for inconvenience, how to connect our test case report with TestNG test report @FDM Commented Mar 9, 2016 at 10:11

4 Answers 4


If you are using Selenium tool for automation Testing, It's easy to generate Test report using TestNG framework. Just you have to make TestNG class and use appropriate annotations in TestNG.

Run it as TestNG -->> right click on Project-->>Click on Refresh-->> Test output folder will create.


  • emailable report.html &
  • index.html files in test output folder.

You will get report in HTML which gives detailed status about how many test Cases passed & failed.

for Ex you may check this one-

enter image description here


You can use TestNG report if you're writing your automation scripts in Java.

Here are few screenshot of TestNG reports.

enter image description here

enter image description here

Here are few tutorial links for TestNG

  1. Link 1
  2. Link 2
  3. Link 3

I am using ExtentReport for the test result generation, where i can see how much test case is passed/failed and how many scenario's tested along with the information of the person running the automation script. Extent Report is an opensource test report which you can download from http://extentreports.relevantcodes.com/, It supports both java as well as .net.

Extent Report is very easy to use and it have good looking UI Dashboards.

[1]: https://i.sstatic.net/cWmYb.png


Like those above said, it depends on what tools/frameworks you are using.

As we migrated to microservices/CD, we found that integrating our tests with ELK stack provided the best bang for the buck. This allowed us to have a centralized reporting platform, not only for developers, but for testers as well.

Here is one of the articles we referred back to while setting it up: https://cdinsight.wordpress.com/2015/09/16/build-impactful-test-automation-dashboards-using-elk-stack/

Take care!

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.