1

Hi could someone explain the fields in Postman htmlextra report. I am not able to understand why testscripts fail shows '0' even though two assertions failed

  1. I only have 15 pm.expect in my testscripts but assertion shows as 19.
  2. Failed test shows as 2 but in summary testscripts shows fail as 0
  3. How to know total no of scenarios covered (No:of tests ) from this report.

Newman Htmlextra report

Also, why the count shows as two in the total request tab for the below scripts even though it was ran only for 1 iteration. How is this count changed ?

enter image description here

2
  • The count in test information was showing as 2 because i had pre-request script. But does not make any sense as that was not under pm.test() – PDHide Dec 11 '19 at 15:08
  • 1
    Please put useful comment when downvoting – PDHide Dec 11 '19 at 16:47
1

I only have 15 pm.expect in my testscripts but assertion shows as 19.

Assertions in postman actually means what ever inside pm.test and not just all pm.expect. So total number of assertion is the total number of testcases.

Failed test shows as 2 but in summary testscripts shows fail as 0

Testscripts are marked as failed when there is compilation or runtime errors for the scripts under tests tab. For instance, undeclared variables in the scripts

How to know total no of scenarios covered (No:of tests ) from this report.

Total number of assertions gives total number of test cases

why the count shows as two in the total request tab for the below scripts even though it was ran only for 1 iteration. How is this count changed ?

This includes the pre request script + pm.test

3
  • 1
    Hey @PDHide, the fastest way to get all your questions answered would be to raise them on the reporter GH repo - I created it so I would be able to tell you what those things mean. By asking a question here, you're just sending it out to anyone 😁 – Danny Dainton Dec 14 '19 at 12:22
  • @DannyDainton Thanks Danny for the awesome report , you meant to raise a issue or contact through community support. ? I really feel confused why tests are marked as total assertion and but failed ones are marked as total test failed . If it was total assertion and failed assertion or , total tests and failed tests then it would have made more sense – PDHide Dec 14 '19 at 12:30
  • 1
    You can raise an issue with a bunch of questions on the repo or get me through the support, either way really. :) The data is all coming through from Newman and those specific values are presented in a similar way as the CLI summary table. The reporter also takes custom template so if it doesn't make sense to you, you always have the ability to display that in a more meaningful way. :) – Danny Dainton Dec 14 '19 at 16:40

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.