4
Having done 23 years of performance tests including trouble shooting, correction, and rerun I can agree with testerab on long reports full of nice graphs that remained unread (and even if scanned certainly not understood). Of course if you are a paid for third party, or even expendable employee, that report might be the only way you can justify your costs ...
3
If are asking how to send a file via email then I'm not sure the "stakeholders" will need this report as if a person is not capable of accomplishing this simple activity I strongly doubt the load report is relevant
If you need to do it using JMeter - you can pack the folder with the dashboard report using OS Process Sampler and SMTP Sampler (it will be a ...
3
Without the Reporting Server, your only option to get this information is through the TFS API. This is because TFS does not directly associate test results with test cases: instead there is an implicit linkage through a test run with test points.
The short version is that each test case may be associated with one or more test runs.
Each test run will have ...
3
If you are using Selenium tool for automation Testing, It's easy to generate Test report using TestNG framework. Just you have to make TestNG class and use appropriate annotations in TestNG.
Run it as TestNG
-->> right click on Project-->>Click on Refresh-->> Test output folder will create.
Check
emailable report.html &
index.html files in ...
3
I have served as QA lead for multiple Scrum teams. Any release might have multiple teams releasing at the same time. I was responsible for the overall QA sign-off and test summary.
What we provided as a summary document:
What user stories were included from each group
Any documented defects that were not fixed and therefore constituted a release risk
...
3
This all feels like a great waste of time, because there is a very big chance no-one will read them ever.
I hear you on this one. I have wasted far too many hours of my life producing documents that nobody ever read - enough so that at one point, I devised Anna's Chocolate Bar Test. (Somewhere in the last half of the document, you state that you have ...
3
I'm not sure how someone who doesn't work in your organization is supposed to know whether it's ok to delete a report after one or two months.
Ask someone you work with: a peer, or your boss, or maybe the people who use the reports.
2
Performance Testing of Desktop applications is oxymoron. Desktop application is used by one, at most two persons at a time. So if generating a report takes 5 seconds it will take 5 seconds no matter how many users are pushing the button.
It takes 9 month for a woman to born a baby. 3 women won't produce a baby in 3 month. 0.5 woman won't give you a baby in ...
2
AFAIK there are certain limitations to the online version of the tool.
Here is a screenshot of how it looks on my side in Microsoft Test Manager.
There also some information at the bottom that can`t be seen in the SS below reering to Links and History.
2
Cucumber is your test-management tool, not? The scenario's are the test-cases for the requirement.
The the cucumber book explains how you can structure your features in a logical way to use it as documentation.
I suggest you combine cucumber-reporting with Jenkins to run the cucumber steps and archive the results per build.
answered Apr 22 '15 at 8:11
Niels van Reijmersdal
31.7k4 gold badges52 silver badges118 bronze badges
2
@Imen: I know below mentioned reporting techniques.
And more important is how you want your reports (Line by line/step by step execution report, class/method level report, etc..?).
What's the best appropriate method used by Selenium Testers to generate tests reports?
Selenium will support multiple reports generation techniques. Testers will be using ...
2
HW revision X, Firmware 1.1.3 etc.
I use the term 'Environment'. It looks like JIRA does too, source.
2
I suggest combining Selenium with a test-runner like jUnit or TestNG, then you can parse the results into a nice report with Allure (also lists more test-runners).
The next step is to run all the test on each build, with a build-server like Jenkins and report broken build/tests with visual indicators.
Allure is a reporting framework to parse xUnit test ...
answered Oct 6 '15 at 19:40
Niels van Reijmersdal
31.7k4 gold badges52 silver badges118 bronze badges
2
You can use TestNG report if you're writing your automation scripts in Java.
Here are few screenshot of TestNG reports.
Here are few tutorial links for TestNG
Link 1
Link 2
Link 3
2
They should be marked as succeeding, not failing.
The test itself is to validate that low privilege users can't access things that they aren't permitted to, so a successful test is one in which they are unable to access the resource, and a failing test is one where they can access the resource. The test case should be written as such, and not rely on the ...
2
An example comes to mind:
"Change request" - user wants additional changes that are not in the original scope of the app, this also includes any additional requests from the user
2
Htmle report in extente report is deprecated from v4.1.3:
http://extentreports.com/docs/versions/4/java/v3-html-reporter.html
Use spark report instead,
http://extentreports.com/docs/versions/4/java/spark-reporter.html
The steps remain the same. Only the name changed and everything else works almost the same
1
As per current JMeter version (JMeter 4.0) it is something which is not supported.
The options are in:
Go for Composite Timeline Graph where you can combine as many charts into single one as you want. You can install Composite Timeline Graph using JMeter Plugins Manager
Use a 3rd-party results analysis tool like BM.Sense which provides Composite ...
1
Remove all the listeners from your Test Plan apart from the Graphs Generator Listener
Add the next line to user.properties file:
jmeter.save.saveservice.autoflush=true
This way JMeter will not rely on previous listeners results and will work with the .jtl results file directly.
More information:
Graphs Generator Listener
Configuring JMeter
Apache JMeter ...
1
After cleaning test results new report is generated without tests that are not included in test suite (xml).
Because I am using maven the command to clean results is:
mvn clean
Or:
1
Annotations transformers is your answer. You can intercept and change any annotation behaviour.
http://testng.org/doc/documentation-main.html#annotationtransformers
1
In my experience, it is less value to share file created by automation or performance tool with stakeholders. They will not understand it. What I would suggest you is to create a short presentation (7-15 min) to present the results and answer the possible questions.
1
In your extent reporter class, specify the code as:
ExtentReports extent = new ExtentReports("Specify the file path here where your extent reports should reside",false);
Parameter False - Is used to append the reports of previous run testcase along with newly run testcase.
Parameter True- Deletes the history of reports of previous run testcases and shows ...
1
you can use the below code.
just pass 'false' as parameter
this will not replace your previous report with new one
and in the end you will get the merged report for all the scripts
public ExtentReports(String filePath, Boolean replaceExisting)
{
this(filePath, replaceExisting, null, null, null);
}
public ExtentReports extent= new ExtentReports(...
1
Looks like the TestNG reporter shows this info in the results by default. The screenshots in this TestNG reporting howto shows: Total methods, failed and passed.
Alternatively let a CI-server (like the free teamcity or open-source jenkins) report and mail results. You do have a build server which runs the tests on each commit, don't you? :)
We are using ...
answered Mar 22 '17 at 10:45
Niels van Reijmersdal
31.7k4 gold badges52 silver badges118 bronze badges
1
I have done something similar in the past, but not in the test itself. Most xUnit test-frameworks have SetUp() and CleanUp() functions. This seems a better place to handle this. Primary as you do not repeat yourself in each test-case. It will be easier to add more fields for your report when needed.
For C# and MS-test this would like something like this:
[...
answered Jan 29 '17 at 21:01
Niels van Reijmersdal
31.7k4 gold badges52 silver badges118 bronze badges
1
Extent Report is much better than XSLT Report.
In Extent Report, All information like who run the test when this test got passed, how much time does it took to get completed.
Major feature is the rich GUI it possess.
Also all the relevant details to the corresponding test can be provided make it pretty more easy for the person who is having a look into ...
1
You can use allure reports, it is under active development and widely used
http://allure.qatools.ru
1
I am using ExtentReport for the test result generation, where i can see how much test case is passed/failed and how many scenario's tested along with the information of the person running the automation script. Extent Report is an opensource test report which you can download from http://extentreports.relevantcodes.com/, It supports both java as well as .net....
1
So after some deliberations and code changes (not much), I was able to port the HTMLRunnner code to Python 3.0+ compatible mode.
I ran a simple test suite using the HTMLRunner and I can see an HTML report created out of it. It's not as fancy as Allure but it does the job.
Another option suggested by @Amazpyel is Nose, although I haven't tried it out yet.
...
Only top voted, non community-wiki answers of a minimum length are eligible