Questions tagged [performance]
Performance testing is a subset of performance engineering, an emerging computer science practice which strives to build performance into the implementation, design and architecture of a system.
424
questions
46
votes
2
answers
43k
views
Where can I find good JMeter tutorials?
I have just been assigned the tasks of doing some research and doing some JMeter tests of my own to get familiar with performance testing. As I have never used this tool before, I would just like to ...
23
votes
4
answers
48k
views
What is the difference between SLA (Service Level Agreement) and SLO (Service Level Objective)?
What exactly is an SLO? How does it differ from SLA? From a performance testing point of view, how should these terms be used?
19
votes
5
answers
27k
views
How do you calculate the number of virtual concurrent users to use in a load test given data on actual site traffic?
When working on performance testing, one of the problems I've faced is trying to translate real-world web application traffic to simulated traffic.
A practical example is for an eCommerce site. ...
13
votes
9
answers
1k
views
Performance testing - a way in?
We have an a browser based application that is built on the Microsoft Stack, specifically .NET 3.5. It also uses Ajax, iframes, jQuery etc.
At the moment we are just guessing at the concurrency ...
13
votes
1
answer
13k
views
JMeter: Getting error in non GUI mode
While trying to execute JMeter from the command line in non-GUI mode I'm getting errorlevel=2 error message.
What I did is,
Navigate to the JMeter bin directory in command prompt.
Run the command &...
12
votes
5
answers
5k
views
Looking for open source, Java-based tool for performance testing
Goal:
I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https.
My findings:
...
12
votes
2
answers
983
views
Measuring test performance when there is high variance
I am running single purpose performance tests on a daily basis. Currently, I run each test 3 times and average them out. But I get fluctuations from day to day which make it difficult to detect ...
11
votes
5
answers
2k
views
Can a proportionately scaled down testing environment find performance load issues?
At my company, we are working on ways to improve our testing of database changes, in our testing environment first.
Since there are no resources to have a production like volume of data in servers ...
11
votes
2
answers
15k
views
load test terms: What are Transactions, request, TPS,throughput?
I am completely new in load testing and want to start analyzing results of a load test.
My problem is that I need a reference for the answers to be sure about its correctness.
These are my question ...
10
votes
2
answers
45k
views
How to generate Report Dashboard in Jmeter?
Jmeter has come up with a latest release 3.0.
This is a major release not just bug fixes after almost a decade.
I read that we can generate Report Dashboard as well with the latest release.
Tell me ...
10
votes
3
answers
350
views
Should you preload DLL's in performance tests?
When running automated performance tests, is it better to preload any DLL's which would slow the first run of a test? This would improve the consistency of the test results but would not reflect the ...
9
votes
3
answers
34k
views
Relation between throughput and hits per second
From below two scenarios which can be happen and which cannot? Please help me understand:
Scenario 1: Throughput is very high and hits per second is very low
Scenario 2: Hits per second is high and ...
9
votes
9
answers
44k
views
Tools to measuring page rendering time
I'm using Jmeter at my organization for performance testing. The application is a secured web portal that provides a lot of reports and documents to its user.
A major issue that I've run into is ...
8
votes
3
answers
2k
views
End-to-end tests are running for 5 hours
This is a continuation of Speeding up end-to-end tests topic, but a more specific one.
Currently, it takes ~5 hours for our daily end-to-end testing run to complete. What can we do to improve on ...
8
votes
3
answers
9k
views
How do you stress test a video streaming app?
I have a a streaming application that I am going to test. I don't really know how to do this. Do I need a special plugin (if so, why)?
Why is it difficult to record a scenario for streaming a video, ...
7
votes
5
answers
2k
views
What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?
In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
7
votes
4
answers
33k
views
what is the concurrent users in load testing using Jmeter
in Jmeter, for a thread group, the number of thread users is 20, ramp-up period is 5s, the loop count is 10,
so what is the concurrent users in this situation.
7
votes
3
answers
7k
views
Maximum Number of Threads in Jmeter
what is the maximum number of threads in JMeter from a single machine? I know there is a dependency for hardware configuration. I'm using this hardware configuration:
Command: #lscpu
Architecture: ...
7
votes
1
answer
678
views
IEEE 730 standard - Why was "non-functional" term deprecated when applied to requirements?
I am reading the "Software Quality Assurance" eBook by Claude Y. Laporte, Alain April, Leo R. Best, Morris Hein, and Scott Pattison that was published on 22-DEC-2017 by IEEE Computer Society Press.
...
7
votes
2
answers
4k
views
How can I generate dashboard from two csv files in Jmeter
I am trying to generate a single dashboard from two CSV files. These two CSV files are generated from two different runs.
This is what I tried so far.
Merge the contents of two CSV files and prepare ...
7
votes
1
answer
198
views
Capture Provisioning time in Performance testing
I have a situation in my application where I need to wait and note the provisioning time of a Virtual Machine (The time taken when the order got accepted and the time it is available for usage).
How ...
7
votes
3
answers
4k
views
Load-Testing an SMS application
HELP! Any developers whom have ever created a service that interacts with people via SMS, how did you test you application for integrity under heavy load?
Im in the middle of helping the company I ...
7
votes
3
answers
3k
views
performance-testing systems on virtual machines that normally run on physical machines
My employer runs some of our systems on physical machines with attached hard drives. I am charged with performance-testing those systems. For cost reasons, I've been asked to test those systems ...
7
votes
1
answer
2k
views
How to deserialize and correlate Binary Large Objects in Load Runner 11.5 Web Custom Request?
I'm working on a Silverlight based application. We've recorded the scripts using Load Runner 11.5 and while replaying to find dynamic values for correlation, we found out that the entire data in a ...
6
votes
8
answers
2k
views
Can a performance issue be defined as blocking bug?
I am the QA Manager of my organization.
We have a performance issue, where a process takes 6X times rather then X. I defined the issue as blocking since there is no workaround on eliminating the ...
6
votes
1
answer
13k
views
How to stop thread in JMeter?
I need to stop a thread in JMeter when some condition is satisfied. How can I do this?
I suppose there should be some method like Thread.Stop() or something like this but can't find concrete info.
6
votes
3
answers
5k
views
How to check if web app speed issues are due to a slow network connection?
Sometimes, while testing a web application, the app responds much slower than usual. There could be many reasons for this such as bugs in backend, outage in some of the servers, slow internet on ...
6
votes
2
answers
9k
views
How can I test load for a chat app built on node.js and socket.io?
Here is the link for a simple chat application with room concept which I'm referring to learn how to create socket.io applications - https://github.com/mcantelon/chatrooms .
I need to test how much ...
6
votes
2
answers
4k
views
Cloud Based Automation Testing with Selenium WebDriver - Java
I am beginner in selenium webdriver (java), and wanted to know whether selenium webdriver can be used in cloud based application testing or not, if yes how to setup it (Searched over the net but didn'...
6
votes
6
answers
5k
views
Performance Testing a cloud application
What are the best approaches and what concerns are there about performance testing a web application that is hosted in the cloud?
6
votes
3
answers
1k
views
Test, Improve performance of WebDriver Automation framework
I have designed a hybrid(keywords and data in same excel sheet) framework using WebDriver+Java+TestNG+Maven. I am using PageFactory, Singleton Pattern . I am using different type of HTML locators in ...
6
votes
4
answers
13k
views
Can't locate Jmeter\Bin on Mac to Install ApacheJMeterTemporaryRootCA.crt
I have installed Jmeter by the homebrew method. For doing performance testing of mobile app, I need to install the ApacheJMeterTemporaryRootCA.crt,
which I can't locate in the said jMeter\bin ...
6
votes
2
answers
1k
views
Performance for WebDriver vs AndroidDriver vs iOSDriver
I initially wrote a few selenium scripts to test my web application. The scripts use RemoteWebDriver call for initialising web driver.
I now wanted to run the same scripts to test the web application ...
5
votes
5
answers
207
views
Making sense of performance regressions
Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that.
Commit B ...
5
votes
2
answers
3k
views
What are the most useful KPIs for tester
There are many KPI (Key Performance Indicators) suggested to measure the performance of software tester. My concern is what are the most useful/ efficiency KPIs for a tester?
5
votes
3
answers
7k
views
Load test with multiple credentials
Okay so I have created a very simple webtest. The purpose of this webtest is to attempt to login whilst simulating a few failing attempts.
The webtest has the obvious credentials associated with it:-
...
5
votes
3
answers
4k
views
Estimation of maximum no of concurrent users a application will need to support
I need to estimate the maximum number of concurrent users my application will experience in order to set goals for the software development team.
We have 550 potential users, but modelling of the ...
5
votes
4
answers
13k
views
Issue with Reading CSV file when doing Distributed testing in Jmeter
I have a satisfactory test plan, that I have been using to test with from single load generation server to our application server which reads data from a CSV file. I have been been asked to setup and ...
5
votes
5
answers
7k
views
Difference between Scalability Testing And Capacity Testing?
Belongs to non-functional testing type. But I get confused between these 2 types of testing.
5
votes
2
answers
8k
views
Comparison of JMeter vs Visual Studio Load Test
My organization is currently planning to test the load capability of our web application (we live in a third-world country, of which testing practice is a very new thing here). In accommodating this ...
5
votes
2
answers
27k
views
How to check latency time in Jmeter?
What settings do I need to use so I can check latency time in Jmeter?
5
votes
4
answers
14k
views
How to use multiple Jmeter instances on a single machine
I want to use multiple JMeter instances from a single machine. Is it possible?
I know about distributed testing but I haven't required machines to do my load test. Actually, I need to run four ...
5
votes
2
answers
413
views
Measuring audio delay
I am working on a project that involves streaming video with audio to/from various cloud streaming services with intermediate encoding steps (i.e. mixing with additional overlays).
Each stage in the ...
5
votes
1
answer
1k
views
How to estimate "how many servers our company sould purchase for this web app" with load/performance testing?
this is a question I faced in an interview:
A web app is going to go online and the manager want you to find out how many servers the company should purchase. We have one server(used by testers) and ...
5
votes
1
answer
306
views
In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?
Background:
MFAT = "Multiple Factors at a Time"
OFAT = "One Factor at a Time"
In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
5
votes
3
answers
1k
views
How can I do performance testing on Cassandra database as a manual tester?
I need to send data on Cassandra DB and retrieve it back. I want to check how much time it will take to post data and retrieve it back.
We are not using Rest API's. There are methods(logic)only. Data ...
5
votes
1
answer
277
views
JMeter graph interpretation
I'm very new at JMeter and am trying to get an idea of how to interpret the graphs below.
The test I performed used 1 thread group with 600 users ramped up ever 5 seconds. What concerns me is the ...
5
votes
1
answer
4k
views
How to define throughput profile for performance tests?
Gatling defines a number of ways to define throughput profile for performance tests. Either through a number of arriving users:
setUp(
scn.inject(
nothingFor(4 seconds), // 1
atOnceUsers(10)...
5
votes
3
answers
1k
views
HTTP request having an Edit action is giving an unauthorized error in JMeter Script
I recorded my scripts using JMeter proxy recorder. The JMeter scripts ran perfectly after I configured the Header Manager and the Authorization Manager. All the HTTP requests were responded perfectly. ...
5
votes
1
answer
126
views
Azure VM for comparative performance testing
Is it acceptable to use Azure VMs for comparing performance of an application over different Windows OS's?
I've heard that testing in a VM can give squiffy results as the hypervisor tries to juggle ...