Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [performance]

Performance testing is a subset of performance engineering, an emerging computer science practice which strives to build performance into the implementation, design and architecture of a system.

41
votes
2answers
42k views

Where can I find good JMeter tutorials?

I have just been assigned the tasks of doing some research and doing some JMeter tests of my own to get familiar with performance testing. As I have never used this tool before, I would just like to ...
17
votes
3answers
25k views

What is the difference between SLA (Service Level Agreement) and SLO (Service Level Objective)?

I have seen these two abbreviations being used interchangeably. Also, I have seen SLA being used as a catch all term for anything related to 'what the test is supposed to measure and compare against'. ...
16
votes
5answers
24k views

How do you calculate the number of virtual concurrent users to use in a load test given data on actual site traffic?

When working on performance testing, one of the problems I've faced is trying to translate real-world web application traffic to simulated traffic. A practical example is for an eCommerce site. ...
13
votes
9answers
1k views

Performance testing - a way in?

We have an a browser based application that is built on the Microsoft Stack, specifically .NET 3.5. It also uses Ajax, iframes, jQuery etc. At the moment we are just guessing at the concurrency ...
12
votes
2answers
617 views

Measuring test performance when there is high variance

I am running single purpose performance tests on a daily basis. Currently, I run each test 3 times and average them out. But I get fluctuations from day to day which make it difficult to detect ...
12
votes
1answer
6k views

JMeter: Getting error in non GUI mode

While trying to execute JMeter from the command line in non-GUI mode I'm getting errorlevel=2 error message. What I did is, Navigate to the JMeter bin directory in command prompt. Run the ...
11
votes
5answers
4k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
10
votes
5answers
1k views

Can a proportionately scaled down testing environment find performance load issues?

At my company, we are working on ways to improve our testing of database changes, in our testing environment first. Since there are no resources to have a production like volume of data in servers ...
10
votes
3answers
307 views

Should you preload DLL's in performance tests?

When running automated performance tests, is it better to preload any DLL's which would slow the first run of a test? This would improve the consistency of the test results but would not reflect the ...
9
votes
3answers
681 views

End-to-end tests are running for 5 hours

This is a continuation of Speeding up end-to-end tests topic, but a more specific one. Currently, it takes ~5 hours for our daily end-to-end testing run to complete. What can we do to improve on ...
9
votes
9answers
35k views

Tools to measuring page rendering time

I'm using Jmeter at my organization for performance testing. The application is a secured web portal that provides a lot of reports and documents to its user. A major issue that I've run into is ...
8
votes
1answer
486 views

IEEE 730 standard - Why was “non-functional” term deprecated when applied to requirements?

I am reading the "Software Quality Assurance" eBook by Claude Y. Laporte, Alain April, Leo R. Best, Morris Hein, and Scott Pattison that was published on 22-DEC-2017 by IEEE Computer Society Press. ...
8
votes
2answers
33k views

How to generate Report Dashboard in Jmeter?

Jmeter has come up with a latest release 3.0. This is a major release not just bug fixes after almost a decade. I read that we can generate Report Dashboard as well with the latest release. Tell me ...
7
votes
3answers
2k views

How to check if web app speed issues are due to a slow network connection?

Sometimes, while testing a web application, the app responds much slower than usual. There could be many reasons for this such as bugs in backend, outage in some of the servers, slow internet on ...
7
votes
1answer
9k views

load test terms: What are Transactions, request, TPS,throughput?

I am completely new in load testing and want to start analyzing results of a load test. My problem is that I need a reference for the answers to be sure about its correctness. These are my question ...
7
votes
3answers
3k views

Load-Testing an SMS application

HELP! Any developers whom have ever created a service that interacts with people via SMS, how did you test you application for integrity under heavy load? Im in the middle of helping the company I ...
7
votes
3answers
2k views

performance-testing systems on virtual machines that normally run on physical machines

My employer runs some of our systems on physical machines with attached hard drives. I am charged with performance-testing those systems. For cost reasons, I've been asked to test those systems ...
6
votes
5answers
1k views

What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?

In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
6
votes
3answers
4k views

Maximum Number of Threads in Jmeter

what is the maximum number of threads in JMeter from a single machine? I know there is a dependency for hardware configuration. I'm using this hardware configuration: Command: #lscpu Architecture: ...
6
votes
1answer
8k views

How to stop thread in JMeter?

I need to stop a thread in JMeter when some condition is satisfied. How can I do this? I suppose there should be some method like Thread.Stop() or something like this but can't find concrete info.
6
votes
5answers
4k views

Performance Testing a cloud application

What are the best approaches and what concerns are there about performance testing a web application that is hosted in the cloud?
6
votes
3answers
902 views

Test, Improve performance of WebDriver Automation framework

I have designed a hybrid(keywords and data in same excel sheet) framework using WebDriver+Java+TestNG+Maven. I am using PageFactory, Singleton Pattern . I am using different type of HTML locators in ...
6
votes
2answers
5k views

How do you stress test a video streaming app?

I have a a streaming application that I am going to test. I don't really know how to do this. Do I need a special plugin (if so, why)? Why is it difficult to record a scenario for streaming a video, ...
6
votes
1answer
486 views

Gatling recorder with Google Auth

I'm starting to learn Gatling and using Gatling Recorder. In my SUT, login is done via Google Auth, but when I try to record steps with Gatling Recorder and Firefox with the proxy set, I receive the ...
6
votes
1answer
442 views

Performance for WebDriver vs AndroidDriver vs iOSDriver

I initially wrote a few selenium scripts to test my web application. The scripts use RemoteWebDriver call for initialising web driver. I now wanted to run the same scripts to test the web application ...
5
votes
4answers
18k views

what is the concurrent users in load testing using Jmeter

in Jmeter, for a thread group, the number of thread users is 20, ramp-up period is 5s, the loop count is 10, so what is the concurrent users in this situation.
5
votes
3answers
7k views

Load test with multiple credentials

Okay so I have created a very simple webtest. The purpose of this webtest is to attempt to login whilst simulating a few failing attempts. The webtest has the obvious credentials associated with it:- ...
5
votes
3answers
1k views

Estimation of maximum no of concurrent users a application will need to support

I need to estimate the maximum number of concurrent users my application will experience in order to set goals for the software development team. We have 550 potential users, but modelling of the ...
5
votes
4answers
3k views

How to determine 'reasonable' response times for performance testing?

I have found performance targets (how long web pages take to respond to actions) difficult to introduce into organizations. There seem to be are no clear definitions (in the industry) that are ...
5
votes
3answers
151 views

Performance / Load Testing: Where can I start?

My Application is a cloud-based solution. And I need to test its performance with many concurrent users that should be within the minimum market viability for concurrent users. I do not have a ...
5
votes
2answers
3k views

Cloud Based Automation Testing with Selenium WebDriver - Java

I am beginner in selenium webdriver (java), and wanted to know whether selenium webdriver can be used in cloud based application testing or not, if yes how to setup it (Searched over the net but didn'...
5
votes
2answers
7k views

Comparison of JMeter vs Visual Studio Load Test

My organization is currently planning to test the load capability of our web application (we live in a third-world country, of which testing practice is a very new thing here). In accommodating this ...
5
votes
1answer
963 views

How to estimate “how many servers our company sould purchase for this web app” with load/performance testing?

this is a question I faced in an interview: A web app is going to go online and the manager want you to find out how many servers the company should purchase. We have one server(used by testers) and ...
5
votes
1answer
193 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
5
votes
3answers
736 views

How can I do performance testing on Cassandra database as a manual tester?

I need to send data on Cassandra DB and retrieve it back. I want to check how much time it will take to post data and retrieve it back. We are not using Rest API's. There are methods(logic)only. Data ...
5
votes
1answer
3k views

How to define throughput profile for performance tests?

Gatling defines a number of ways to define throughput profile for performance tests. Either through a number of arriving users: setUp( scn.inject( nothingFor(4 seconds), // 1 atOnceUsers(10)...
5
votes
1answer
103 views

Azure VM for comparative performance testing

Is it acceptable to use Azure VMs for comparing performance of an application over different Windows OS's? I've heard that testing in a VM can give squiffy results as the hypervisor tries to juggle ...
4
votes
5answers
189 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
7answers
924 views

Can a performance issue be defined as blocking bug?

I am the QA Manager of my organization. We have a performance issue, where a process takes 6X times rather then X. I defined the issue as blocking since there is no workaround on eliminating the ...
4
votes
2answers
2k views

What are the most useful KPIs for tester

There are many KPI (Key Performance Indicators) suggested to measure the performance of software tester. My concern is what are the most useful/ efficiency KPIs for a tester?
4
votes
3answers
6k views

Issue with Reading CSV file when doing Distributed testing in Jmeter

I have a satisfactory test plan, that I have been using to test with from single load generation server to our application server which reads data from a CSV file. I have been been asked to setup and ...
4
votes
8answers
5k views

What are the deliverables of the QA department?

The company I work for conducts quarterly performance reviews. As a member of our small QA team I've been ask to help define this process. A lot of what I do is identifying issues and collaborating ...
4
votes
2answers
114 views

Endurance testing strategy needed for a LAMP Stack application

The AUT is built with LAMP* Stack and is the Intranet Home app and is going to be used by almost all employees of a large corporation. Application Performance Testing is carried out using HPE suite ...
4
votes
3answers
14k views

Relation between throughput and hits per second

From below two scenarios which can be happen and which cannot? Please help me understand: Scenario 1: Throughput is very high and hits per second is very low Scenario 2: Hits per second is high and ...
4
votes
3answers
2k views

Performance testing automation tools for desktop applications

Is there any open source automation tool for performance testing for desktop applications? Load Runner and JMeter are supporting web applications only. I searched in several websites but found no ...
4
votes
3answers
9k views

Using Charles Proxy to test mobile app network

I would like to test the behavior of my app in case of slow network. Can Charles Proxy do it? please give me some guidance. Many thanks.
4
votes
2answers
5k views

Speed up launch of WebDriver Firefox Window

When WebDriver initializes, there is a long waiting time when a browser window launches before the actual automated test begins. How can I speed this up? Is there a way to have a browser window ...
4
votes
3answers
5k views

How to use multiple Jmeter instances on a single machine

I want to use multiple JMeter instances from a single machine. Is it possible? I know about distributed testing but I haven't required machines to do my load test. Actually, I need to run four ...
4
votes
3answers
228 views

Will there be any negative impact, If I load test an Amazon-EC2 hosted application from JMeter (also AWS-EC2 hosted)

Has anyone experience of load-testing a web application hosted on Amazon-EC2 by using the JMeter that is also hosted on Amazon EC2 instance (separate instance). Please share best practices and tips ...
4
votes
2answers
139 views

Measuring audio delay

I am working on a project that involves streaming video with audio to/from various cloud streaming services with intermediate encoding steps (i.e. mixing with additional overlays). Each stage in the ...