Hot answers tagged

41

Looking into Jmeter User's Manual will be indeed good as first step (Getting Started, Building a Test Plan, Building a Web Test Plan). Several step-by-step guidelines about Jmeter setup and usage for performance/load testing you can find here: - Jmeter articles and tutorials: Load Testing your Applications with Apache JMeter Using JMeter Effective load ...


12

There is never a general industry-wide answer to this sort of question. What might be "Key" for your company may very well not be "Key" for my company. To answer this question for your specific context, find out what matters to the stakeholders you serve. Figure out what is important, what is not, and then determine what indicators can help you determine if ...


10

The first thing you need to do is isolate whatever could be messing with your system. Make it as independent as possible. The fewer background processes, extra hardware and software, and even network traffic you can get, the better. Sometimes it's even a good idea to run these on a batch job that runs at night at a time when you know there's nothing else ...


9

I have had some luck using Grinder. It is Java based but you can also write your scripts in Jython or Clojure. You said that you would like to take advantage of your team's current Selenium scripts and expertise performance testing. You did not describe your regression test scripts, but you may want to reconsider whether they are appropriate. In ...


8

JMeter thread can be stopped with standard JMeter sampler Test Action. There are 3 options: Pause, Stop and Stop Now.


8

It's not exactly clear what question you are asking, but let me take a stab. I would deal with it by creating a bug report. In it, I would mention what you are seeing in Commit A, and Commit B. I'd mention that the combination of the two pushes performance past the prescribed limits. From a QA point of view, it's not important at all in which Commit the ...


7

All right, So Tristann kindly revised his original question to include more details in terms of a scenario. So I'm adding a second answer to more directly address it. Firstly you'd probably want to ask a few more questions about what the customer is most concerned with and what they want tested, here's a small sample: what's the duration of the shoppers ...


5

you could use a plugin, although there is a simpler way. You can create a CSV file with the list of usernames and passwords you want to iterate through and then create a datasource. When you execute the web test, it will iterate through all of the items in the CSV file, one line for each test execution. Based on what you outlined above I would probably ...


5

There are a lot of performance testing tools: Apache Bench The Grinder Siege Pylot Setup for the most part is very easy. You could run each of these packages on a local VM; however, if you want to simluate large loads of traffic you need to have a machine with a little more RAM and Processor. Since this is an AJAX application you might have to simulate ...


5

Desktop software usually requires installation. Web applications usually do not. But web applications are sometimes expected to be running 24x7. This can make upgrades and maintenance more of a challenge to plan and execute (and thus test) In addition to browser versions mentioned by others here, you may need to worry about browser add-ons You may also need ...


5

JMeter is a good choice. Kindly find answers on your queries below: Also, I'm not sure if I can define requests dynamically, based on the results of previous request. You can. Particularly for REST web services I would recommend installing Extras with Libs Set of JMeter Plugins project which provides JSON Path Extractor so you will be able to work with ...


5

I have put together a really simple article of doing performance testing with Jmeter over here - http://testcy.co.in/performance-testing-jmeter. Even novice users with not much technical knowledge of code can do performance testing using this method. For more tutorials, here you go, http://www.tutorialspoint.com/jmeter/jmeter_tutorial.pdf ...


4

I wrote about concurrent users and numbers in a blog post: http://blog.xceptance.de/2011/06/07/get-the-right-load-mix-out-of-a-few-numbers/ Wait… where are my concurrent users? This is simple: “concurrent users” is an inaccurate way of describing traffic, so we have not used that number yet. Why is that? To get to the bottom of that, we ...


4

You should not focus on the concurrency rate, rather try to get traffic statistics, such as visits, amount of activity, and so on. If you already have a site running, you can analyze the server logs or any audit trails your application might write. When your site is still offline and you just want to go live, you have to come up with some expectations for ...


4

I do not think the UI testing is very different: field validation, default values, resizing, scalability, and so on. You probably need to support more than one brand and version of web browser, and perhaps even some mobile devices. You may want to separate your business logic tests from your browser-level tests so that you do not repeat every test on ...


4

Combinatorial explosion of varieties: You may need to test each version of each browser on various hardware running various operating systems Front-end testing can be easier because of the universality of the displayed information When you do performance/load testing you're simultaneously testing the machine the server is on, not the current desktop (unless ...


4

Apart from "what those other guys said", all of it very good advice, some other considerations I'd recommend are: Usability - Desktop applications tend to have a help file built in, where web applications should be more or less self-explanatory. Load times - this one is a big pain point. Not everyone has broadband (and we won't go into how much I despise ...


4

The deliverable is information about the system. The purpose is to help people make better decisions, based on information about the system.


4

The answer to this question is obvious: it depends. As an example, the customer complained on that the report generation pages takes a lot of time ~ 4 minutes to generate the report. Our developers were not able to fix the performance without rewriting the legacy code from scratch. So they just added “ajax-like” loading indicator. Well… our customers were ...


4

'Also JMeter concurrent threads are not "concurrent users" as real-life people do pauses between actions on web pages. If you don't set any pauses in your tests then 20 concurrent threads will stand for something like 200-250 concurrent users.' Yes, I am in an argument with a client about this fact. They are thinking 50 Threads = 50 Users. But there are no ...


4

Please see the following link: http://jmeter.apache.org/usermanual/test_plan.html#thread_group The 'number of threads' are equivalent to the number of concurrent users that you are looking for. In your scenario above, you have 20 concurrent threads (users) and each thread will run 10 times.


4

It depends on what your test is doing. If it's something long enough - it will be 20, if it's something very short - it'll be 1. JMeter offers several options to control the load. In particular the most commonly used elemends are: Synchronizing Timer - to pause threads unless certain number will be reached and fire them all at the same time. Constant ...


4

Although i do not have much idea about it but i think you can give selenium grid a try. I read on seleniumhq.org that with selenium grid you can create a master slave architecture, where one master machine will control several slaves to send request to a common server. Maybe this can help solve your issue!


4

Consider using A/B testing on your site to determine the impact of response time differences to your customers. If done well, you will determine If performance differences really matter How much they matter Thresholds after which your customers abandon your site


3

NOTE: this answer was to an earlier version of the question which was asking of you needed a 1:1 relationship between vusers, etc. Rather than re-word it I'll let it stand as is since the info inside is still pretty sound. But now you know why it doesn't seem to be directly answering the new version of the question. Generally if you can afford it ...


3

I'm of two minds about this. Don't load them - There are a number of problems I've uncovered with a web application where the DLL's and other such objects were not loaded in memory first. Two concurrent users hitting the app at the same time before all files were "spun up" created some really strange concurrency issues that only happened in that instance. ...


3

As you are using the Microsoft stack I have to recommend the Microsoft Visual Studio tool kit. The load testing tools that come with visual studio will hook into your performance counters on the boxes. The tools include guidance from the asp.net team baked in in the form of key warnings when certain thresholds are reached like an excessive number of garbage ...


3

Oh deja vu ... I think that Larry Elison summed it up nicely when he stated that Cloud computing is just, servers and the internet. Video is here -> http://www.youtube.com/watch?v=UOEFXaWHppE Performance testing "Cloud" applications should be tested as though you would test any existing web application. Specifically for performance you would want to ...


3

If you are interested in web sites, and mostly from a front-end point of view, the best books I have found are: High Performance Web Sites Even Faster Web Sites both by Steve Souders.


3

web test Plugins was my solution I can write some code to iterate or go through a data set quite easily. Example: using System; using System.Collections.Generic; using System.Linq; using System.Text; using Microsoft.VisualStudio.TestTools.WebTesting; namespace SampleRequestPlugins { public class DynamicUsername : WebTestPlugin { static int ...



Only top voted, non community-wiki answers of a minimum length are eligible