Hot answers tagged load-testing
7
I have had some luck using Grinder. It is Java based but you can also write your scripts in Jython or Clojure.
You said that you would like to take advantage of your team's current Selenium scripts and expertise performance testing. You did not describe your regression test scripts, but you may want to reconsider whether they are appropriate. In ...
6
All right, So Tristann kindly revised his original question to include more details in terms of a scenario. So I'm adding a second answer to more directly address it.
Firstly you'd probably want to ask a few more questions about what the customer is most concerned with and what they want tested, here's a small sample:
what's the duration of the shoppers
...
5
Similar questions have been asked a number of times. The general consensus is that UI automation tools such as Selenium are not a good choice for load testing. There are a number of reasons why, but the main one is that it is a LOT slower. You can easily spin up thousands of concurrent requests in a second in a tool like JMEter which to reproduce in ...
5
There are a lot of performance testing tools:
Apache Bench
The Grinder
Siege
Pylot
Setup for the most part is very easy. You could run each of these packages on a local VM; however, if you want to simluate large loads of traffic you need to have a machine with a little more RAM and Processor.
Since this is an AJAX application you might have to simulate ...
5
This is a pretty interesting problem, actually :)
You could try using a Markov Chain Monte Carlo approach. I haven't worked with these types of models myself, but the idea is that you start with a given long-run distribution and use Monte Carlo modelling to develop the actual Markov chain. I know this is a pretty well-used technique for simulation ...
5
From my Experience I would Say Yes to VSTS Test Edition
I used VSTS Continiously ran load tests for 4 Hours, Simulated Maximum of 60 requests / sec with 4 Test machines, OLTP Application
Web Service / Biztalk / SQL Server / Replication / Service Broker based architecture
VSTS Tests - Easily bind data to tests. This is pretty straight forward ( ...
4
Does your company have a firewall proxy?
I've run into this same issue with non-Vaddin apps, and resolved the issue by launching Jmeter with proxy info. From the command line, it looks like this:
jmeter.bat -H proxyDomain -P proxyPort -u proxyUsername -a proxyPassword
4
I wrote about concurrent users and numbers in a blog post: http://blog.xceptance.de/2011/06/07/get-the-right-load-mix-out-of-a-few-numbers/
Wait… where are my concurrent users?
This is simple: “concurrent users” is
an inaccurate way of describing
traffic, so we have not used that
number yet. Why is that?
To get to the bottom of that, we
...
4
You should not focus on the concurrency rate, rather try to get traffic statistics, such as visits, amount of activity, and so on. If you already have a site running, you can analyze the server logs or any audit trails your application might write. When your site is still offline and you just want to go live, you have to come up with some expectations for ...
4
Based on the answer and comments I had received what I wound up doing was:
Use a Once Only Controller with a BeanShell Sampler to read the file into an array, then when I need to pull that data I just use a BeanShell PreProccessor with:
import java.util.Random;
Random random = new Random();
vars.put("MyChosenVariable", vars.get("AvailChoices_" + ...
4
I have no doubt that the IBM Rational tools could allow you to automate functional and performance testing. However, there are many free and open source tools that also provide the same (or often better) functionality. From my own experience working with proprietary test tools such as Rational (my experience was with Rational years ago, Silk and a bit of ...
3
Randomizing the file BEFORE use is a much better approach.
It will much more efficiently (especially in the case of significant amount of entries) to randomize the order of entries in your CSV file before the test - and then read prepared data sequentially, in way you like (via CSV Data Set e.g.).
You can do the preparation using e.g. perl script or even ...
3
NOTE: this answer was to an earlier version of the question which was asking of you needed a 1:1 relationship between vusers, etc. Rather than re-word it I'll let it stand as is since the info inside is still pretty sound. But now you know why it doesn't seem to be directly answering the new version of the question.
Generally if you can afford it ...
3
I have worked in VSTT and did performance testing for OLTP application. VSTT has good information and articles on web testing, load testing
Visual Studio Performance Testing Quick Reference Guide (Version 2.0) Published
Performance Testing Videos Posted to CodePlex
3
As you are using the Microsoft stack I have to recommend the Microsoft Visual Studio tool kit. The load testing tools that come with visual studio will hook into your performance counters on the boxes. The tools include guidance from the asp.net team baked in in the form of key warnings when certain thresholds are reached like an excessive number of garbage ...
3
you could use a plugin, although there is a simpler way. You can create a CSV file with the list of usernames and passwords you want to iterate through and then create a datasource. When you execute the web test, it will iterate through all of the items in the CSV file, one line for each test execution.
Based on what you outlined above I would probably ...
3
Silverlight is NOT a thin client, it allows for heavy client-side processing and so the request is quite valid.
Silverlight is a dialect / subset of WPF, the technology that replaces Windows Forms, another fat-client :)
Here are a few ideas on how to go about this "perf testing" (it's not really load testing because a client can only be accessed by 1 ...
3
AirieFenix, welcome to SQA. Here are some possible problems:
Your JMeter machine ran out of resources.
Your server is overwhelmed.
An intermediary (e.g. a proxy server or a load balancer on a DMZ machine) between your JMeter machine and the server is overwhelmed or is intentionally throttling network traffic.
Here are some ways to narrow things down:
...
2
JMeter is the open source performance testing tool that might be useful in this situation. There will most certainly be some ramp-up time to learn how to use the tool as well as some time required for general performance testing education (best practices, etc).
2
If you have an average visit length of 5 minutes, a single user could create 60 min / 5 min = 12 visits per hour. To get to the target number of 1000 visits/visitors per hour, you need 1000 visits / 12 visits per user = 84 concurrent user.
In total you will have 1000 visits and 3000 page views.
Just as a side note: 5 min visit length and only 3 page views ...
2
web test Plugins was my solution I can write some code to iterate or go through a data set quite easily. Example:
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using Microsoft.VisualStudio.TestTools.WebTesting;
namespace SampleRequestPlugins
{
public class DynamicUsername : WebTestPlugin
{
static int ...
2
The person who has placed you in this role has an obligation to help you be successful. The path to success in performance testing begins wih a confirmation and firming up of any foundation skills that are soft. Next comes product training. After that a period of internship.
Tools are only 5-12% of the skills you need to have. Mind you it is a critical ...
2
jmeter
I know it sounds like I'm beating a dead horse here, but this is the most commonly used open source tool. There is documentation all over the internet about using and setting it up. Additionally, if your company is a java shop, there are probably many developers who could help your team get started.
2
I ll suggest Jmeter for Performance...
As the name indicates Jmeter is one of the Java tools which is used to load testing client/server applications. Earlier it was used for testing Web Applications only however now-a-days its being used for other test functions. It is typically used to measure performance and to load test functional behavior of ...
1
This option is only available in the PRO version of SOAP UI. The license costs around 300 dollars a year. You can have the data in an excel sheet and map the columns in the request; Loop it so that the test runs until all the rows in excel sheet are read and executed. You can export the response to a CSV or excel sheet.
You might also find this useful: ...
1
I find that using a combination of both gives you the most realistic results. As the posters have already mentioned Selenium requires a large number of servers to get a similar load to tools such as jmeter.
However if you incorporate the browsermob proxy into your selenium tests ...
1
(disclaimer: I'm the Gatling project lead dev)
It currently seems unefficient to use Webdriver for load tests, even with a huge grid.
If you want to reduce the cost of maintaining functional tests AND load tests, you can build a system where you obtain your load tests base from your functional tests:
plug a recording system on your functional tests, such ...
1
You could also check out Gatling, which is an open source stress tool based on akka.
On the Gatling homepage, you'll find a direct comparison of how your test specification will look in Gatling vs. in JMeter. This might help you decide between these too.
If you want to create massive amounts of load, I think there's nothing better than akka as an engine.
...
1
If you have very simple tests to run, take a look at our free version - Load Tester LITE. It is currently limited to pretty simple tests, but is free if you supply the load-generating hardware and allows unlimited VUs.
1
1) You have to extract viewState value BEFORE the usage.
I.e. if you send viewState value along with login-request so you have to extract this value from response to PREVIOUS request.
Thread Group
HTTP Request 01 : /login GET
XPath Extractor : extract jsfViewState
HTTP Request 02 : /login POST (send previously extracted jsfViewState as ...
Only top voted, non community-wiki answers of a minimum length are eligible
