Hot answers tagged

6

If you are running a service or a platform (e.g. operating system), then MTTF and MTBF are very important factors in software and have been used for quite some time to assess reliability usually via some form of stress testing. One of the primary purposes of stress testing is to find the MTTF (mean time time failure) which generally occurs due to memory ...


4

There is a newer plugin for JMeter which is fully RFC 6455 compliant and allows re-using same TCP session for multiple duplex requests. JMeter WebSocket Sampler by Maciej Zaleski - download from Releases page WebSocket Testing With Apache JMeter - how-to guide


3

Your first step is to host the app on as close to a production environment as possible to eliminate "noise" from your load/performance testing. In the case of a test server, you'd want to keep everything else off it, have any database hosted on a separate system if that's your likely production configuration, and then start exploring the application behavior ...


3

I believe that you can start with How to Load Test HTTP Live Media Streaming (HLS) with JMeter guide followed by what dzieciou suggests if there still will be open questions.


3

You may use websocket client library for any popular language (e.g. java or python). For your test scenario it will be more suitable way of testing, rather than try to find some test tools. Also, I'd advise to use 'select' or 'poll' instead of threading, because it scales better, especially if you need more than 10K connections. It took about a couple of ...


2

I agree with sqeemih: The challenge of load testing Ajax calls lies, first in the sending of the requests, and also, and probably mainly, in two other areas : 1) Management of asynchronous requests between the browser and the web server. Ajax calls have two goals: Performing some DOM refresh upon browser decision for a smooth page rendering; and also more ...


2

In the past, I used a .net websocket client library, however .net 4.5 has support for websockets: http://www.codeproject.com/Articles/617611/Using-WebSocket-in-NET-4-5-Part-1 I am sure there are other libraries in java or other languages that also allow you to interact with a WebSocket, but I am less familiar with them. Once you find a library, you can ...


2

What can I see from your code is that at least you generate 600 native JVM thread to simulate 300 connections only which is a small number, I also doubt that the library you are using CUstomWebsocketClientWrapper creates extra threads per each connection which will end up with super inefficient tool to do the job. I tried the recipe here ...


2

Performance Testing of Desktop applications is oxymoron. Desktop application is used by one, at most two persons at a time. So if generating a report takes 5 seconds it will take 5 seconds no matter how many users are pushing the button. It takes 9 month for a woman to born a baby. 3 women won't produce a baby in 3 month. 0.5 woman won't give you a baby in ...


1

It simplifies to knowing what you want to measure and knowing how to determine when you have measured it. Entry criteria include: Knowing what sort of performance you are looking at. Eg maximum load, use of system resources at various loads, affect on response times as load increases, long term stability (eg memory loss), and several others. Stability of ...


1

Ask clarification questions, and lead the other side to give you an answer. It's always a good advice, but especially true for interview questions. Let's use your question as an example- How do you define performance testing ? what is our goal- do we want to verify the product can achieve X or do we want to investigate and find out what X is ? What are ...


1

You found the right plugin, mind the Active word in its name. For instance, on below image there are 101 alive threads as per green rectangle in upper-right corner, but only one active thread is reflected in graph as others are sleeping: You can also run your JMeter test via Taurus tool - the results will be available via fancy web interface, including ...


1

The Throughput: is the number of requests per unit of time (seconds, minutes, hours) that are sent to your server during the test. The Response time: is the elapsed time from the moment when a given request is sent to the server until the moment when the last bit of information has returned to the client. The throughput is the real load processed by your ...


1

I am not so well versed in Jmeter, but I once studied it for few months. Here are some of the good links I can recommend for interpreting Jmeter results. Link 1 - check Andrew Monkhouse's answer. He has explained it very precisely. Link 2 - A good explanation is given here. Link 3 - TechTarget always have some of the best explanations. This is another one ...


1

The number of virtual users (VUs) that one computer can handle depends on the complexity and duration of the individual test cases. Many factors contribute to the complexity, including: number of requests, number of plugins called and what they do, number of extraction and validation rules. As complexity increases so does the usage of memory (RAM) and CPU ...


1

Apache JMeter is designed for load testing and it provides Selenium support via WebDriver Sampler The WebDriver Sampler uses JavaScript language for tests definition so minimal refactoring will be required and your tests should mostly work. See The WebDriver Sampler: Your Top 10 Questions Answered guide for tips and tricks. Alternative options are using ...


1

(You did not say how many simultaneous users you need to simulate for your stress test. My answer assumes you need to simulate more than 5 or 10.) Using your Selenium tests as the basis for stress testing is an attractive idea. After all, they are already written/debugged. You would like to check the same things under load, so they seem relevant. And ...


1

I believe that peak load follows general Pareto principle, at least basing on my experience during "peak" periods application served 80% of requests during 1-2 hours time frame and remaining 20% of requests were more or less equally distributed between remaining 20 hours in a day. So: if you need some explained formulae take a look at Establishing ...


1

The only way you can do this is if you make an educated guess about the distribution of your data. Otherwise you're asking the impossible: Given an aggregated measure of center (the average) return an outlier (the peak). If you want to guess that your data is a normal distribution, then you should be able to derive the top nth percentile and use that as ...


1

This is an indirect answer to your question, because I think you may be asking the wrong question. I am not sure that either of the things you are asking for - a statistical way to determine peak load in 1 second from average load in a day, and vice versa - are necessarily that important when it comes to performance and load testing. It is hard to ...


1

Alright, I feel dumb. Apparently I was wrong about the user and pass working. That was also sending EOF, but that part wasn't failing. I found the answer here to be very helpful. I believe I had the thread sharing set wrong. It seems to be working now.


1

In regards to placement, you need to provide enough iterations to CSV Data Set Config so it could go for 2nd and further lines. So it makes sense to put CSV Data Set Config as a child of a Thread Group or Loop Controller. Regarding id bit. Any change that username and/or password contains comma? If so, you may have to check "Allow quoted data" to work it ...


1

Different platforms could very well have different results. The chipset and drivers could provide differing results.


1

It depends on what the software interacts with. It's entirely possible for specific hardware to cause the software to go down an atypical path that leaks memory.


1

I had faced the same issue. What I was using: ./adb shell monkey -p your.company.name -v 50 --throttle 1000 Correct syntax: ./adb shell monkey -p your.company.name -v --throttle 1000 50 According to the syntax mentioned here, all options should be before the event-count. If you are already using this correctly, the "multiple events in rapid ...


1

Short version Not necessarily. Long version The idea First thing to realize is what open-source means for software: the basic idea is that the source code is available. In more specific terms, someone has decided (for a new project or a running one) to share the code, i.e. every technical detail with the whole world. Furthermore, since there's ...


1

Bishop and Bloomfield have proposed a method of predicting long term reliability growth in software. It is based on an initial assessment of faults. Their work is very easy to understand and follow and later works look at estimating software defects by various methods. A large set of their papers can be found here. Papers that may be helpful, or provide a ...


1

Wikipedia has the best answer for this one. Reliability engineers / design engineers, often utilize Reliability Software to calculate products' MTBF according to various methods/standards (MIL-HDBK-217F, Telcordia SR332, Siemens Norm, FIDES,UTE 80-810 (RDF2000), etc.). However, these "prediction" methods are not intended to reflect fielded MTBF as is ...



Only top voted, non community-wiki answers of a minimum length are eligible