To realistically load test such protocols, you need to either build your own plugin or use existing one.
Indeed proceeding without a plugin will lead to:
Indeed, players have a complex behavior in order to reduce pause times (Lag) during the play.
- They select the playlist depending on the bandwidth
- They initially buffer few seconds before starting to play
- They download data while video is being played
Another problem is that your test won’t be able to limit the bandwidth for some of your users based on their network type.
Time consuming development
Creating an « imperfect simulation » will take you some time and skill as you need to:
- Master Regular Expression Extractor
- Ensure you handle correctly pauses
- Select correctly the playlist depending on bandwidth
- Reproducing live behavior is very complex and requires a lot of scripting
- Reproducing Player behavior and the way it interacts with your servers requires that you code in Java multi-threading as a player downloads while it plays and reloads playlist for Live Streaming
Stream manipulate important volumes of data per users. So whatever you do it won't scale OOTB.
Difficult analysis and reporting
You need specific metrics for Video that JMeter does not provide OOTB:
- Buffer fill
- Lag time
- Play time
- Lag ratio
- Download time
You can read this for more details:
You can use either a JMeter SAAS or your own Cloud server to overcome possible network issues from your injector and use Apache JMeter + this commercial plugin which simulates realistically the Players behaviour for HLS, MPEG-DASH and MS Smooth.
Disclaimer : We are behind the development of this solution