Are there any differences for mobile web (not native App, not hybrid) testing between emulators/simulators and real devices?

There are different 3rd party sites under test that contain our custom in-house HTML5 player that needs to be verified, along with all the analytics, on a plethora of mobile devices.

For the analytics stuff, especially on iOS devices, the Man-in-the-middle proxy that we're starting beforehand needs a manually accepted and installed SSL certificate. Because of this, very few cloud-browser providers offer Private devices but they come with large costs.

So, we were thinking of building our own test lab. Naturally, the first choice would be to use iOS Simulators and Android Emulators, but we don't know whether we would get false-positives or false-negatives because of this.

Hopefully someone had this dilemma before and can shed some light into this (even if it's not HTML5, any info would be useful).


There will be differences between emulators/simulators and actual devices. Android emulators just emulate the screen size and pixel ratio and run a stock version of Android. Many of the major devices run their own custom version of Android. For instance, any Samsung Galaxy runs it's own version of Android which contains Samsung software to promote people using their browser and software. Other low end devices also use their own versions of Android which is designed to run on low memory.

IOS simulators through the browser are not as reliable as the IOS Simulator through XCODE. The XCODE simulator is more reliable as it is the one which IOS developers use during their development process. That being said, when you run the XCODE IOS simulator on a computer, you choose the processor which you want to emulate. Most of the times, you run using and X64 processor which is optimized to run on a computer. It's not the same processor which an actual iPhone will run.

Since, both implementation and hardware is different, there will definitely be false positives. As well as differences in performance.

Also, you should keep in mind when creating your own device farm, iOS limits the number of simulators which you can run on one apple device. You can generally run one simulator per Apple machine. So to build a device farm legally, you are going to need a bunch of mac computers or iPhones.

|improve this answer|||||

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.