What are some ways In which testing a mobile application is different from testing a PC application?

Question

My company is considering offering an application for Android devices and iPhones. What are some of the challenges of testing a mobile application that are different from testing a PC application (or an application that runs in a browser)?

Answer 1

Off the top of my head:

• Memory footprint. Allocations that "rarely" fail on a desktop OS may fail on a mobile platform
• Battery impact - on a desktop app, it's common to have a thread polling, or a background task. On a mobile platform, activities like this can drain battery pretty quickly
• Desktop applications often assume reliable network access. Mobile platforms don't have consistent or reliable network access
• If you're using automation tools (or other tools) to help test your desktop applications, they likely won't work on a mobile OS. You'll need to look for alternate tools or mobile versions if these are critical to your testing.
• Location awareness -- if the app uses GPS or Cell-based location information, you need a mechanism to test related cases -- no location info available; unexpected locations, etc.
• Screen sizes and orientations -- In addition to different screen resolutions (especially on Android) and phone vs. tablet testing, most mobile platforms can dynamically switch from "portrait" to "landscape" mode without warning.

I'm sure there are big areas I'm missing, but the community should take care of that.

Answer 2

Some thing spring to mind:

1. Cellular coverage affects not only your internet connectivity but also loads the CPU
2. Mobile devices CPUs are usually slower
3. Mobile OS's impose a lot of restrictions that doesn't exist in Desktops, for example IOS handling of multi tasking
4. Compatibility is a pain, Android or IOS behaves slightly different on different devices, even screen resolution is different.
5. Battery impact has more sides to it, mobile OS's have tricks to save power so you might find yourself in places you didn't expect. One example are data calls that can go dormant, taking seconds or more to resume.
6. Cellular data introduce large delays and packet losses ratios, for example mobile TCP timers are much larger, making detection of connection loss more difficult.

Answer 3

In many ways, it's more like a PC application than a browser app -- you must test with the expectation that once a user downloads your app, they may never update it, or may not update it as quickly as you'd like. In addition to potentially buggy code in the field, you may also have to test back-end systems against various versions of the app.

Answer 4

In addition to the excellent points already mentioned, data synchronization to a mobile application is a rich source of bugs, and, even worse, of unwise specifications. A bug I’ve seen in many incarnations is that the mobile device can’t handle all of the data in a desktop application, so the programmer limits it in a way that seems reasonable to him, but not to the user, generally without documenting his decision or even letting the test team know.