My team is deciding whether or not to use AWS Device Farm, and I was curious if anyone here has experience with it testing their mobile apps and what they like/ dislike about it?
Software Quality Assurance & Testing Stack Exchange is a question and answer site for software quality control experts, automation engineers, and software testers. It only takes a minute to sign up.Sign up to join this community
I did a Cost-Benefit-Analysis a few years ago (so take it with a grain of salt) and found
AWS Device Farm - Worked really well for Android but didn't screen record iOS runs and the remote control mode was really laggy.
Xamarin Cloud - Worked well but was expensive and instrumenting was a chore. I don't recall a remote control mode.
TestObject - Had everything we were looking for; iOS and Android log and videos, remote control mode, and was relatively inexpensive.
Please keep in mind that your requirements might be different and the products might have evolved since 2017. The main benefit of the cloud devices is saving on costs of furnishing devices to the DEV/QA teams and the ability to try to reproduce issues on more devices. If you only have to support one or two devices it might be more cost-effective to plug those devices into a Mac Mini running Appium Server.