TestFairy.com: The Place for Android Crowd Testing
By Geertjan-Oracle on Nov 27, 2013
The idea is that you've developed your Android app and now you have an APK file, either from native Android or from PhoneGap/Cordova. Now you'd like to test that APK file and also monitor what your testers are actually doing with it. So you upload your APK file to TestFairy.com and then tell the world where to get hold of it. One nice thing is that you can distribute a URL to a bar code, which your testers can then install via a bar code scanner on their Android device.
And then you sit back and monitor what they're doing with the app!
Above, you can see the apps I've made available for testing, below you see the testers registered for testing the current app:
And here's a movie of what the current tester actually did with the app:
The above are some of the displays you get on TestFairy.com, including (as the last screenshot shows) a movie that shows exactly what the tester did with the app, including where they touched the screen and the movements of the screen itself during testing.
I think this is a great basis for crowd testing! Everyone in the world could get access to your app, they could try it out, and you'd sit back and monitor what's going on with your app everywhere in the world.
Two approaches are supported. In the first, you don't get the instrumented APK back. In the second, you get the APK back, instrumented, i.e., with all the stuff TestFairy adds to it in order to monitor it. Then you can pass that APK to whoever needs to test it, after you've signed it with whatever stuff you need to add to it prior to testing. But, if you don't need to add your own signatures, then leaving the APK on the TestFairy site during testing is great, especially the bar code approach to distributing the APK is pretty cool.
Would even be better if you could somehow define your own URL. I.e., for my "BeerJudge" app, I'd like to have a URL something like "testfairy.com/apps/beerjudge", which would be easy to tell the rest of the world about. They'd all go there, scan the bar code, and have immediate access to the app and then I could sit back and monitor their activities. It's also useful because it shows which parts of the app are most interesting and which parts the user doesn't care so much about.
Could also be cool to have a menu item on APK files in NetBeans IDE with the display text "Send to TestFairy!" And then the Upload API would be used to pass the APK to TestFairy:
Watch this space for more info on the NetBeans TestFairy plugin!