Beta testing iPhone apps

16,911
-1

Published on

This presentation gives you some tips on beta testing iphone apps along with some useful resources for beta app distribution (Hockey) and where to find and select testers.

1 Comment
14 Likes
Statistics
Notes
  • Our you could use The Beta Family (http://www.thebetafamily.com), thats my favorite app beta testing service. They have a lot of testers so you get objective feedback, also they ease the process of geting the UDIDs and installing Ad hocs over the air.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
16,911
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
171
Comments
1
Likes
14
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • Apps in the app store have been approved by Apple for general distribution. Apple limits the distribution of non-approved or pre-approved apps by only allowing you to distribute to 100 unique devices. The UDID is a unique to every device and never changes. This is NOT the serial number.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • You can only register 100 devices in a given year. Even if you delete devices, they still count against your 100.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Click Ad Hoc\nEnter a name, usually [App Name - Ad Hoc]\nSelect App ID\nSelect Devices\nSave\n
  • Click Ad Hoc\nEnter a name, usually [App Name - Ad Hoc]\nSelect App ID\nSelect Devices\nSave\n
  • Click Ad Hoc\nEnter a name, usually [App Name - Ad Hoc]\nSelect App ID\nSelect Devices\nSave\n
  • Click Ad Hoc\nEnter a name, usually [App Name - Ad Hoc]\nSelect App ID\nSelect Devices\nSave\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • -Friends and Family are the easiest to target and install the app on.\n-Developers are often busy with their own dev and can only give quick feedback on design and technical issues, they may not see it as your audience will se it so it’s tough to get feedback on “fun” factor or usefulness.\n-Forums and websites are a good resource for end user feedback. Start visiting these sites when you first get your idea (should be part of your market research anyway). Comment on other posts, start building a report before you pitch your idea. These are also the hardest users to get feedback from without coming off as pushy or spammy.\n\n
  • \n
  • \n
  • -Response rates from testers is about 25% on paid testing, much less for non-paid testing\n-Make announcements to users via the email form on their site, do not post messages because end users are not notified there is a new message pending. I’ll show an example soon.\n\n
  • in short, use with caution.\n
  • \n
  • \n
  • Beta testing iPhone apps

    1. 1. Beta Testing Your iOS App Shawn Grimes www.ShawnsBits.com
    2. 2. What We’ll Cover• End User Setup• Provisioning Portal• Building an Ad-Hoc release• Distributing your release • Email - the hard way • Web Share (Hockey) - the “easy” way• Notes About Testers
    3. 3. End User Setup• Need Unique Device IDentifier (UDID) • Get from iTunes • Free App: Ad Hoc Helper - Easy Way• Need Ad Hoc Provisioning Profile
    4. 4. UDID - iTunes• Connect device to computer and launch iTunes• Click on Serial Number in Info Screen• Edit->Copy
    5. 5. UDID - iTunes cont’d
    6. 6. UDID - iTunes cont’dClick
    7. 7. UDID - iTunes cont’dClick
    8. 8. UDID - iTunes cont’dClick
    9. 9. Ad Hoc Helper• http://itunes.apple.com/us/app/ad-hoc- helper/id285691333?mt=8• Tester can email UDID straight from App
    10. 10. Ad Hoc Helper• http://itunes.apple.com/us/app/ad-hoc- helper/id285691333?mt=8• Tester can email UDID straight from App
    11. 11. Add Device to Provisioning Portal• http://developer.apple.com• Provisioning Portal • Devices
    12. 12. Provisioning Portal - Warning!!!
    13. 13. Provisioning Portal - Warning!!!
    14. 14. Provisioning Portal - Add Device
    15. 15. Provisioning Portal - Add Device
    16. 16. Provisioning Portal - Add Device
    17. 17. Provisioning Portal - Add Device
    18. 18. Provisioning Portal - Add Device
    19. 19. Provisioning - New Profile• Provisioning Menu • Distribution • New Profile
    20. 20. Provisioning - New Profile• Provisioning Menu • Distribution • New Profile
    21. 21. Provisioning - New Profile• Provisioning Menu • Distribution • New Profile
    22. 22. Provisioning - New Profile• Provisioning Menu • Distribution • New Profile
    23. 23. Distribution Profile
    24. 24. Distribution Profile
    25. 25. Distribution Profile
    26. 26. Distribution Profile
    27. 27. Distribution Profile
    28. 28. Distribution Profile• Refresh to Download
    29. 29. Distribution Profile• Refresh to Download
    30. 30. Distribution Profile• Refresh to Download
    31. 31. Create Build Package• Drag downloaded Ad Hoc provisioning profile into Xcode• Open project in Xcode• Project->Edit Project Settings• Configurations Tab• Duplicate Release Configuration • Name “Release AdHoc”• Go to “Build” tab • Set Code Signing Identity to AdHoc Prov Profile
    32. 32. Create Build Package
    33. 33. Create Build Package
    34. 34. Create Build Package
    35. 35. Create Build Package
    36. 36. Create Build Package
    37. 37. Create Build Package
    38. 38. Create Build Package
    39. 39. Build Your Ad Hoc Release• Build Settings: • Device • Release AdHoc• Build and Archive
    40. 40. Organizer• Window->Organizer• Archived Applications
    41. 41. Sharing Your App• End user needs two files: • App itself (usually in .app, .ipa, or .zip format) • Ad Hoc Mobile Provisioning Profile that you signed the app with (.mobileprovision)
    42. 42. Sharing Your App - Email• Steps: • Select version you want in Archived Applications • Click Share... • Select AdHoc Distribution Identity• Warning: File size limited to 10MB by most email providers.
    43. 43. Sharing Your App - Email
    44. 44. Sharing Your App - Email
    45. 45. Sharing Your App - Email
    46. 46. Sharing Your App - Email
    47. 47. Ad Hoc Build Demo
    48. 48. Hockey• Install beta apps directly to device via mobile Safari• Based on work by Jeffrey Sambells• Consists of server and [optional] client framework• https://github.com/TheRealKerni/Hockey
    49. 49. Hockey - cont’d• Server Framework • Requires PHP5 server • No database required • Handles multiple apps per server• Client Framework • Optional • Checks for update at launch
    50. 50. Hockey - Client• Copy libraries to your project• Create pre-processor macro: CONFIGURATION_$(CONFIGURATION)
    51. 51. Hockey - Client Code• Create conditional statements in code to keep Hockey client out of App Store builds: • .h: #if !defined (CONFIGURATION_Release) #import "BWHockeyController.h" #endif • .M: #if !defined (CONFIGURATION_Release) [[BWHockeyController sharedHockeyController] setBetaURL:@"http://beta.shawnsbits.com/ index.php"]; #endif
    52. 52. Hockey - Server• Copy public folder to web server in public folder• Copy includes folder to web server in NON-PUBLIC folder (such as parent directory)• Adjust path to includes folder in config.php
    53. 53. Hockey - Create Package1. Build and Archive2. Share->Distribute for Enterprise... 1. URL: __URL__ 2. Title: AppName3. Save As: (NO SPACES IN FILENAME!)
    54. 54. Hockey - Create Package
    55. 55. Hockey - Create Package1. Create new folder in public web folder with app ID: i.e. com.shawnsbits.DoodleDogFight2. Upload .ipa & .plist to this new folder3. Upload .mobileprovision file to new folder4. Upload .png (114x114) - optional5. Upload release notes (notes.html)
    56. 56. Hockey - Web Install
    57. 57. Hockey - In App Update
    58. 58. Hockey - In App Setttings• Integrate provided view controller to your settings panel
    59. 59. Hockey Demo
    60. 60. Hockey - Final Notes• Client does not check if version is greater than installed, only checks if they are different.
    61. 61. ResourcesWhat We’ll Cover• Where to find testers• Communicating with testers• iBetaTest
    62. 62. Where to find testers• Friends and Family • Pros: Easy to find • Cons: Hard to get honest feedback• Other Developers • Pros: Good feedback on technical/design issues • Cons: Busy with their own dev, may not see the game as your end user will see it• Target forums and websites that would include your target demographic • Pros: Most beneficial feedback • Cons: Hard to get feedback
    63. 63. Communicating With TestersNeed to Handle:• Bug submissions• General feedback • Playability, usefulness, audio, interface design, fun factor
    64. 64. Collecting Feedback• Forums• Mailing list• Surveys
    65. 65. iBetaTest.com• Pros: • Easily find people willing to test • Collect bug reports and general feedback • Make announcements to users via Email• Cons: • low response rate, even lower for betas w/out tester compensation • Site is in Beta with not much progress • Waste Ad-Hoc provisions on people who may never provide feedback
    66. 66. iBetaTest.com• Recommendations: • Betas of 10-15 users, try to reuse and rate good testers • $10 iTunes gift card is good compensation, stated that only in exchange for feedback• Results: • 4 good testers with good feedback.
    67. 67. iBetaTest.com Demo
    68. 68. Final Notes• The technical side is the easy part, predictable, reliable, “documented”• The people side is more dynamic and variable • With such small testing capabilities (100 users max/year), your results will vary depending on how well those people represent your end user. Choose wisely.
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×