Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Mobile	
  Tes*ng	
  –	
  That’s	
  Just	
  a	
  
Smaller	
  Screen,	
  Right?	
  
Stephen	
  Janaway	
  
Who	
  am	
  I?	
  
Stephen	
  Janaway	
  
•  14	
  years	
  experience	
  in	
  mobile	
  soCware	
  tes*ng.	
  
•  SoCwa...
This	
  Presenta*on	
  
•  Why	
  mobile	
  tes*ng?	
  
•  What	
  is	
  mobile	
  tes*ng?	
  
•  Hints,	
  *ps	
  and	
  ...
So	
  Why	
  Mobile?	
  
©	
  Stephen	
  Janaway	
  2014	
  
So	
  Why	
  Mobile?	
  
The	
  mobile	
  market	
  is	
  huge	
  
It’s	
  Increasingly	
  	
  
Smartphones	
  and	
  Tablets	
  
©	
  Stephen	
  Janaway	
  2014	
  
•  Smart	
  Phones	
  
•  Feature	
  Phones	
  
•  Tablets	
  
•  E-­‐readers	
  
•  Big	
  screens,	
  small	
  screens,	...
And	
  now…	
  
•  Fitness	
  devices.	
  
•  Smart	
  watches.	
  
•  Medical	
  devices.	
  
•  Trackers.	
  
©	
  Steph...
Mobile	
  devices	
  are	
  much	
  more	
  
•  Alarm	
  Clocks	
  
•  Maps	
  
•  Link	
  to	
  loved	
  ones	
  
•  Hand...
My alarm didn’t go off…
I’m lost
MOBILE	
  USERS	
  ARE	
  MORE	
  
EMOTIONALLY	
  ATTACHED	
  
QUALITY	
  IS	
  NOT	
  CURRENTLY	
  
GREAT	
  (BUT	
  DO	
  USERS	
  CARE?)…	
  
MOBILE	
  USERS	
  CAN	
  LEAVE	
  BAD	
  
FEEDBACK	
  MUCH	
  MORE	
  QUICKLY	
  
MOBILE	
  USERS	
  ARE	
  NOT	
  SECOND	
  
CLASS	
  CITIZENS	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
©	
  Stephen	
  Janaway	
  2014	
  
?	
  
Different	
  Sorts	
  of	
  Tes*ng	
  
•  Hardware	
  level	
  
•  Protocol/	
  Air	
  Interface	
  
•  Applica*ons	
  
	
  
Na*ve	
  or	
  Web?	
  
•  Na*ve	
  app:	
  
–  Specifically	
  designed	
  to	
  run	
  on	
  a	
  device.	
  
–  Runs	
  ...
Interac*ons	
  
•  While	
  your	
  applica*on	
  runs,	
  the	
  phone	
  is:	
  
–  Talking	
  to	
  the	
  network	
  
...
Usability	
  Makers	
  
•  Usability	
  is	
  more	
  important	
  in	
  the	
  mobile	
  world:	
  
–  Smaller	
  screen....
Consistency	
  
•  Think	
  about	
  what	
  a	
  mobile	
  user	
  would	
  want.	
  
–  How	
  easy	
  is	
  it	
  to	
 ...
Performance	
  
•  Limited	
  memory.	
  
•  Limited	
  processing	
  capacity.	
  
•  Not	
  turned	
  off	
  very	
  oCen...
Bakery	
  Life	
  
©	
  Stephen	
  Janaway	
  2014	
  
Apps	
  Stores	
  
•  Different	
  stores	
  have	
  different	
  criteria.	
  
•  One	
  es*mate	
  is	
  that	
  70%	
  of...
Security	
  
Sensible	
  Error	
  Messages	
  
Par*cularly	
  when	
  network	
  /	
  data	
  isn’t	
  available	
  
©	
  Stephen	
  Ja...
Don’t	
  Just	
  Test	
  Here…	
  
On	
  Here,	
  and	
  At	
  Here…	
  
Out	
  Here…	
  
In	
  Here…	
  
Different	
  OS’s	
  
Source:	
  hkp://gs.statcounter.com	
  
©	
  Stephen	
  Janaway	
  2014	
  
iOS	
  Adop*on	
  -­‐	
  J	
  
©	
  Stephen	
  Janaway	
  2014	
  
Source:	
  mixpanel.com	
  
Android	
  versions	
  -­‐	
  L	
  
Source:	
  hkp://opensignal.com/reports/fragmenta*on-­‐2013/	
  	
  
Screen	
  Sizes	
  
©	
  Stephen	
  Janaway	
  2014	
  
Where	
  do	
  I	
  get	
  all	
  the	
  devices	
  from?	
  
•  Don’t	
  use	
  them	
  at	
  all	
  –	
  simulators	
  o...
Open	
  Device	
  Labs	
  
•  Borrow	
  devices,	
  normally	
  
for	
  free.	
  
•  hkp://opendevicelab.com	
  	
  
•  Op...
Automa*on	
  
•  The	
  holy	
  grail	
  to	
  solving	
  the	
  fragmenta*on	
  
tes*ng	
  problem?	
  
•  Caveat	
  –	
 ...
Understanding	
  	
  
the	
  User	
  
•  In	
  app	
  analy*cs.	
  
•  Website	
  analy*cs.	
  
•  User	
  persona’s.	
  
...
So……	
  
Mobile	
  Test	
  Strategy	
  –	
  Top	
  5	
  Tips	
  
1.  Understand	
  the	
  poten*al	
  user:	
  
–  Which	
  plasorm...
So…	
  
•  Mobile	
  is	
  huge.	
  
•  Users	
  are	
  more	
  emo*onally	
  akached	
  to	
  their	
  
phones	
  than	
 ...
“Be	
  proud,	
  your	
  work	
  will	
  soon	
  
be	
  in	
  the	
  hands	
  of	
  millions”	
  
Stephen	
  Janaway	
  
	
  
	
  	
  	
  	
  	
  www.stephenjanaway.co.uk	
  	
  
	
  	
  	
  	
  	
  @stephenjanaway	
  
	...
Stephen janaway  mobile testing - that's just a smaller screen, right
Upcoming SlideShare
Loading in …5
×

Stephen janaway mobile testing - that's just a smaller screen, right

1,377 views

Published on

  • D0WNL0AD FULL ▶ ▶ ▶ ▶ http://1lite.top/f7xxR ◀ ◀ ◀ ◀
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Stephen janaway mobile testing - that's just a smaller screen, right

  1. 1. Mobile  Tes*ng  –  That’s  Just  a   Smaller  Screen,  Right?   Stephen  Janaway  
  2. 2. Who  am  I?   Stephen  Janaway   •  14  years  experience  in  mobile  soCware  tes*ng.   •  SoCware  tes*ng  and  test  management.   •  Main  focus  on  the  mobile  device  and  applica*ons  area.     •  Have  worked  for  companies  such  as  Ericsson,  Motorola  and   Nokia.         www.stephenjanaway.co.uk    @stephenjanaway  
  3. 3. This  Presenta*on   •  Why  mobile  tes*ng?   •  What  is  mobile  tes*ng?   •  Hints,  *ps  and  techniques.   •  Why  get  involved?  
  4. 4. So  Why  Mobile?   ©  Stephen  Janaway  2014  
  5. 5. So  Why  Mobile?  
  6. 6. The  mobile  market  is  huge  
  7. 7. It’s  Increasingly     Smartphones  and  Tablets   ©  Stephen  Janaway  2014  
  8. 8. •  Smart  Phones   •  Feature  Phones   •  Tablets   •  E-­‐readers   •  Big  screens,  small  screens,  touch  screens  and   keypads.   Mobile  devices  are  
  9. 9. And  now…   •  Fitness  devices.   •  Smart  watches.   •  Medical  devices.   •  Trackers.   ©  Stephen  Janaway  2014  
  10. 10. Mobile  devices  are  much  more   •  Alarm  Clocks   •  Maps   •  Link  to  loved  ones   •  Hand  held  shops   •  Tickets   •  Music  Players   •  Books   •  Games  Players   •  Cameras   •  ……   •  These  are  key  experiences.  Imagine  if  they  did  not  work?  
  11. 11. My alarm didn’t go off…
  12. 12. I’m lost
  13. 13. MOBILE  USERS  ARE  MORE   EMOTIONALLY  ATTACHED  
  14. 14. QUALITY  IS  NOT  CURRENTLY   GREAT  (BUT  DO  USERS  CARE?)…  
  15. 15. MOBILE  USERS  CAN  LEAVE  BAD   FEEDBACK  MUCH  MORE  QUICKLY  
  16. 16. MOBILE  USERS  ARE  NOT  SECOND   CLASS  CITIZENS  
  17. 17. ©  Stephen  Janaway  2014   ?  
  18. 18. ©  Stephen  Janaway  2014   ?  
  19. 19. ©  Stephen  Janaway  2014   ?  
  20. 20. ©  Stephen  Janaway  2014   ?  
  21. 21. ©  Stephen  Janaway  2014   ?  
  22. 22. ©  Stephen  Janaway  2014   ?  
  23. 23. Different  Sorts  of  Tes*ng   •  Hardware  level   •  Protocol/  Air  Interface   •  Applica*ons    
  24. 24. Na*ve  or  Web?   •  Na*ve  app:   –  Specifically  designed  to  run  on  a  device.   –  Runs  on  device  OS.   –  Tes*ng  needs  to  include  download/  upgrade/  uninstall.   –  Typically  needs  to  be  adapted  for  different  devices.     •  Mobile  website:   –  All  or  some  parts  of  the  soCware  are  downloaded  from  the  Web   each  *me  it  is  run.     –  Usually  accessible  from  all  Web-­‐capable  mobile  devices.   –  HTML5  makes  it  increasingly  difficult  to  separate  web  apps  from   na*ve  apps.   –  Tes*ng  needs  to  include  different  mobile  browsers.  
  25. 25. Interac*ons   •  While  your  applica*on  runs,  the  phone  is:   –  Talking  to  the  network   –  Working  out  where  you  are   –  Maybe  receiving  calls,  texts,  Facebook  and  Twiker   updates.   •  What  happens  when  you  have  your  applica*on   running,  and  then  get  a  call,  and  a  text,  whilst   uploading  video  to  YouTube?  Test  for  it  and  find   out.  
  26. 26. Usability  Makers   •  Usability  is  more  important  in  the  mobile  world:   –  Smaller  screen.   –  More  difficult  to  interact  with  and  typically  used  one   handed.      
  27. 27. Consistency   •  Think  about  what  a  mobile  user  would  want.   –  How  easy  is  it  to  use  the  applica*on?  Do  user  ‘just  get   it’?   –  How  is  the  look  and  feel?   –  Does  the  applica*on  or  device  feel  fast?     •  Takes  advantage  of  mobile  func*onality:   –  Loca*on.   –  Mobile  search.   –  M-­‐commerce.   •  A  design  that  can  be  viewed  on  a  small  screen   and  in  bright  light.   ©  Stephen  Janaway  2014  
  28. 28. Performance   •  Limited  memory.   •  Limited  processing  capacity.   •  Not  turned  off  very  oCen.   •  Think  of  how  the  applica*on  works  when   network  performance  is  poor  or  on  different   speeds  (2G/  3G/  LTE/  Wifi).  
  29. 29. Bakery  Life   ©  Stephen  Janaway  2014  
  30. 30. Apps  Stores   •  Different  stores  have  different  criteria.   •  One  es*mate  is  that  70%  of  applica*ons  are   submiked  to  apps  stores  without  any  formal   tes*ng  have  been  conducted.  
  31. 31. Security  
  32. 32. Sensible  Error  Messages   Par*cularly  when  network  /  data  isn’t  available   ©  Stephen  Janaway  2014   ?  
  33. 33. Don’t  Just  Test  Here…  
  34. 34. On  Here,  and  At  Here…  
  35. 35. Out  Here…  
  36. 36. In  Here…  
  37. 37. Different  OS’s   Source:  hkp://gs.statcounter.com   ©  Stephen  Janaway  2014  
  38. 38. iOS  Adop*on  -­‐  J   ©  Stephen  Janaway  2014   Source:  mixpanel.com  
  39. 39. Android  versions  -­‐  L   Source:  hkp://opensignal.com/reports/fragmenta*on-­‐2013/    
  40. 40. Screen  Sizes   ©  Stephen  Janaway  2014  
  41. 41. Where  do  I  get  all  the  devices  from?   •  Don’t  use  them  at  all  –  simulators  or  user   agents.   •  Buy  them.   •  Rent  them.   •  Borrow  them.   •  Use  a  cloud  based  service  (Perfecto  Mobile,   DeviceAnywhere).  
  42. 42. Open  Device  Labs   •  Borrow  devices,  normally   for  free.   •  hkp://opendevicelab.com     •  Open  Device   Labs  =  shared  community   pools  of  internet   connected  devices  for   tes*ng  purposes.     ©  Stephen  Janaway  2014  
  43. 43. Automa*on   •  The  holy  grail  to  solving  the  fragmenta*on   tes*ng  problem?   •  Caveat  –  mobile  test  automa*on  is  like   desktop  test  automa*on  6  years  ago.   •  You  may  want  to  consider  pushing  for  more   unit  and  integra*on  tests  before  spending   *me  on  mobile  UI  automa*on.   ©  Stephen  Janaway  2014  
  44. 44. Understanding     the  User   •  In  app  analy*cs.   •  Website  analy*cs.   •  User  persona’s.   •  Similar  applica*ons.   ©  Stephen  Janaway  2014  
  45. 45. So……  
  46. 46. Mobile  Test  Strategy  –  Top  5  Tips   1.  Understand  the  poten*al  user:   –  Which  plasorms  and  devices  will  they  use?   –  How  will  they  use  the  app  or  website?   2.  Understand  what  OS  versions  are  being  used  and   when  new  ones  are  coming.   3.  Test  using  simulators  and  real  devices.   4.  Understand  the  cost  of  automa*on:   –  It  is  where  desktop  automa*on  was  6  years  ago.   –  Best  combined  with  extensive  unit  and  integra*on  tes*ng.   5.  Use  an  exploratory  approach  to  manual  tes*ng:   –  Mobile  device  projects  are  typically  short.   ©  Stephen  Janaway  2014  
  47. 47. So…   •  Mobile  is  huge.   •  Users  are  more  emo*onally  akached  to  their   phones  than  they  are  to  their  PCs.   •  Tes*ng  applica*ons  is  the  easiest  route  into   the  industry.   •  A  mobile  test  strategy  should  not  merely  be  a   copy  of  a  desktop  test  strategy.  
  48. 48. “Be  proud,  your  work  will  soon   be  in  the  hands  of  millions”  
  49. 49. Stephen  Janaway              www.stephenjanaway.co.uk              @stephenjanaway     Ques*ons?  

×