We were excited to ﬁnd aNZ bank rated number 2through a meta-analysis,but then we found out thatMr. Nuciforo worked on theANZ goMoney app.Thats not exactly objectivein our book!
d Ob serve Who c Usability$ user an ? use it? expe rience InteracGon$ PlaLorms$ design$ Mobile H ow do design ing exist i t? principles? rateusers User$raGngs$ Features$ What can users do? Our framework for identifying the best mobile app.
Usability$ InteracGon$PlaLorms$ design$ User$raGngs$ Features$ Six NZ banks were tested along with the three time Keynote winner Chase bank.
Not bigger = Not better Usability$ InteracGon$ PlaLorms$ design$ User$raGngs$ Features$
ANZ = $7bn revenue. Westpac,BNZ and ASB are roughly the samesize at $4bn-ish. KiwiBank is about$1bn. And TSB is “only” $200millionCompare this with Chase bank,which turns over $100 billion + Deloi/e/Management&Magazine&Top&200&(December&2012)&
Using these three criteria, we created a heatmap showing capability.PlaLorms$ User$raGngs$ Features$
iPhone Y Y Y Y Y Y y yPlatform iPad N Y N N N N y y Android Y Y Y Y Y N y y Windows Y N N N N N y N Open3accounts N N Y N N Y N N No3log9in3balances Y Y Y N N N N N 4/53digit3log9in Y N Y Y Y N N Y View3account3balances Y Y Y Y Y Y Y Y View3transaction3lists Y Y Y Y Y Y Y Y Transfer3between3accounts Y Y Y Y Y Y Y Y Bill3payment Y Y Y N Y Y Y N Set3up3payees393From3Mobile N N N N N Y Y N View3automatic3payments N Y Y N Y Y N Y Change3upcoming3payments N N Y N Y y N N View3term3deposits Y Y Y N Y y N Green = has it N View3mortgages3&3loans Y Y N Y Y Y Y Y Red = does notFunctionality View3KiwiSaver Y N N N N N N N Pay3tax N N N N Y Y N N have it Alerts:3333333333333333333333333333333333333333Text N N N N N Y Y N Push N N N N N Y Y Y Email N N N N N Y Y N Foreign3exchange,3rates3etc. Y N N N Y Y N N Share3trading N N N N N N N y NFC N N N N N y N N Location3based3services Y N Y N N N Y Y Pay3to3mobile Y N N Y N Y N Y Pay3TradeMe3sellers Y N Y N N N N N Pay3to3Facebook3friends Y N N N N N N N Personalise3account N N N N N Y N N Personalised3service N N N N Y N N N Picture3cheque3deposits N N N N N N Y N Loyality3scheme3points Y n N N N N Y N Secure3Messaging Y N N N Y Y N N App3store393latest3version 4.53 3.33 4.55 1.82 4.35 4.45 2.34 2.19Rating App3store393all3versions 3.31 1.87 4.16 1.82 4.35 4.45 3.49 3.00 Google3play 3.94 2.93 4.50 3.93 4.35 4.24 3.92
How many is enough?How many is Features$ too many?
Features come in many different variations.Verve Mobile surveyed 1,200 people andfound ﬁve core features users want:transfers, bill pay, alerts, person toperson payments, and branch/ATM locator.We added a sixth: ﬁnd a past transaction.
Core(Features( Non(Core( Features( Of the six core features we looked for, some had multiple facets. This allowed the banks to score up to nine points in this area.0( 5( 10( 15( 20(
BNZ( Kiwi( ASB( Chase( Google(play( iTunes(All(Versions( TSB( iTunes(Latest( We found ratings to be moreWestPac( indicative of bugs than actual user experience. Bugs were consistently rated 1 star, but ANZ( other comments could be rated polar opposites. 0( 1( 2( 3( 4( 5(
PlaLorms$ Apps occassionally break, so in addition to the core platforms in NZ, we also added the criteria that they should have a responsive designed website.
Usability$ Who: to What Millennials ? test25% of the worldspopulation, We used the sixheaviest users of core features thatmobile banking, users identiﬁed3.4 billion in as most desired.earnings by 2018. Metho d ? here Traditional lab based W testing, counter balanced design, We have labs in single note taker for Auckland and consistency, Wellington, so it participants couldnt made sense to test their own banks test there. app.
Its a sled system that allows theuser have a very natural experiencewith the smartphone during testing.
What(we(found…(100( 20( 90( 18( 80( 16( 70( 14( SUS(score( 60( 12( Total(#(of( 50( 10( Features( Compare ASB to TSB. 40( Its a good example that 8( Usability( the number of features Issues( 30( 6( doesnt impact the overall usability score 20( 4( (SUS). It comes down to having well thought 10( 2( out interaction design. 0( 0( 1( 2( 3( 4( 5( 6( 7(
In general, the banks are doing well. Mostuse SMS for authentication, though BNZsNetGuard tripped us up. The deploymentof custom keyboards like ANZs goMoney,helped minimize "fat ﬁnger" experienceswhen typing in numeric values.
One of the trickiest areas was accountnames. Not all banks carried customaccount names like "checking" or"savings" through to the mobile app.This made transfering of funds betweenaccounts a little more challenging.
SUS(Score( Uber(Usability( Average(Issue( Score(At the end of the usability testing, weasked participants to stack rank the fourapps they just tested. The score of thisstack ranking was then added onto theSUS score to create an Uber Usabilityscore.
The Creating anevaluation evaluation process framework InteracGon$ design$ We could not ﬁnd a great interaction What d design framework, so we created our own. id We looked at the context of mobile usage, we lear n? adherence to platform standards, and efﬁciency of interactions, just to name a few. We then had our experts double check each other for our own internal consistency.
In total we created ten categories withﬁve criteria per category.
An example: On the left Kiwibankprovides no affordance thatanything is happening during thelog in process. Contrast that withANZ, which has the animated spinallowing the user to visually knowsomething is happening.
Usability$ 27.5%$ We realised the raw scored InteracGon$PlaLorms$ didnt tell an accurate story. An 15%$ app with only three core Design$ features should have an excellent usability score. User 15%$ ratings arent consistent between comments, so we decided we should weight things accordingly. User$raGngs$ Features$ 15%$ 27.5%$
ANZ came out on the bottom. This is 56.01$ Usability$ in large part because they had three of the core features, and very low user ratings. InteracGon$PlaLorms$ design$ User$raGngs$ Features$
ASB comes out on top. Their 77.83$ Usability$ combination of core features and excellent interaction design provided them with a great usability score. This combined with good platform coverage and high user ratings made them the overall winner. InteracGon$PlaLorms$ design$ User$raGngs$ Features$
74.86$ Chase bank did well too. Their Usability$ user ratings were low due to bugs, and their usability score was hampered by marketing terminology that made tasks more challenging than needed. InteracGon$PlaLorms$ design$ User$raGngs$ Features$
Even though Chase came insecond overall, we decided thistesting was really about Kiwi banks.Therefore, BNZ takes second andWestPac takes third place.
Lessons$Feature$Bloat$–$Requires$geat$interacGon$design$Hard$to$measure$good$design$Good$user$experiences$may$make$people$switch$Americans$sGll$use$Cheques$Already$out$of$Date$ Several of the banks, have already As we noted, mobile is a storm. released updates to the apps we tested. And$ﬁnally…$
41 ( ( ( ((((65 ( ( ( (((((80( Please remember to keyword your apps! Depending on the study you read, the average Millenial has between 84 and 141 apps installed.