Website User Friedliness Q1 Generic Portal Report

1,143 views

Published on

The Website User Friendliness Generic Portal Report studies, interprets, evaluates, measures and reports the ‘user-friendliness’ of a website taking into account both in its look factors as well as its usability factors. The study helps the online players measure, quantify and benchmark the ‘user friendliness’ and ‘usage satisfaction’ of their website vis-à-vis the key competing websites across six generic portals

Published in: Business, Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,143
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
22
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Website User Friedliness Q1 Generic Portal Report

  1. 1. Website User Friendliness Study
  2. 2. Generic Portal Website User Friendliness Study Generic Portal Report Jan-Mar ‘08
  3. 3. Website User Friendliness Study © copyright JuxtConsult
  4. 4. Generic Portal
  5. 5. Website User Friendliness Study Table of content Introduction .............................................................. 1 Methodology.............................................................. 2 Category Websites Tested.............................................. 8 Findings: Website User Friendliness Aggregate Scores - Overall ............ 10 Website User Friendliness Sub Parameter Scores - Overall....... 11 Website User Friendliness Perceptual Map – Overall .............. 13 Average Ratings on the Individual Parameters - Overall.......... 14 Rating Dispersions by Individual Attributes ......................... 15 Relative Importance of the Individual Criteria ..................... 26 Website User Friendliness Aggregate Scores - Website Users Only ............................................................................ 27 Website User Friendliness Sub Parameter Scores - Website Users Only....................................................................... 28 Website User Friendliness Perceptual Map – Website Users Only 30 Average Ratings on the Individual Parameters - Website Users Only....................................................................... 31 Rating Dispersions by Individual Attributes ......................... 32 Relative Importance of the Individual Criteria ..................... 43 Website User Friendliness Aggregate Scores - Website Non Users Only....................................................................... 44 Website User Friendliness Sub Parameter Scores - Website Non Users Only ............................................................... 45 Website User Friendliness Perceptual Map – Website Non Users Only....................................................................... 47 Average Ratings on the Individual Parameters - Website Non Users Only ............................................................... 48 Rating Dispersions by Individual Attributes ......................... 49 Relative Importance of the Individual Criteria ..................... 60 Demographic Profile ................................................... 62 Socio Economic Profile................................................. 66 Economic Profile........................................................ 68 Net Usage Dynamics.................................................... 70 WUF Index Ranking of Websites by User Segments ................ 71 Sample Sizes............................................................. 78
  6. 6. Generic Portal
  7. 7. Website User Friendliness Study Introduction Internet users rarely bother to complain about the poor quality or experience of a website. They just ‘switch’ to an alternative website. Yet most websites do little to track their user’s experience and perceptions about their websites on various critical parameters - be it the appeal of their user interface, ease of navigation and task completion, or the satisfaction derived from the actual usage experience. To precisely fill this gap JuxtConsult has introduced its ‘Website User Friendliness’ syndicated study. The study helps the online players measure, quantify and benchmark the ‘user friendliness’ and ‘usage satisfaction’ of their website vis-à-vis the key competing websites. The study is unique in its methodology as it takes the concept of ‘usability testing’ of a website online – it makes the users use a website and give the feedback on its usage experience in ‘live’ online environment. The user feedback is real time and based on actual usage of the website. In order to define and measure what really makes a website ‘user- friendly’, we looked at a simple and interesting parallel of what makes a person seem ‘friendly’. In human interaction, we identify someone as ‘friendly’ only when that person firstly ‘looks’ friendly to us and then ‘behaves’ friendly towards us. When it comes to our interaction with websites, our expectations and behaviors are no different. We identify or treat a website as ‘friendly’ only when it both looks pleasant and acceptable to us and is easy and convenient to use. That is, A User friendly website Looks friendly + Behaves friendly To ‘look’ friendly, a website must be identifiable, appealing, relevant, and pleasant in its appearance. On the other hand, to ‘behave’ friendly a website must enable the task a user has come to perform on the website in a convenient, smooth, orderly and satisfactory manner. Accordingly, this study interprets, evaluates, measures and reports the ‘user-friendliness’ of a website taking into account both in its look factors as well as its usability factors. 1
  8. 8. Generic Portal Methodology The JuxtConsult ‘Website User Friendliness’ model Any comprehensive measure of ‘user-friendliness’ of a website must cover all key aspects that determine its ‘user-interface’ (looking friendly) as well as its ‘usage experience’ (behaving friendly). At a broad level, we at JuxtConsult defined these key aspects as follows: User Interface (look friendly) Usage Experience (behave friendly) Visually appealing Easy to access Distinctly identifiable Easy to locate relevant information Organized interface Easy to comprehend information Relevant content Easy to navigate and conduct a task Better quality of content Offer relevant and adequate solutions Facilitate satisfactory completion of task Consistent in performance Highly interactive and responsive In order to identify the precise and measurable attributes under each of these aspects, we carefully mapped the typical flow of the ‘interaction’ a user usually has with a website. In doing so we identified 6 typical stages of interaction a user has with a website (and therefore, 6 critical aspects that need to be measured to arrive at any comprehensive evaluation of ‘user-friendliness’ of a website): The user accesses the website (Accessibility) Finds the website appealing (Likeability) Finds the content relevant (Relatability) Is able to smoothly navigate on the website (Navigability) Finds the website responsive when needs assistance/help (Interactivity) Is able to complete the task/purpose for which he/she visited the website in the first place (Task accomplishment) Digging a little deeper in these 6 critical areas we identified 19 individual parameters that required to be measured to make the model a fairly comprehensive one. The parameters related to ‘e-commerce’ and ‘transactions’ were not included in the ‘generic model’ per se (to retain its universality), but have been considered separately as the 2
  9. 9. Website User Friendliness Study ‘seventh’ critical aspect of measuring user friendliness of the ‘e- commerce’ websites. The following graphics outline the precise ‘website user friendliness’ measuring and rating schema used in the JuxtConsult model and in bringing out these reports: © The Model The Website – User The Measures The User Friendliness Criteria Interaction Points Browser compatibility Accessibility Download time Is the website easy to access? Technical Distinctiveness (branding) Layout and interface Aesthetics (color, text, graphics) Likeability Does it look appealing? Identification with the website Design Ease of comprehension Relevance/Adequacy of content Relatability Is the content relevant and distinct? Content distinctiveness (quality) Content Ease of locating task info Ease of conducting the tasks Navigability Is it easy to use? Inter-page consistency in design Task Flow and flow Navigational cues and helps Error rate / error recovery Interactivity Is it able to assist the user when needed? Contacability (and responsiveness) Assistance Sense of security in using the site Level of task completion (success) Task Accomplishment Timeliness of task completion Is the user able to accomplish the task? Solution Adequacy of task compl. (satisfaction) 3
  10. 10. Generic Portal © User Friendliness Measuring Schema 3. Distinctive in identity (branding) 4. Presentation of content (layout) 10. Ease of locating task info 5. Aesthetics (color, text, graphics) 11. Ease of conducting the task 6. User identification with the site 12. Navigation flow between pages 16. Timeliness of task completion 7. Ease of comprehension 13. Navigational cues and helps 17. Quality of usage experience 1. Browser Compatibility 8. Relevance of content 14. Error recovery 18. Perceived sense of security in usage 2. Download Time 9. Relative quality of content 15. Customer responsiveness 19. Brand preference creation Site is likeable and relevant Site is easily accessible Site is easy to use with hassle-free navigation Site delivers task accomplishment Design Appeal Ease of Access Ease of Usage Usage Satisfaction Appeal Index Accessibility Index Navigability Index Satisfaction Index User Friendly Experience User Friendly Interface User Friendly Interface Index (UFEX) User Friendly Experience Index (UZEX) Website User Friendliness Category Level Website User Friendliness Index (WUF) 4
  11. 11. Website User Friendliness Study As shown in the schema, the 19 individual parameters that determine the overall user friendliness of a website have been clustered together into 4 ‘sub index’ measuring the ‘accessibility’, ‘appeal’, ‘navigability’ and ‘usage satisfaction’ index of a website. Hereafter these are combined to arrive at two higher level ‘user interface’ and ‘user experience’ Index and eventually into the overall ‘website user friendliness’ (WUF) index of a website. The model thereby allows various websites in a category/vertical to be evaluated, compared, benchmarked and ranked on various aspects of their ‘user-friendliness’ in an objective manner (based on the index score derived from actual ‘ratings’ of these websites by their existing and potential users). The online survey To test and get the websites rated on these 19 parameters and some other identified aspects of ‘user friendliness’ by their existing and potential users, an online survey methodology based on ‘live’ usage and rating of websites was used. The online survey was conducted using JuxtConsult’s own online user panel (www.getcounted.net) as well as using a ‘survey ad campaign’ on Google Ad Sense (contextual search ads). The online survey was conducted using an e-questionnaire segmented into three sections. The first section had a ‘screener questionnaire’ that was used to identify the ‘users’ of an online category, and of the various websites being tested within that category. Then the identified ‘users’ and ‘non-users’ (taken as potential users) of the various websites were taken to the respective websites for ‘live’ usage. This was done by providing the ‘URL links’ of these websites within the questionnaires. Half the respondents (of both existing and potential users of the website) were asked to surf the ‘homepage’ and the other half to ‘complete a simple assigned task’ on the website1. This split was done to keep the length of the ‘live’ usage sessions within reasonable time limit, so that including the feedback-giving time (questionnaire filling), the whole session does not become too long for the respondent. In this way we tried to minimize the impact of any possible ‘response fatigue’ in the survey to the extent it is possible to do so in such surveys. To ensure a statistically healthy representation and calculation of the ratings (and indices) for each website in the study, a minimum sample quota of 120 ‘reported response’ per website was fixed. This is the sample size on which the user friendliness index calculations are based. 1 The tasks that the respondents of the Generic Portal category were asked to perform were – 1) check your horoscope for today, 2) check the day’s news of your interes, 3) check sprots content of your interest. 5
  12. 12. Generic Portal However, because of a break up of ‘live’ usage between the ‘only homepage surfing’ and ‘only an assigned task completion’, each respondent were to give only ‘part’ rating of the website. This meant that in practice it would take 2 respondents (one of homepage and one of task) to compete one rating of a website as per the JuxtConsult Model. Accordingly, in sample collection, the quota per website was doubled to 240 respondents per website. The eventual break up of the samples as ‘set’ per website and between its existing users and non- users (potential users) was as follows: Table 1: Sample size by websites Sample Base Users Non-users Total Rediff Home page 60 60 120 Task 60 60 120 Yahoo Home page 60 60 120 Task 60 60 120 Indiatimes Home page 60 60 120 Task 60 60 120 Sify Home page 60 60 120 Task 60 60 120 AOL Home page 60 60 120 Task 60 60 120 MSN Home page 60 60 120 Task 60 60 120 Total Category 720 720 1,440 Further to ensure that we report only those responses that are based on actual, and to an extent, sincere ‘live’ usage of the website, firstly the time taken to check/use the website was measured (from the time of clicking the URL link on the questionnaire to the time of answering the first feedback question). Thereafter, we decided to exclude from reporting those respondents who took less than 3 minutes to ‘surf the homepage’ and less than 5 minutes to ‘complete the assigned task’ on the website. For the 19 individual parameters, except for browser compatibility, the ratings for the rest 18 parameters were taken directly from the respondents. For rating on browser compatibility, websites were tested internally at JuxtConsult by its own technical team on various popular internet browsers and then rated accordingly. The browsers on which the website opening was tested were – Internet Explorer, Firefox, Netscape and Opera. For the rest 18 parameters where users’ gave the ratings directly, all ratings were taken on a ‘5 point qualitative scale’. For each parameter, respondents were asked to choose one of the five statements given as ‘options’. The five statements ranged from the most positive statement about that attribute on that website to the most negative statement about that attribute on that website. Of these 18 parameters, only one parameter’s response was taken from the respondents ‘past usage’ of the website (therefore asked only to 6
  13. 13. Website User Friendliness Study the ‘users’). This parameter was customer responsiveness (measured as timeliness and appropriates of response to any query they may have made on the website in the past). On all the other 17 parameters the respondents were asked to give their ratings basis the ‘live’ usage experience and in real time. Eventually, Index numbers were calculated and derived from the individual parameter level rating, with each level index having its own calculated scale (depending on the number of individual parameters included under that index). The sample bases of various websites were equalized while calculating their website user friendliness index to ensure that there are no sample size biases in the reported findings. In the online questionnaires, a response format of ‘clicking’ a single or multiple options among the various given options was used for most questions. Wherever relevant, it was also possible for a respondent to answer ‘none’, ‘not applicable’ or ‘any other’. To enlist complete and sincere responses, an incentive of a significant cash prize was also announced to be given to one randomly selected respondent at the end of the survey. The questionnaire were pre-tested and timed to take approximately 15- 20 minutes for a respondent to complete depending on the speed of comprehension and answering of the questions. The questionnaire was structured and designed to reduce the level of ‘respondent fatigue’ to an extent that was practically possible. Over 1,421 unduplicated and clean responses were collected from the online survey for the 6 websites being tested under the Generic Portal category (in about 3 weeks of time for which the survey was ‘live’ online). After further cleaning of the data for the actual time spent on surfing the homepage/completing the task on the websites 1,325 responses were finally found to be valid and used in creating this report. The valid and usable data was then made representative of the entire online urban Indian population by using appropriate 'demographic multipliers’ using highly authentic Govt. of India population statistics. The weights used were derived from the JuxtConsult’s India Online 2007 study and are based on 3 highly relevant demographic parameters – SEC, town class and region. The end result is that the findings of this report possibly represent the ‘voice’ of over 24 million online urban Indians. Further, the findings represent and effectively cover internet users from all SEC groups, all age groups above 12 years, all income groups and all types of town classes (right down to 20,000 population size level towns)2 . 2 For more details on the demographic and socio-economic profile of the respondents see the ‘Respondent Profile’ section of this report. 7
  14. 14. Generic Portal Category Websites Tested Rediff (www.rediff.com) Yahoo (www.yahoo.com) Indiatimes (www.indiatimes.com) Sify (www.sify.com) AOL (www.aol.in) MSN (www.msn.com) 8
  15. 15. Website User Friendliness Study Findings 9
  16. 16. Generic Portal Website User Friendliness Aggregate Scores - Overall Table 2: Website user friendliness index (WUF) - overall Brands WUF Index Relative Index Rediff 7.0 100% Yahoo 6.9 98% Indiatimes 6.5 93% Sify 6.4 91% AOL 6.2 88% MSN 5.4 76% Base: 1,325 Table 3: Friendly interface index (UFEX) - overall Brands UFEX Index Relative Index Rediff 4.1 100% Yahoo 3.9 97% Indiatimes 3.7 91% Sify 3.7 90% AOL 3.6 88% MSN 3.1 75% Base: 1,325 Table 4: User friendly usage experience index (UZEX) - overall Brands UZEX Index Relative Index Rediff 3.0 100% Yahoo 2.9 99% Indiatimes 2.8 96% Sify 2.7 91% AOL 2.6 88% MSN 2.3 77% Base: 1,325 10
  17. 17. Website User Friendliness Study Website User Friendliness Sub Parameter Scores - Overall Table 5: Accessibility index (overall) Brands Accessibility Index Relative Index Rediff 2.2 100% Yahoo 2.1 96% Indiatimes 2.0 92% Sify 2.0 90% AOL 1.9 88% MSN 1.7 75% Base: 1,325 Table 6: Appeal index (overall) Brands Appeal Index Relative Index Rediff 1.9 100% Yahoo 1.8 97% Sify 1.7 91% AOL 1.7 89% Indiatimes 1.7 89% MSN 1.4 76% Base: 1,325 11
  18. 18. Generic Portal Table 7: Navigability index (overall) Brands Navigability Index Relative Index Yahoo 1.1 100% Rediff 1.0 93% Indiatimes 1.0 92% Sify 0.9 84% AOL 0.9 83% MSN 0.8 72% Base: 1,325 Table 8: Usage satisfaction index (overall) Brands Satisfaction Index Relative Index Rediff 1.9 100% Yahoo 1.8 95% Indiatimes 1.8 94% Sify 1.8 92% AOL 1.7 87% MSN 1.5 77% Base: 1,325 12
  19. 19. Website User Friendliness Study Website User Friendliness Perceptual Map – Overall .2 Design Appeal Yahoo .1 AOL Rediff Ease of Usage 0.0 Sify Ease of Access MSN -.1 Usage Satisfaction Attribute Indiatimes -.2 -.2 -.1 0.0 .1 .2 .3 Brand 13
  20. 20. Generic Portal Average Ratings on the Individual Parameters - Overall Table 9: Summary table - overall Ratings (on a 5 point qualitative scale) AOL Sify Yahoo Indiatimes Rediff MSN Browser Compatibility 5.0 5.0 5.0 5.0 5.0 5.0 Download Time 4.4 4.2 4.3 4.5 4.3 4.0 Accessibility Index 1.9 2.0 2.1 2.0 2.2 1.7 Distinctive in identity (branding) 3.5 3.3 3.2 3.1 3.2 3.3 Presentation layout of the home page 3.5 3.3 3.2 3.1 3.2 3.3 Presentation layout of the task page 4.5 4.4 4.3 4.1 4.4 4.4 Aesthetics of text on the homepage 2.7 2.5 2.7 2.7 2.6 2.7 Aesthetics of graphics on the homepage 4.3 4.2 3.9 3.8 4.2 4.2 User identification with the site 3.8 3.8 3.8 3.8 3.9 3.7 Ease of comprehension 3.9 4.0 4.1 4.2 4.1 3.8 Relevance of content 4.0 4.2 4.3 4.1 4.0 4.2 Relative quality of content 4.1 4.1 4.3 4.0 4.1 4.3 Appeal Index 1.7 1.7 1.8 1.7 1.9 1.4 Ease of locating task info 4.3 4.3 4.3 4.1 4.0 4.5 Ease of conducting the task 4.1 4.1 4.1 4.2 4.0 4.1 Navigation flow between pages 4.2 4.5 4.0 4.2 4.1 4.4 Navigational cues and helps 2.8 2.9 3.0 2.8 2.8 2.9 Error recovery 4.3 4.6 4.0 4.3 4.4 4.4 Appropriateness of response to queries 4.7 4.4 4.6 4.7 4.4 4.7 Timeliness of response to queries 4.3 4.3 4.2 4.4 4.4 4.6 Satisfaction with query resolution 4.4 4.4 4.2 4.4 4.4 4.5 Navigability Index 0.9 0.9 1.1 1.0 1.0 0.8 Timeliness of task completion 4.3 4.0 3.6 4.1 4.0 3.9 Quality of the usage experience 3.9 4.2 4.0 4.1 4.1 4.1 Perceived sense of security during usage 4.1 4.2 4.2 4.3 4.2 4.3 Creation of brand preference 4.3 4.4 4.3 4.4 4.2 4.4 Satisfaction Index 1.7 1.8 1.8 1.8 1.9 1.5 UFEX Index 3.6 3.7 3.9 3.7 4.1 3.1 UZEX Index 2.6 2.7 2.9 2.8 3.0 2.3 WUF Index 6.2 6.4 6.9 6.5 7.0 5.4 Base: 1,325 14
  21. 21. Website User Friendliness Study Rating Dispersions by Individual Attributes Chart 1: Download time (overall) JFM '08 0% 0% 1% 2% 3% 100% 1% 1% 4% 3% 3% 5% 9% Extremely slow 13% 10% 16% 15% 15% 18% 22% 75% Fairly slow 28% 24% 26% 28% 32% Neither fast nor 50% slow 64% Reasonably fast 58% 57% 54% 25% 49% 41% Adequately fast 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 Chart 2: Distinctive in identity (overall) JFM '08 Didn't notice the logo at all'. 100% 5% 7% 9% 10% 13% 15% 4% 7% 6% 7% 6% 8% I had to search for 14% 10% 9% 16% the logo 75% 11% 3% 21% 24% 26% 28% I spotted it but only 28% 31% after a while 50% 62% It was prominent 50% 25% 48% and I spotted it 44% 41% 39% easily It was the first thing 0% that I noticed on the page AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 15
  22. 22. Generic Portal Chart 3: Presentation of the home page (overall) JFM '08 0% Extremely haphazard 0% 0% 1% 2% 2% 100% 2% 2% 1% 1% and badly presented 6% 3% 10% 18% 9% 17% 16% 25% Fairly disorganized and ill presented 75% 34% 44% 39% Just average in 44% 40% organization and presentation 45% 50% Fairly well organized and presented 53% 25% 43% 42% Extremely well 38% 37% organized and neatly 28% presented 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 Chart 4: Presentation of the task page (overall) JFM '08 0% 0% 1% 2% 1% 3% Extremely untidy and 100% 0% 1% 0% 5% 1% 5% 1% 9% cluttered 1% 1 16% 17% 20% Fairly untidy 30% 75% 39% 26% 27% 37% Averagely presented 34% 50% Fairly well presented 62% 57% 55% 55% 25% 48% 42% Very well presented 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 16
  23. 23. Website User Friendliness Study Chart 5: Aesthetics of text (overall) JFM '08 It has too little 100% 7% 0% 2% 2% 5% 8% content and 22% 24% looks empty 31% 19% 33% 75% 38% It has too much text and looks 50% cluttered 76% 74% 73% 69% 62% 54% 25% It has just the right amount of text and looks 0% fine AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 Chart 6: Aesthetics of graphics (overall) JFM '08 100% Neither engage 6% 5% 8% 9% 9% 11% me nor distract 17% me 20% 14% 14% 21% 75% 33% Too many 50% 66% 63% 54% 55% 60% 50% 25% Highly relevant and engaging 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 17
  24. 24. Generic Portal Chart 7: User identification with the site (overall) JFM '08 3% 100% 4% 0% Its just opposite of my 6% 6% 7% style and personality 13% 10% 5% 5% 8% 12% 13% I find it difficult to 24% 24% 20% 75% 18% 25% relate to it I can live with it 38% 26% 29% 28% 50% 33% 39% I can relate to it to some extent 25% 39% 37% 36% 36% 33% 23% It matches my style and personality completely 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 Chart 8: Ease of comprehension (overall) JFM '08 2% 2% 3% 100% 4% 5% 2% Extremely difficult 2% 3% 4% 7% 1% 1 14% 14% 9% 16% 26% 21% 75% Quite difficult 21% 28% 42% 39% 21% 32% Neither easy nor 26% 50% difficult Reasonably easy 25% 47% 45% 42% 40% 38% 38% Extremely easy 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 18
  25. 25. Website User Friendliness Study Chart 9: Relevance of content (overall) JFM '08 Almost 0% 0% 2% 3% 100% 0% 6% 2% 0% 5% 4% irrelevant 1% 16% 15% 9% 22% 14% 17% Low 75% relevance 36% 33% 45% 50% 43% 45% Averagely 50% relevant 25% 50% Fairly 44% 38% 36% 34% relevant 30% 0% Highly relevant AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 Chart 10: Relative quality of content (overall) JFM '08 0% Significantly inferior 0% 1% 2% 2% 3% 100% 1% than the other 2% 5% 2% 6% 5% websites 15% 16% 9% 16% 17% 25% Somewhat inferior than the other 75% websites 37% 33% 43% 37% Same as offered by 36% the other websites 37% 50% Somewhat better than the other websites 25% 48% 47% 42% 40% 40% 32% Significantly better than the other websites 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 676 19
  26. 26. Generic Portal Chart 11: Ease of locating task info (overall) JFM '08 0% Extremely 0% 1% 1% 2% 3% 100% 1% 1% 4% 1% 4% 6% difficult 13% 13% 12% 18% 24% 25% Fairly difficult 75% 24% 29% 17% 30% 23% 25% Neither easy 50% nor difficult 62% 61% 56% 53% Fairly easy 25% 48% 43% 0% Very easy AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 Chart 12: Ease of conducting the task info (overall) JFM '08 0% 0% 1% 1% 2% 100% Faced lots of difficulty 7% 4% 6% 3% 6% 10% 7% 15% 21% 21% 16% 31% Faced some difficulty 17% 75% but was able to complete the task 36% 29% Neither easy nor 30% 15% 24% 32% difficult 50% Fairly easy with only some minor irritants 50% 25% 46% 45% 45% 44% 41% Extremely easy and hassle-free 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 20
  27. 27. Website User Friendliness Study Chart 13: Navigation flow between pages (overall) JFM '08 0% 0% 1% 2% 2% 100% 5% 2% Relevant page did not 7% 2% 5% 8% 6% open at all 14% 8% 7% 22% 1% 1 16% Faced lot of problems 28% 75% 38% 43% 17% 28% 29% Neither freely nor with difficulty 50% More or less freely 63% 54% 53% 25% 47% 43% 43% Completely freely 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 Chart 14: Navigation cues and helps (overall) JFM '08 Had very few relevant 100% instructions 25% 30% 26% 30% 33% 35% Had a fair bit of relevant instructions 75% 16% 17% 12% 3% 15% 1% 1 Almost did not have any relevant 50% instructions 32% 39% Had most of the 42% 53% 47% relevant instructions 50% 25% 13% Had all the relevant 7% instructions 4% 7% 12% 6% 12% 1% 1 6% 4% 3% 2% 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 21
  28. 28. Generic Portal Chart 15: Error recovery (overall) JFM '08 1% 1% 1% 3% 100% 4% Couldn't resolve and 2% 1% 2% 4% 5% 9% failed to complete the 8% 12% 7% task 13% 7% 9% 14% 7% Resolved with great 75% difficulty 26% 27% 35% 20% 30% Encountered but resolved with website 50% help instructions Encountered error but 72% resolved on my own 61% 60% 59% 54% 25% 47% Did not encounter any error at all 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 Chart 16: Appropriateness of the response (overall) JFM '08 0% 0% 0% 1% 4% 100% 0% 0% There was no 1% 2% 0% 2% 10% 1% 1% 4% response at all 1% 12% 3% 24% 26% 24% 27% 1% 1 Received only auto- 75% reply, nothing 20% thereafter They responded but did not resolve the 50% query 76% Query was resolved 74% 73% 72% 69% only partially 63% 25% Query was resolved completely 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 268 22
  29. 29. Website User Friendliness Study Chart 17: Timeliness of response (overall) JFM '08 0% 0% 0% 1% 1% 100% 4% 0% 0% 0% 7% Did not receive any 0% 9% 5% response at all 5% 13% 20% 24% 1% 27% Fairly late 75% 23% 14% 45% 19% 33% Neither promptly nor 50% late 68% More or less in time 65% 64% 57% 25% 50% 46% Very promptly 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 268 Chart 18: Satisfaction with response (overall) JFM '08 0% 0% 0% 1% 1% 3% 100% 0% 0% 1% Highly dissatisfied 5% 0% 5% 7% 5% 8% 4% 1% 6% Moderately 40% 75% 39% dissatisfied 39% 41% 49% 44% Neither satisfied not dissatisfied 50% Moderately satisfied 56% 54% 53% 52% 25% 46% 42% Highly satisfied 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 268 23
  30. 30. Generic Portal Chart 19: Timeliness of task completion (overall) JFM '08 2% 2% 2% 1% 100% 7% 3% Took significantly 4% longer than expected 10% 10% 14% 14% 18% 20% 15% Took somewhat more 21% 18% 75% time than expected 19% 16% 17% 17% Completed in as much 18% 20% time as expected 20% 50% 13% Completed marginally faster than expected 61% 56% 25% 49% 47% 43% 43% Completed a lot faster than expected 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 Chart 20: Quality of usage experience (overall) JFM '08 0% 1% 2% 1% 2% 3% 100% 1% Downright painful 1% 6% 6% 9% 7% 6% 20% 12% 24% 21% 24% Fairly troublesome 75% and irritating 41% 38% 37% 35% Just about agreeable 38% 50% 32% Fairly pleasant and satisfactory 25% 45% 42% 40% 39% 36% 33% Extremely pleasant and delightful 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 651 24
  31. 31. Website User Friendliness Study Chart 21: Perceived sense of security in usage (overall) JFM '08 1% 1% 2% 1% 1% 1% 100% 1% 1% 2% 3% 3% 4% Completely insecure 10% 16% 14% 16% 22% 21% Fairly insecure 75% 39% 36% 38% 31% 45% Not sure if I can trust 37% the website 50% Fairly secure 25% 47% 46% 45% 42% 38% 37% Absolutely secure 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 1,325 Chart 22: Brand preference creation (overall) JFM '08 0% 1% 2% 2% 100% 3% 4% Very unlikely to visit it 2% 2% 2% 2% 3% 5% 8% 1% 1 12% 12% 10% 14% Fairly unlikely to visit it 75% 29% 26% 27% 24% 34% 26% Not sure, may or may not visit it 50% Somewhat likely to visit it 60% 59% 58% 57% 54% 53% 25% Very likely to visit it 0% AOL Sify Yahoo Indiatimes Rediff MSN Base: 1,325 25
  32. 32. Generic Portal Relative Importance of the Individual Criteria Table 10: Importance ranking of the key individual criteria (overall) Brands AOL Sify Yahoo Indiatimes Rediff MSN Overall Fastest to download 80% 70% 90% 62% 76% 79% 76% Simplest and most easy to understand 50% 39% 49% 54% 55% 41% 48% language Most responsive and prompt in customer 19% 27% 24% 38% 22% 26% 26% service and support Brand image in the market place 20% 35% 21% 30% 18% 21% 24% Provide the best help 28% 19% 20% 24% 24% 25% 23% Most neat looking design (aesthetics) 20% 29% 20% 13% 20% 24% 21% Best assures safety against frauds & 25% 20% 20% 16% 16% 18% 19% misuse of personal details & financial info Gives best assurance on privacy of info 15% 15% 22% 21% 21% 17% 19% provided Matches my personality and style the best 18% 15% 15% 10% 27% 19% 17% Most logical structure and flow of info. / 8% 21% 6% 8% 12% 20% 12% content Helps accomplish the task in least no. of 12% 9% 9% 17% 5% 8% 10% clicks Most consistent design, look & feel across 4% 1% 5% 7% 5% 3% 4% the page Base: 1,320 26
  33. 33. Website User Friendliness Study Website User Friendliness Aggregate Scores - Website Users Only Table 11: User friendliness index (WUF) - website users only Brands WUF Index Relative Index Yahoo 3.7 100% Rediff 3.7 98% AOL 3.6 95% Indiatimes 3.2 86% Sify 3.2 86% MSN 2.9 78% Base: 707 Table 12: Friendly interface index (UFEX) - website users only Brands UFEX Index Relative Index Rediff 2.1 100% Yahoo 2.1 98% AOL 2.1 96% Sify 1.8 86% Indiatimes 1.8 85% MSN 1.6 77% Base: 707 Table 13: User friendly usage experience index (UZEX) - website users only Brands UZEX Index Relative Index Yahoo 1.6 100% Rediff 1.5 94% AOL 1.5 91% Indiatimes 1.4 86% Sify 1.4 83% MSN 1.3 77% Base: 707 27
  34. 34. Generic Portal Website User Friendliness Sub Parameter Scores - Website Users Only Table 14: Accessibility index (website users only) Brands Accessibility Index Relative Index Rediff 1.2 100% Yahoo 1.1 99% AOL 1.1 95% Indiatimes 1.0 87% Sify 1.0 85% MSN 0.9 77% Base: 707 Table 15: Appeal index (website users only) Brands Appeal Index Relative Index Rediff 1.0 100% Yahoo 1.0 98% AOL 1.0 98% Sify 0.8 87% Indiatimes 0.8 84% MSN 0.8 77% Base: 707 28

×