• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
MeasureWorks - StartupBootCamp Amsterdam - Outrun your competition
 

MeasureWorks - StartupBootCamp Amsterdam - Outrun your competition

on

  • 484 views

Nobody likes waiting… Especially (spoiled) online consumers, with all that content and competition just one click away. In this session Jeroen Tjepkema, founder of MeasureWorks, will explain the ...

Nobody likes waiting… Especially (spoiled) online consumers, with all that content and competition just one click away. In this session Jeroen Tjepkema, founder of MeasureWorks, will explain the delicate balance between performance, usability and conversion. Based on real world examples and user panel research, this session will provide actionable insights in what's needed to create an user experiences that exceeds expectations. You'll learn how the mind of your user works, what keeps them clicking, what metrics to collect and how to measure performance and user experience.

Statistics

Views

Total Views
484
Views on SlideShare
483
Embed Views
1

Actions

Likes
1
Downloads
0
Comments
0

1 Embed 1

http://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    MeasureWorks - StartupBootCamp Amsterdam - Outrun your competition MeasureWorks - StartupBootCamp Amsterdam - Outrun your competition Presentation Transcript

    • @jeroentjepkema Founder & CEO
    • Slides: bit.ly/MW-SBCmnfc13
    • Content vs. Experience
    • How we perceive experience....
    • How we perceive experience.... 15%-20% worse than in reality
    • How we perceive experience.... 15%-20% worse than in reality Task completion has positive impact
    • How we perceive experience.... 15%-20% worse than in reality Task completion has positive impact Slow downs have more impact
    • How we perceive experience.... 15%-20% worse than in reality Task completion has positive impact Slow downs have more impact Always compared to past experiences
    • A simple online business model: Marketing Conversion Optimization New visitors Search Tweets Mentions ADs seen Conversion rate Growth Number of visits Loss Bounce rate Revenue Pages per visit Time on site X Order value
    • Consumers visit 18-23 websites before they finally convert Source: TNS/Nipo
    • Performance influence cycle Search/Orientation phase 1 Perception of experience http://twinkle100.measureworks.nl
    • Performance influence cycle Stimulate content/ conversion 4 Search/Orientation phase 5 1 Perception of experience http://twinkle100.measureworks.nl Delivered experience 3 2 Your website
    • Fast = Engagement @jeroentjepkema, MeasureWorks @jeroentjepkema, MeasureWorks
    • 0 Source: Jakob Nielsen
    • 1 0,3 0 Interaction: Let’s conversate... Instantaneous: I like it! Source: Jakob Nielsen
    • 3 1 0,3 0 Mmm, shall I click away? Interaction: Let’s conversate... Instantaneous: I like it! Source: Jakob Nielsen
    • 10 Only if the task/content is relevant 3 1 0,3 0 Mmm, shall I click away? Interaction: Let’s conversate... Instantaneous: I like it! Source: Jakob Nielsen
    • 0:00 sec. Conversation starts
    • 0:00 sec. Conversation starts 2.5 sec. First reply
    • 4.5 sec. Finish conversation 0:00 sec. Conversation starts 2.5 sec. First reply
    • 4.5 sec. Finish conversation 0:00 sec. Conversation starts Comfort zone Tolerated 2.5 sec. First reply Frustrated
    • The holy grail in experience is “flow state”
    • “” Flow is an “optimal experience” that is “intrinsically enjoyable”
    • Provide relevant content to support task completion
    • Deliver it fast, focus on perception
    • http://www.nytimes.com/2012/08/19/opinion/sunday/why-waiting-in-line-is-torture.html?pagewanted=all&_r=0
    • http://answers.yahoo.com/question/index?qid=1005081200005
    • http://amzn.to/1biSi6C
    • That’s not my website?
    • Over 60% of people that experienced a slow website ranked design 2 points lower compared to a fast experience Slow Average Fast % of respondents that rated the actual website speed 100 75 50 25 0 1 2 3 Design score (1=bad - 5=beautiful) 4 5
    • Mobile context?
    • Under time Content pressure Mobile context?
    • Under time Content pressure Mobile context? (often) one Usability handed
    • Under time Content pressure (often) one Usability handed Mobile context? While Speed on the move
    • Under time Content pressure (often) one Usability handed Mobile context? While Performance on the move
    • M-commerce?
    • Experiment 1: Mobile Shopping
    • Mobile shopping experience setup.... 100 mobile users Perform 2 tasks: ‣Buy a book ‣Buy a T-shirt Mobile browsers only via 3G, no WiFi
    • Average experience rating 7 6 5 4 Fix it fast 3 2 1 1 2 3 4 5 Average expectation rating Find a website Search for a book Order a book 6 7
    • #1: Speed
    • Functional issues reported with Zalando 50 37,5 Round 1 25 45 42,1 12,5 15,4 0 Zalando HM 20 7,7 V&D 24 3,9 Tom Tailor 4 Design 1. Buy a T-shirt Speed Mobile Readiness Other 2. Feedback 40 30 Round 2 20 10 12 0 54 34 Zalando Mobile Only research: - Task completion: Only use smartphone to buy a book - N = 100, users range from 20-65 15,4 HM 8 V&D Tom Tailor 21 Design 18 Speed 6 Mobile Readiness Other
    • Nexus - Android - 3G Tested with webpagetest.org (3G traffic shaping, 2000Kbps Down, 1000 Kbps Up, 150ms latency)
    • Nexus - Android - 3G Tested with webpagetest.org (3G traffic shaping, 2000Kbps Down, 1000 Kbps Up, 150ms latency)
    • #2: Usability
    • Bol.com Selexyz De Boekerij ECI Bruna Cosmox Mobile Readiness
    • 100 75 50 46 44 26 24 25 16 0 Bol.com Selexyz Bruna Other 1. Buy a book Mobile Only research: - Task completion: Only use smartphone to buy a book - N = 100, users range from 20-65 Design Speed 16 Mobile Readiness 2. Feedback bol.com 16 Other Design 12 Speed Mobile Readiness Other 3. Feedback from different stores
    • Mobile Readiness
    • - One touch? +
    • Login or not?
    • Mobile Search
    • Experiment 3: Mobile Banking
    • The mobile user experience… 50 users of ING, ABN and Rabobank Rate the user experience Select home insurance
    • There’s an app for that?!
    • Mobile satisfaction compared to desktop 80% 74% 77% Usability Speed 23% Design Content Satisfaction Mobile Banking research: - Focus on task completion - N = 50, users range from 20-65
    • Mobile satisfaction compared to desktop 80% 74% 77% Preference per type of task 77% 72% 38% 34% 23% Design Content Usability Satisfaction Mobile Banking research: - Focus on task completion - N = 50, users range from 20-65 Speed Check Balance Transfer 3d Party payments View history Mobile task preference
    • Mobile satisfaction compared to desktop Mobile versus Desktop frequency Preference per type of task Mobile 80% 74% 77% 77% 72% 38% 34% 23% Design Content Usability Satisfaction Mobile Banking research: - Focus on task completion - N = 50, users range from 20-65 Speed Check Balance Transfer 3d Party payments View history Mobile task preference Daily Weekly 2-weekly Change in behavior Monthly
    • Mobile websites?
    • Desktop Mobile 81% 71% 56% 62% 34% 42% 37% 22% Design Content Usability Speed Design Task satisfaction Desktop vs. Mobile Mobile Banking research: - Focus on task completion - N = 50, users range from 20-65 Content Usability Speed
    • What impacts mobile (shopping) experience?
    • What impacts mobile (shopping) experience? Day to day usage Screen size vs. Content Performance Mobile browsers
    • Outrun your competitors
    • Optimize all your touch points
    • Regular website Mobile Web Deliver the same experience to all your (mobile) users Native Application
    • Mobile first www.lukew.com
    • Deliver content accordingly Prioritize your business goals Mobile first www.lukew.com
    • Design for (mobile) use cases
    • Focus on task completion
    • With mobile conditions in mind
    • Optimized for the right screen
    • Native app Mobile Web - Portrait Mobile Web - Landscape
    • (Touch) Screen
    • 49% One device, One hand http://www.uxmatters.com/mt/archives/2013/02/how-do-users-really-hold-mobiledevices.php?goback=.gmp_72842.gde_72842_member_215909354
    • Golden touch http://www.uxmatters.com/mt/archives/2013/02/how-do-users-really-hold-mobiledevices.php?goback=.gmp_72842.gde_72842_member_215909354
    • Make it (feel) fast!
    • Abandonment"Rate"Across"200+"Sites"/"177+"Million"Page"Views" Over"2"weeks"/"All#Browsers# 30" Abandonment"Rate"(%)" 25" 20" Abandonment*Rate*,* All*Browsers* 15" 10" 5" 0" 0" 1" 2" 3" Source: Gomez real user monitoring 4" 5" 6" 7" 8" 9" Page"Load"Time"Band"(sec.)" 10" 11" 12" 13" 14" 15" It only takes a second...
    • Abandonment"Rate"Across"200+"Sites"/"177+"Million"Page"Views" Abandonment"Rate"Across"200+"Sites"/"177+"Million"Page"Views" Over"2"weeks"/"All#Browsers#vs.#iPhone#Safari# Over"2"weeks"/"All#Browsers# 25" Abandonment"Rate"(%)" 30" 25" Abandonment"Rate"(%)" 30" 20" 20" 15" 15" 10" 10" 5" 5" 0" Abandonment*Rate*,* All*Browsers* Abandonment*Rate*,* All*Browsers* Abandonment*Rate*,* iPhone*Safari* 0" 0" 1" 1" 2" 2" 3" 4" 5" 6" 7" 8" 9" 10" 11" 12" 13" 14" 15" 0" 3" 4" 5" 6" 7" 8" 9" 10" 11" 12" 13" 14" 15" Page"Load"Time"Band"(sec.)" Source: Gomez real user monitoring Page"Load"Time"Band"(sec.)" Source: Gomez real user monitoring ..To click away
    • Performance Analytics
    • A simple online business model: Marketing Conversion Optimization New visitors Search Tweets Mentions ADs seen Conversion rate Growth Number of visits Loss Bounce rate Revenue Pages per visit Time on site X Order value
    • Why did customers drop off? ‣ Price ‣ Functional errors? ‣ Performance issues?
    • Why did customers drop off? ‣ Price ‣ Functional errors? ‣ Performance issues? What’s the business impact? ‣ Lost customers? ‣ Revenue risked? ‣ In Euros?
    • We need context!
    • Complete Web Monitoring
    • Web Analytics Usability Performance (what did they do on the site?) (how did they interact with it?) (could they do what they wanted to?) Complete Web Monitoring VoC Social Media Competition (what were their motivations?) (what were they saying?) (what are they up to?)
    • “Hard” data Web Analytics Usability Performance (what did they do on the site?) (how did they interact with it?) (could they do what they wanted to?) Complete Web Monitoring VoC Social Media Competition (what were their motivations?) (what were they saying?) (what are they up to?) “Soft” data
    • “Hard” data Web Analytics Usability Performance (what did they do on the site?) (how did they interact with it?) (could they do what they wanted to?) Complete Web Monitoring VoC Social Media Competition (what were their motivations?) (what were they saying?) (what are they up to?) “Soft” data
    • #1. Collecting Performance Data
    • (CLOUD) DATA CENTER INTERNAL USERS CUSTOMERS INTERNET Third-party/ Cloud Services Storage Major ISP DB Servers Web Servers Network Mainframe Middleware Servers App Servers Load Balancers This is what you control... Local ISP Content Mobile Delivery Networks Carriers What you’re blamed for..
    • Measuring performance?
    • Measuring performance? Outside-in, from the browser perspective...
    • Performance Measurement Toolkit
    • Benchmark & Optimization
    • Webpagetest.org
    • Object level ! Webpagetest.org ! Optimization tips !
    • Webpagetest.org
    • Ultimately, Real User benchmarking gives you periodic insight in real usage scenario’s...
    • Uptime Monitoring
    • Simulate business transactions
    • Via multiple devices & browsers
    • Used for error detection & Root Cause Analysis
    • Used for error detection & Root Cause Analysis
    • Ultimately, synthetic monitoring shows you if your site’s working or not...
    • Real User Monitoring
    • But, synthetic isn’t enough...
    • Synthetic heartbeat Real Users But, synthetic isn’t enough...
    • 1 2 Insert tag (.js file) into (mobile) web pages tag.js Pages are requested from browser/device 3 As pages execute, tag collects performance metrics tag.js tag.js Browser RUM tag.js 4 After onload tag send detailed report for further analysis
    • Relies on navigation timing API, custom variables can be added Google Analytics
    • Soasta
    • Ultimately, Real User Monitoring shows you how many users are affected by bad performance...
    • Performance surveys
    • Expected Experience vs. Delivered Experience
    • Average experience rating 7 6 5 4 Fix it fast 3 2 1 1 2 3 4 5 Average expectation rating Find a website Search for a book Order a book 6 7
    • Where UX meets Performance: Study on Car Configurators (Audi vs. BMW) http://bit.ly/MW-CC13 password: mob1l32013
    • Ultimately, performance surveys give you periodic insight in task completion issues... (20 people is enough to find 80% of common issues)
    • Summarized:
    • Uptime Monitoring Real User Monitoring Benchmark & Optimize Performance surveys Benefits Benefits Benefits Benefits Heartbeat, runs without traffic Test specific customer journeys Object level detail Collect detailed alerts, including root cause analysis Desktop/Mobile Site Pingdom Watchmouse Alertsite Mobile Apps Gomez Keynote Real usage information from all users!! Trending/Optimization Business impact Testing of user scenario’s with real devices/bandwith Optimization details Competitive scan Desktop/Mobile Site Soasta New Relic Google Analytics Desktop/Mobile Site Webpagetest Browserstack Mobile Apps Gomez New Relic Localytics Google Analytics Mobile Apps Perfecto Mobile Device Anywhere Soasta Performance Measurement toolkit Soft data feedback Abandonment optimization Test before go live Real User Desktop/Mobile Site Wufoo Usabilla Loop11 Crazyegg Mobile Apps Reflector UX recorder Magitest
    • #2. Performance Budget
    • What is your baseline:
    • What is your baseline: A pre-defined set of metrics
    • What is your baseline: A pre-defined set of metrics that describes normal behavior
    • What is your baseline: A pre-defined set of metrics that describes normal behavior in order to detect variancies
    • What is your baseline: A pre-defined set of metrics that describes normal behavior in order to detect variancies and to be comparable within historic context
    • Then define service levels & thresholds...
    • Purchasing a book, must be completed (speed), where every page loads under 4 sec., Customer journey Metric: Speed Target: Sec using IE8 and higher, User scenario from any location in the Netherlands, User locations for 95% of all users, every day between 6am and 12pm, measured with Real User Monitoring. Percentile Window Collection type Source: Metrics 101, Velocityconf 2010
    • #3. Performance Analysis
    • Service levels KPI’s 082 084 Performance (avg) Loadtime. Loadtime Availability (Document. (.fully.loaded.) complete) Competition You 5 ww.homepage.nl 97,0% 2,20 3,50 10% 85% /autoverzekeren 99,0% 2,50 3,30 20% 90% ekeren/afsluiten 95,0% 2,30 3,60 15% 70% 95,0% 2,43 3,57 20% 67% 1 epage.nl/zoeken 94,0% 2,48 3,62 23% 59% Branche 2 epage.nl/contact Competitors 0 productoverzicht 93,0% 2,53 3,67 25% 92,0% 2,58 3,72 28% 44% 3 33 34 35 /ab8test/variant2 91,0% 2,63 3,77 30% 37% /facebookplugins 90,0% 2,68 3,82 33% 29% nl/muziekpagina 89,0% 2,73 3,87 35% 22% homepage.nl/faq 88,0% 2,78 3,92 38% 14% 36 37 38 39 40 Week 52% /ab8test/variant1 4 # 6 3,4 sec Is your ranking against competitors is the average performance of your competitors 40% 40% of your compeitors are faster than you
    • Competitive analysis Your website 20 2 2000 1 1000 10 0 Pagesize (kb) 3 3000 Speed (sec) URL’s 30 URL's 3rd URL's Speed (sec) Page Size (KB) 0 33 34 35 36 37 38 39 40    Week # 33 34 35 36 37 38 39 40 Your site Performance (FV) 3,3 2,4 2,2 2,8 3,3 2,9 3,1 3,2   URL's 67 68 65 69 80 72 69 73   URL's 3rd party 2 2 2 2 5 3 3 3   Page size (KB) 2000 1800 1850 2100 2400 2500 2500 2450 Your branche Performance (FV) 2,3 2,0 2,5 2,8 2,3 2,4 2,2 2,5   URL's 55 59 56 62 59 60 59 61   URL's 3rd party 2 2 2 2 3 3 3 3   Page size (KB) 1900 1800 1850 1900 2050 1900 1890 1900 #30-35 #15-20 #10-15 #15-20 #50-55 #20-25 #30-35 #30-35 Competitive ranking  
    • Performance Variation 9,26 8,98 7,79 7,79 7,23 7,29 7,24 7,24 6,67 4,97 5,4 5,40 4,80 4,61 3,39 3,38 3,08 3,08 2,97 1,89 Sunweb D-reizen Arke Globe Neckermann
    • Performance vs. Sentiment
    • 0! dec;11! nov;11! okt;11! sep;11! aug;11! jul;11! jun;11! mei;11! apr;11! 200.000! mrt;11! feb;11! Jan;11! dec;10! nov;10! okt;10! sep;10! aug;10! jul;10! jun;10! mei10! apr110! mrt;10! feb;10! jan;10! dec;09! nov;09! okt;09! sep;09! aug;09! jul;09! jun;09! Mei;09! Web%traffic%%(Pageviews)! Capacity Management Max.%number%of%pageviews%per%hour%! 1.200.000! 1.000.000! 800.000! Christmas/EOY% 600.000! 400.000! Traffic!Realized! Traffic!Forecast! MAX!capacity! Safety!capacity!
    • Revenue risked Optimale flow 10.000 visitors Speed (s) Availability (%) Bouncerate (%) Conversie Page 1 5,5 100 70 3000 Page 2 13,0 100 75 750 Page 3 2,0 100 60 300 Page 4 3,5 88,5 5 252 10.000 visitors Actual flow Speed (s) Availability (%) Bouncerate (%) Conversie Page 1 8,0 100 75 2500 Page 2 15,5 100 80 500 Page 3 2,0 100 60 200 Page 4 8,0 88,5 5 168
    • If anything else...
    • Build with the end-user in mind
    • Focus on a fast experience …without it, NO time for content
    • Deliver before the lights turn green!
    • Reading material: www.stevesouders.com www.leananalytics.com www.lukew.com
    • Thanks! More questions? M: jtjepkema@measureworks.nl T: @jeroentjepkema W: www.measureworks.nl