You Can’t Manage What You Can’t Measure:Using Analytics to Improve Web PerformanceCJ Cunniff & Matt Arnold
Over 10 years interactive experience
 JavaScript/XML programming, JQUERY, MOOTOOLS, AJAX and Flash Development
 7 years working in higher education
Role:  How you do it!CJ CunniffDirector, Interactive Media ProductionOver 15 years interactive experience
 Has led interactive strategy
 7 years higher education experience
 Master’s thesis focused on computer augmented group decision-making
Role:  What you should do and why!Matt ArnoldDirector, Interactive Media Strategy
Google AnalyticsQualifiedCJ CunniffDirector, Interactive Media ProductionGoogle AnalyticsQualifiedMatt ArnoldDirector, Interactive Media Strategy
Fundamentals: Analytics DefinedImpress Your Boss VersionUnderstandable Version	Web analytics is the measurement, collection, analysis and reporting of internet data for purposes of understanding and optimizing web usage.WikipediaWeb Analytics is the measurement of what is really happening on your site.
Abandonment: Falling out of the funnel in three frames
Point of ViewWith competing priorities and greater scrutiny on marketing budgets, it is imperative that institutions realize how their web presence is performing. The best way to understand ROI and drive continuous improvement is through the effective use of web analytics.
GoalsBenefitsFundamentals/Overview of AnalyticsHolistic ApproachMaking Things ActionableTips, Tricks & RecommendationsDiscussion / Q&A
Fundamentals: Other DefinitionsHitsA hit occurs any time a single file is transferred and is now a generally useless measure.  A page with 4 images would count as 5 hits in a single page view.Page ViewsA page view occurs any time a single page loads and the analytics JavaScript runs.Unique VisitorA unique visitor will only be counted once for a given period of time.VisitA visit starts when a unique visitor opens a website and ends when they move on to another website. One unique visitor can make many visits to a website.FunnelThe path that you expect (or want) a visitor to take to complete an action.  This could be the form pages needed to complete an application for example.
BenefitsUnderstanding the true state of your integrated marketing campaign Obtaining better customer insightsOverall time savingsMore effective use of marketingdollarsAbility to show Return on Investment for any level of marketing you decide to track Continuous Improvement
	Fundamentals: Tracking Track your funnel. Know all of the metrics at each of the friction points. Assign cost to each stage of the funnel.
	Fundamentals:FocusAvoid paralysis by analysis. Establish key metrics to observe on regular basis and use for optimization.
	Fundamentals:   AutomateUse tools to diagnose opportunities and threats, and save time developing and managing your efforts.
“In God we trust; all others must bring data.” W. Edwards Deming Physicist and quality improvement pioneerSource: Clemson University (http://deming.eng.clemson.edu/pub/den/files/deming.jpg)
PeopleRoles / Responsibilities
 Organizational Development
 Training
 Change Management
 Communication
 CultureToolsTechnology
 Requirements
 ConstraintsProcessWorkflows
 Procedures / TasksThe Hub And Spoke Method: The SpokeThe spokes are the different business units, areas or competences that your organization has.The job of the hub is to supply the spokes with the information theyneed via processes designed to get the most out of the tools..More information on The Hub and Spoke model can be found in “The Cult of Analytics”
The Hub And Spoke Method: The SpokeThe spokes are the different business units, areas or competences that your organization has.The job of the hub is to supply the spokes with the information theyneed via processes designed to get the most out of the tools..More information on The Hub and Spoke model can be found in “The Cult of Analytics”
The Chasms (per Forrester Research)InvestmentStaffingAction
People/Institutions Attending SIM Tech
People/Institutions using analytics
People/Institutions using Google Analytics
People/Institutions spending time with Google Analytics to understand more than number of visits or bounce rate
What to CollectStart with what’s important to the institution?
Making Things Actionable: Determine What Data to Collect:  KPI Prioritization:What type of metrics have the most potentialKeep your focus. Focus on what is important to your site/industry. Focus your limited resources.   Sit down and match up your report to your priorities.
Goals & objectives change the shape of the funnel
EnteringLeavingWhat about sites without E-Commerce?
  Tracking $Index
  Estimating Actionable ValuesGoal
They can get everything they need from the homepage.
This confuses and angers me.  They’ll most likely abandon.They can get everything they need from the homepage.
EnteringLeavingGoal
Value of Matriculated StudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue$2000Matriculate
Value of Matriculated StudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue30% (Apply to Accept)$42070%  (Accept to Matriculate)$1,400$2000Matriculate
Value of Matriculated StudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue1% (Open email)$.00212% (Click through to site)$.215% (Info Request lead to visit)$10.5050% (Campus Visit to Apply)$21030% (Apply to Accept)$42070%  (Accept to Matriculate)$1,400$2000Matriculate
Value of Matriculated StudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue1% (Open email)$.0021What else can drive traffic to these pages?What will that cost?2% (Click through to site)$.215% (Info Request lead to visit)$10.5050% (Campus Visit to Apply)$21030% (Apply to Accept)$420Lifetime Value?Persist
Graduate
Donate
Will70%  (Accept to Matriculate)$1,400$2000Matriculate
	Play NiceWebsite GoalsUser GoalsInstitutional Goals
Making Things Actionable: Collecting Data RadioTelevisionPrintWebAnalytics Collection
Making Things Actionable: Collecting Data Youraddress.edu/radioYouraddress.edu/tvRadioTelevisionPrintWebYouraddress.edu/webYouraddress.edu/printAnalytics Collection
Making Things Actionable: make data consumableCore goals?Extended funnel abandonment?Movement towards or away from business goals?Changes to the funnel?Are we comparing apples to oranges?Annotations are key
Correlation does not equal causation.

Stamats: Analytics Webinar

  • 1.
    You Can’t ManageWhat You Can’t Measure:Using Analytics to Improve Web PerformanceCJ Cunniff & Matt Arnold
  • 2.
    Over 10 yearsinteractive experience
  • 3.
    JavaScript/XML programming,JQUERY, MOOTOOLS, AJAX and Flash Development
  • 4.
    7 yearsworking in higher education
  • 5.
    Role: Howyou do it!CJ CunniffDirector, Interactive Media ProductionOver 15 years interactive experience
  • 6.
    Has ledinteractive strategy
  • 7.
    7 yearshigher education experience
  • 8.
    Master’s thesisfocused on computer augmented group decision-making
  • 9.
    Role: Whatyou should do and why!Matt ArnoldDirector, Interactive Media Strategy
  • 10.
    Google AnalyticsQualifiedCJ CunniffDirector,Interactive Media ProductionGoogle AnalyticsQualifiedMatt ArnoldDirector, Interactive Media Strategy
  • 11.
    Fundamentals: Analytics DefinedImpressYour Boss VersionUnderstandable Version Web analytics is the measurement, collection, analysis and reporting of internet data for purposes of understanding and optimizing web usage.WikipediaWeb Analytics is the measurement of what is really happening on your site.
  • 12.
    Abandonment: Falling outof the funnel in three frames
  • 13.
    Point of ViewWithcompeting priorities and greater scrutiny on marketing budgets, it is imperative that institutions realize how their web presence is performing. The best way to understand ROI and drive continuous improvement is through the effective use of web analytics.
  • 14.
    GoalsBenefitsFundamentals/Overview of AnalyticsHolisticApproachMaking Things ActionableTips, Tricks & RecommendationsDiscussion / Q&A
  • 15.
    Fundamentals: Other DefinitionsHitsAhit occurs any time a single file is transferred and is now a generally useless measure. A page with 4 images would count as 5 hits in a single page view.Page ViewsA page view occurs any time a single page loads and the analytics JavaScript runs.Unique VisitorA unique visitor will only be counted once for a given period of time.VisitA visit starts when a unique visitor opens a website and ends when they move on to another website. One unique visitor can make many visits to a website.FunnelThe path that you expect (or want) a visitor to take to complete an action. This could be the form pages needed to complete an application for example.
  • 16.
    BenefitsUnderstanding the truestate of your integrated marketing campaign Obtaining better customer insightsOverall time savingsMore effective use of marketingdollarsAbility to show Return on Investment for any level of marketing you decide to track Continuous Improvement
  • 18.
    Fundamentals: Tracking Track yourfunnel. Know all of the metrics at each of the friction points. Assign cost to each stage of the funnel.
  • 19.
    Fundamentals:FocusAvoid paralysis byanalysis. Establish key metrics to observe on regular basis and use for optimization.
  • 20.
    Fundamentals: AutomateUse tools to diagnose opportunities and threats, and save time developing and managing your efforts.
  • 21.
    “In God wetrust; all others must bring data.” W. Edwards Deming Physicist and quality improvement pioneerSource: Clemson University (http://deming.eng.clemson.edu/pub/den/files/deming.jpg)
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
    Procedures /TasksThe Hub And Spoke Method: The SpokeThe spokes are the different business units, areas or competences that your organization has.The job of the hub is to supply the spokes with the information theyneed via processes designed to get the most out of the tools..More information on The Hub and Spoke model can be found in “The Cult of Analytics”
  • 33.
    The Hub AndSpoke Method: The SpokeThe spokes are the different business units, areas or competences that your organization has.The job of the hub is to supply the spokes with the information theyneed via processes designed to get the most out of the tools..More information on The Hub and Spoke model can be found in “The Cult of Analytics”
  • 34.
    The Chasms (perForrester Research)InvestmentStaffingAction
  • 35.
  • 36.
  • 37.
  • 38.
    People/Institutions spending timewith Google Analytics to understand more than number of visits or bounce rate
  • 40.
    What to CollectStartwith what’s important to the institution?
  • 41.
    Making Things Actionable:Determine What Data to Collect: KPI Prioritization:What type of metrics have the most potentialKeep your focus. Focus on what is important to your site/industry. Focus your limited resources.   Sit down and match up your report to your priorities.
  • 42.
    Goals & objectiveschange the shape of the funnel
  • 44.
  • 45.
    Tracking$Index
  • 46.
    EstimatingActionable ValuesGoal
  • 48.
    They can geteverything they need from the homepage.
  • 49.
    This confuses andangers me. They’ll most likely abandon.They can get everything they need from the homepage.
  • 50.
  • 51.
    Value of MatriculatedStudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue$2000Matriculate
  • 52.
    Value of MatriculatedStudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue30% (Apply to Accept)$42070% (Accept to Matriculate)$1,400$2000Matriculate
  • 53.
    Value of MatriculatedStudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue1% (Open email)$.00212% (Click through to site)$.215% (Info Request lead to visit)$10.5050% (Campus Visit to Apply)$21030% (Apply to Accept)$42070% (Accept to Matriculate)$1,400$2000Matriculate
  • 54.
    Value of MatriculatedStudentHow to Determine Value of Non-ecommerce Events.Likelihood of ConvertingValue1% (Open email)$.0021What else can drive traffic to these pages?What will that cost?2% (Click through to site)$.215% (Info Request lead to visit)$10.5050% (Campus Visit to Apply)$21030% (Apply to Accept)$420Lifetime Value?Persist
  • 55.
  • 56.
  • 57.
    Will70% (Acceptto Matriculate)$1,400$2000Matriculate
  • 58.
    Play NiceWebsite GoalsUserGoalsInstitutional Goals
  • 59.
    Making Things Actionable:Collecting Data RadioTelevisionPrintWebAnalytics Collection
  • 60.
    Making Things Actionable:Collecting Data Youraddress.edu/radioYouraddress.edu/tvRadioTelevisionPrintWebYouraddress.edu/webYouraddress.edu/printAnalytics Collection
  • 61.
    Making Things Actionable:make data consumableCore goals?Extended funnel abandonment?Movement towards or away from business goals?Changes to the funnel?Are we comparing apples to oranges?Annotations are key
  • 62.
    Correlation does notequal causation.
  • 63.
    Making Things Actionable:Check for Erroneous AssumptionsDrowningShark AttacksBoating AccidentsIce cream is obviously EVILIce cream consumedIce cream consumedIce cream consumed
  • 64.
    Making Things Actionable:Check for Erroneous AssumptionsDrowningShark AttacksBoating AccidentsShark AttacksDrowningBoating AccidentsActual CausalityIce cream consumedIce cream consumedIce cream consumedHigh Temp of the DayHigh Temp of the DayHigh Temp of the Day
  • 65.
    Making Things ActionableInteresting alone is not actionableDetermine what can be improved?Determine the value of various traffic drivers & focus on improving value and conversions.
  • 66.
  • 67.
    Inspire your audienceWenow know what people are tending to do and what we want them to do. We now know the gap between desired state and current state.The next step is to increase engagement with our audience to further enhance our KPI results and improve ROI.Use informative titles in reports
  • 68.
    Rinse and RepeatThework of a good analytics campaign is never complete.Once we have made some changes and have seen some improvement we will need to start the process over.
  • 69.
    Tips / Tricks:ResourcesSitesGoogle’s Web Analytics IQOccam’s Razor – Avinash’s BlogWeb Analytics AssociationBooksWeb Analytics an Hour a DayWeb Analytics 2.0: The Art of Online Accountability and Science of Customer Centricity Cult of AnalyticsActionable Analytics
  • 70.
    Tips/Tricks: PeopleAssigningroles and responsibilitiesOngoing training sessions – give them the skills to analyze and interpret the dataTime ManagementHow oftenAutomationWhen to research
  • 71.
    Tips/Tricks: ProcessDefineproblems & do a GAP analysisSet up $indexing to define and measure the solutionUse “The 3x3 Matrix Approach” to get started
  • 72.
    What Is $Index & How Can It Help?
  • 73.
    The 3 x3 Grid as a Starting Point to making things actionable
  • 74.
  • 75.
  • 76.
    AnnotationsAnnotations will alsoshow up on the graphsThe annotations box is closed by default. Click this button under a graph to open itFor something of particular importanceplace a star.
  • 77.
  • 78.
    A/B Testing WithGoogle Website OptimizerDetermine a lowor a high traffic pageto be tested based on aKPICreate multiple versionsof the pageDefine the goal landingpageTrack for a minimum ofa few hundred hitsImplement the best ranked solution
  • 79.
    Wrap UpHolistic: people,process, and toolsProgress, not perfection – commit to continuous improvement Transform data into information and knowledgeLove results, not channelsKnow what’s producing and what’s worth doingSet up goals and funnels in your analytics programBe data-driven
  • 80.
  • 81.
    The BonusFree 30Minute Consultations Given to The First 15 Registrants at:http://www.stamats.com/analytics(This presentation and links to the resources referenced are also available)

Editor's Notes

  • #3 Discuss why we have two people involvedStrategicProduction/technical
  • #4 cj
  • #5 MattWhere is traffic coming from, is where they’re landing relevant.Client impact – landing page vs. a redirect (such as a 301)
  • #6 Matt
  • #7 CJ to review
  • #8 CJ
  • #9 Matt
  • #10 MattNeed the previous… elements are necessary, but not sufficient
  • #11 Matt – strategy – track your funnel or establish a funnelCJ, rest of slide
  • #12 cj
  • #13 CJImage from: http://www.flickr.com/photos/devosdelphin/3056545837/*** Do we need to expand on how to do this ***
  • #15 matt
  • #16 Matt
  • #17 Matt – holistic approach helps you avoid a tools only view of web analytics.
  • #18 CJ
  • #19 Matt
  • #20 CJ
  • #21 CJ
  • #22 CJ
  • #23 CJ
  • #24 Matt – visualizing the visitor’s path in the funnel. How you are driving/acquiring traffic and what you’re doing with the traffic once it’s in the funnel.Everything at the top is about reach / awareness.It’s about tools in the tool kit.
  • #25 MattWhat are you trying to accomplish? What’s important to the institution or your department – operationalize ways to measure that…then expand.Same diligence and discipline is needed in design. Site design, delivery, improvements can’t happen in a vacuum.
  • #26 Cjhttp://www.flickr.com/photos/redvers/532076662/sizes/o/
  • #27 MattHighly selective or not, could be an example.Experience at Capella with application fees.
  • #28 MattEach stage of the funnel, or part of the visitor path can be seen as a mini-funnel. This may get you to adjust your strategies and tactics for overall better ROI. Sometimes a higher cost per lead or cost per inquiry may yield a lower cost per conversion/matriculation.
  • #29 CJ
  • #30 CJHome page vs landing page or redirects. Don’t skimp because it’s easy for you…don’t make your process the customers problem.
  • #31 CJ
  • #33 CJ
  • #34 CJ
  • #35 Cj –
  • #36 Cjhttp://www.watchingwebsites.com/archives/lean-analytics-questions-vcs-should-ask-and-youd-better-answer
  • #37 Matt
  • #38 matt
  • #39 Matt
  • #40 matt
  • #41 CJ
  • #42 Matt
  • #43 Matt
  • #44 *** Matt ***Talking with client about work they wanted to do, and different spends (radio, tv, etc). They were interested in the ROI of their spend, but wouldn’t change the URL. What was directing traffic? Best you can do is annotate the launch dates.