Provide an introduction to web analytics and how these tools and their data can be applied in the performance realm
Notes from http://answers.performable.com/faqs/website-analytics-advanced/js-api-overview You'll notice a couple of things about the way we set things up. The first is that we check to see if there is already a variable _paq before we create it. This is a good practice so we don't accidentally remove events that were enqueued before our call. The other thing to note is that we add events by calling _paq.push just like you would add items to an array. In this case, we're setting the account we want to track and also calling the trackPageView method. You call methods by specifying the method name and the arguments like so: _paq.push([&quot;method&quot;, &quot;arg1&quot;, &quot;arg2&quot;]); setAccount (accountId) This method sets the account that we'll attribute all tracking events to and should be called before you start tracking events. trackPageView This method tracks this page as viewed by the visitor.
May want multiple subdomains tracked as separate properties or as one property.
Cmg10 Web Analytics Pres Am Long
Technology Exploitation and the Bottom Line An Introduction to Web Analytics for Performance Analysts and Capacity Planners Anna Long Web Analytica SM
Agenda <ul><li>Web Analytics Definition </li></ul><ul><li>Current Web Analytics Technologies </li></ul><ul><li>Web Analytics Applied to Marketing </li></ul><ul><li>Applying Web Analytics to Performance Management and Capacity Planning </li></ul>1 -
Defining Web Analytics <ul><li>The Web Analytics Association (WAA) Definition: </li></ul><ul><ul><li>Web Analytics is the measurement, collection, analysis and reporting of Internet data for the purposes of understanding and optimizing Web usage. [“Web Analytics Definitions” – WAA Standards Committee, 2008] </li></ul></ul>
Current Web Analytics Technologies <ul><li>Major technologies in use today: </li></ul><ul><li>Web server logging ( such as Microsoft IIS logging, Apache Access logging) </li></ul><ul><li>Page tagging (such as Adobe SiteCatalyst, Google Analytics) </li></ul><ul><li>Other technologies in use: </li></ul><ul><li>Network Appliances (such as Pion Systems by Atomic Labs) </li></ul><ul><li>Tag Management Systems (such as Ensighten Manage) </li></ul>
Web Server Logging – How Does it Work? <ul><li>Web Servers such as Apache or Microsoft IIS record activity as requests are made and served. </li></ul><ul><li>Web servers provide general-purpose logging at a very detailed level. </li></ul><ul><li>Data must be cleaned and organized to make it usable for web analytics. </li></ul>
Web Server Logging – A Log Record Example* <ul><li>22.214.171.124 - - [26/Feb/2001:15:34:52 -0600] "GET / HTTP/1.0" 200 8437 "http://xyz.com/crawler?category=dimensional+modeling" "Mozilla/4.5 [en] (Win98; I)" </li></ul>* Example log record from Sweiger2002 IP Address Timestamp Request Status and Bytes Referring Page
Web Server Logging – Making Sense of It All <ul><ul><li>The granularity of recorded activity is frequently non-optimal, either too fine or too coarse. </li></ul></ul><ul><ul><li>IP addresses do not always map to unique visitors. </li></ul></ul><ul><ul><li>Server logs lack visibility into client-side activity. </li></ul></ul>Several characteristics of web server logging limit its usefulness for analyzing website user activity:
Web Page Tagging – Implementation Complexities <ul><li>Several characteristics of web page tagging complicate its successful application for analyzing website user activity: </li></ul><ul><li>Complex architectures (such across multiple subdomains or third-party ecommerce subsystems) can be difficult to tag for accurate data collection </li></ul><ul><li>Proper maintenance of high-volume tagging for a major online property can be overwhelming (especially when considering tagging of webpages and in-bound links) </li></ul>
How Web Analytics is Used in Marketing <ul><ul><li>developing customer profiles </li></ul></ul><ul><ul><li>managing online marketing campaigns </li></ul></ul><ul><ul><li>improving conversion </li></ul></ul>Even though web analytics technologies have drawbacks, they still provide useful results. For example, marketing groups have been very successful using analytics for these activities:
Customer Profiling <ul><li>Segmentation of the customer population </li></ul><ul><li>Persona development </li></ul><ul><li>RFM (Recency/Frequency/Monetary Value) Analysis </li></ul>Web analytics can support the activities of customer profiling, which enable marketing to tailor offerings to particular customer needs.
Measuring Response for Online Marketing Campaigns <ul><li>Each in-bound “call to action” link can be uniquely tagged. </li></ul><ul><li>Search engine advertising programs such as Google AdWords add extensive in-bound link tagging to identify the characteristics of the visit and visitor </li></ul><ul><li>Analytics software collects this data, which the web analyst process and analyzes with the following aims: </li></ul><ul><ul><li>Identify which campaigns are most and least successful </li></ul></ul><ul><ul><li>Determine which aspects of successful campaigns to replicate </li></ul></ul><ul><ul><li>Determine whether to revise less successful campaigns or pull the plug </li></ul></ul>Online marketing makes extensive use of web analytics.
Improving Conversion <ul><li>Conversion is the event where a website visitor becomes a customer. </li></ul><ul><li>The process through which conversion takes place is called a “conversion funnel”. </li></ul><ul><li>The conversion process is viewed as a leaky funnel, meaning some people abandon the process, i.e., they “leak out” at each step along the way. </li></ul><ul><li>Marketers attempt to improve conversion by reducing the leakage. </li></ul>Improving conversion is a major goal of online marketing.
Conversion Funnel Another View Graphic courtesy of WAA colleague Bob Russotti
Web Analytics and Performance Management / Capacity Planning <ul><li>Managing the impact of web analytics on performance and capacity requirements </li></ul><ul><li>Applying web analytics to enrich performance and capacity planning activities </li></ul>As a performance analyst or capacity planner, your involvement with web analytics can fall into two categories:
Bringing Web Analytics In-House – To SAAS or Not to SAAS? <ul><li>Plan for storage if bringing collected data in-house (Google recommendation: minimum of 10 GB for each million pageviews (but plan for much more)) </li></ul><ul><li>Architect/plan for servers and connectivity if bringing collection servers in-house </li></ul>Most major web analytics tools offer a SAAS version, but some organizations choose to keep their web analytics data or the entire collection process in-house. With in-house, there are performance/capacity challenges to address:
Sampling All That Data – Your Judgment Call <ul><li>Instrumenting a subset of the website (not recommended) </li></ul><ul><li>Collecting a subset of tracked events </li></ul><ul><li>Querying a subset during analysis (if must sample this approach is most desireable) </li></ul>To stay within performance, resource, or budget restrictions, some organizations resort to data sampling. Several sampling approaches are commonly applied:
We’re From Web Analytics – We’re Here to Help! <ul><ul><li>Diagnosing problems </li></ul></ul><ul><ul><li>Alerting for anomalies </li></ul></ul><ul><ul><li>Developing benchmark workloads </li></ul></ul><ul><ul><li>Developing forecasts </li></ul></ul>While web analytics can add complexity to performance and capacity management processes, it can also provide insights to enhance performance and capacity planning activities:
Diagnosing Performance Problems <ul><li>When a performance problem cannot be reproduced in a testbed </li></ul><ul><li>When performance monitors do not have the granularity or reach to “see” into a web application </li></ul><ul><li>When a performance problem is caused by a particular mix of configuration/user characteristics not readily isolated by other tools </li></ul>When traditional performance monitoring/testing tools fall short in tackling web-based problems, web analytics data can provide insights not available from other tools. For instance:
Alerting For Anomalies <ul><li>Start by setting up an alert “ladder” in your web analytics tool </li></ul><ul><li>If receiving alerts, you can dig into the web analytics data to learn characteristics of the activity spike: </li></ul><ul><ul><li>Peak referrers </li></ul></ul><ul><ul><li>Peak geographic regions </li></ul></ul><ul><ul><li>Time zone rolling </li></ul></ul>Web analytics tools can be configured to support proactive performance management by alerting for situations that could build into performance problems. For example, managing demand when a video goes viral:
Developing Benchmark Workloads <ul><li>Ecommerce system example: one million purchases per day does not equate to one million visitors per day. </li></ul><ul><li>Web analytics data can reveal conversion funnel patterns of ecommerce to help you produce a more realistic visitor pattern. </li></ul><ul><li>Web analytics data can also identify customer segments so each can be represented with its own unique characteristics. </li></ul>Web analytics data can provide key insights to make simulated workloads a more accurate representation of operational demand.
Developing Forecasts <ul><li>Many of the features that make web analytics so useful for benchmark development also apply for forecasting. </li></ul><ul><li>Caution: need to remember that data from page tagging undercounts the volume of activity. Use it for revealing trends and identifying customer segments. Augment that trend analysis with analysis of web server log data to estimate volumes. </li></ul>The historical perspective gained from web analytics data and tools can help you develop better forecasts of future system demand.
Conclusions <ul><li>Web analytics tools play an important role in the information technology architecture of virtually any organization with a major web presence. </li></ul><ul><li>While web analytics tools traditionally support marketing, they can also be applied much more widely to manage resources. </li></ul><ul><li>Web analytics tools can support the work of performance analysts and capacity planners, enhancing their work products and making their projects more successful. </li></ul>Web Analytics… they’re not just for marketing any more!