Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
THE WHAT, WHY &
HOW OF (WEB)
ANALYTICS TESTING
Anand Bagmar
Software Quality Evangelist
@BagmarAnand
about.me/anand.bagmar
ABOUT ME
What do you expect
from this session?
Why do we do
Testing?
HOW DO WE VALIDATE?
What are Heuristics?
Web Analytics
WHAT IS WEB ANALYTICS?
WHY DO WE NEED WEB ANALYTICS?
WEB ANALYTICS SOLUTIONS
Google Analytics
SiteCatalyst
AWStats
WebTrends
….
Testing Web Analytics
LEARN & OPTIMIZE
TESTING AT THE REPORT LEVEL
Pros
¨ Ensure report is setup correctly
Cons
¨ Licensing
¨ Reports not yet setup
¨ Validate al...
Biggest Problem
It is TOO LATE!
The Solution
Web Analytics Testing
Challenges
MANUAL
REPEATING OVER-AND-OVER AGAIN
WAAT - Web Analytics
Automation Testing
WHAT DOES WAAT DO FOR ME?
q Plugs into existing test framework
q With minimal changes
q Web Analytic tool independent
q UI...
FLAVORS
ARCHITECTURE
WAAT-JAVA
q Original flavor
q Supports 3 plugins
q Omniture Debugger
q HttpSniffer
q JsSniffer
q Available on github
WAAT-RUBY
q Ruby gem implemented over WAAT-Java
q Uses RJB – Ruby-Java-Bridge
q Supports 2 plugins
q HttpSniffer
q JsSniffer...
OMNITURE DEBUGGER
OMNITURE DEBUGGER
Pros
q OS independent
q Run using the regular test-user
Cons
q Browser dependent – need to implement Scr...
HTTPSNIFFER
Pros
q Web-analytic solution independent
q Browser independent
q UI-driver independent
Cons
q 3
rd
party libra...
JSSNIFFER
Pros
q  Web-analytic solution independent
q  Browser independent
q  HTTPs supported out-of-the-box
q  No depende...
Is that all to
Web Analytics?
The new “kids” in town
IoT & Big Data
Some popular use cases
IOT – INTERNET OF THINGS
Opportunity to
¨ Create new value propositions
¨ Be Innovative
¨ Be Creative
IOT – HOW TO DELIVER VALUE?
¨ Automate the manual processes
¨ Integrate data capabilities
¨ Collect – integrate from vario...
IOT – CHALLENGES
¨ Federated devices
¨ Different types of networks
¨ Different communication channels
¨ Physical (hardware) ...
IOT – BIGGER CHALLENGES
¨ Too many devices
¨ Lots of data
BIG DATA …. IS GETTING BIGGER
¨ Volumes of data generated
¨  A jet engine generates 1TB of data per flight.
¨  A large refin...
IoT is about Data!
TO GET VALUE FROM IOT …
¨ Collect
¨ Analyze
¨ Predict
¨ Plan
What does this mean
for Testing?
TESTING OPPORTUNITIES
We need to build capabilities to validate –
¨ Data collection is working well
¨ From all sources
¨ A...
RESOURCES
¨ https://github.com/anandbagmar/waat
¨ https://github.com/anandbagmar/waat-ruby
¨ http://essenceoftesting.blogs...
@BagmarAnand
about.me/anand.bagmar
THANK YOU
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
The what why and how of web analytics testing
Upcoming SlideShare
Loading in …5
×

The what why and how of web analytics testing

190 views

Published on

vodQA 2016

Published in: Technology
  • Be the first to comment

  • Be the first to like this

The what why and how of web analytics testing

  1. 1. THE WHAT, WHY & HOW OF (WEB) ANALYTICS TESTING Anand Bagmar Software Quality Evangelist
  2. 2. @BagmarAnand about.me/anand.bagmar ABOUT ME
  3. 3. What do you expect from this session?
  4. 4. Why do we do Testing?
  5. 5. HOW DO WE VALIDATE?
  6. 6. What are Heuristics?
  7. 7. Web Analytics
  8. 8. WHAT IS WEB ANALYTICS?
  9. 9. WHY DO WE NEED WEB ANALYTICS?
  10. 10. WEB ANALYTICS SOLUTIONS Google Analytics SiteCatalyst AWStats WebTrends ….
  11. 11. Testing Web Analytics
  12. 12. LEARN & OPTIMIZE
  13. 13. TESTING AT THE REPORT LEVEL Pros ¨ Ensure report is setup correctly Cons ¨ Licensing ¨ Reports not yet setup ¨ Validate all requests are sent / captured
  14. 14. Biggest Problem It is TOO LATE!
  15. 15. The Solution
  16. 16. Web Analytics Testing Challenges
  17. 17. MANUAL
  18. 18. REPEATING OVER-AND-OVER AGAIN
  19. 19. WAAT - Web Analytics Automation Testing
  20. 20. WHAT DOES WAAT DO FOR ME? q Plugs into existing test framework q With minimal changes q Web Analytic tool independent q UI Driver framework independent q Browser independent
  21. 21. FLAVORS
  22. 22. ARCHITECTURE
  23. 23. WAAT-JAVA q Original flavor q Supports 3 plugins q Omniture Debugger q HttpSniffer q JsSniffer q Available on github
  24. 24. WAAT-RUBY q Ruby gem implemented over WAAT-Java q Uses RJB – Ruby-Java-Bridge q Supports 2 plugins q HttpSniffer q JsSniffer q Available on github and rubygems.org
  25. 25. OMNITURE DEBUGGER
  26. 26. OMNITURE DEBUGGER Pros q OS independent q Run using the regular test-user Cons q Browser dependent – need to implement ScriptRunner for the UI-driver in use q Web-Analytic solution dependent – Adobe Marketing Cloud / Omniture SiteCatalyst
  27. 27. HTTPSNIFFER Pros q Web-analytic solution independent q Browser independent q UI-driver independent Cons q 3 rd party libraries are OS Dependent q HTTPs not supported out-of-the-box q Run tests as ‘root’
  28. 28. JSSNIFFER Pros q  Web-analytic solution independent q  Browser independent q  HTTPs supported out-of-the-box q  No dependency on any 3 rd party library Cons q  Need to write JavaScript to get the URL from the browser q  UI-driver dependent
  29. 29. Is that all to Web Analytics?
  30. 30. The new “kids” in town IoT & Big Data
  31. 31. Some popular use cases
  32. 32. IOT – INTERNET OF THINGS Opportunity to ¨ Create new value propositions ¨ Be Innovative ¨ Be Creative
  33. 33. IOT – HOW TO DELIVER VALUE? ¨ Automate the manual processes ¨ Integrate data capabilities ¨ Collect – integrate from various sources ¨ Repeat collection – automate the collection ¨ Analyze – manual & machine learning ¨ Optimize / Pivot ¨ Repeat
  34. 34. IOT – CHALLENGES ¨ Federated devices ¨ Different types of networks ¨ Different communication channels ¨ Physical (hardware) & Virtual (software)
  35. 35. IOT – BIGGER CHALLENGES ¨ Too many devices ¨ Lots of data
  36. 36. BIG DATA …. IS GETTING BIGGER ¨ Volumes of data generated ¨  A jet engine generates 1TB of data per flight. ¨  A large refinery generates 1TB of raw data per day. ¨  As cars get smarter, the number of sensors is projected to reach as many as 200 per car. ¨  Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors. ¨ IoT leads to massive volumes of data http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
  37. 37. IoT is about Data!
  38. 38. TO GET VALUE FROM IOT … ¨ Collect ¨ Analyze ¨ Predict ¨ Plan
  39. 39. What does this mean for Testing?
  40. 40. TESTING OPPORTUNITIES We need to build capabilities to validate – ¨ Data collection is working well ¨ From all sources ¨ Analyzing data, capturing patterns and trends ¨ Optimize business value ¨ Create new opportunities and value propositions
  41. 41. RESOURCES ¨ https://github.com/anandbagmar/waat ¨ https://github.com/anandbagmar/waat-ruby ¨ http://essenceoftesting.blogspot.in/search/label/waat ¨ http://www.cisco.com/web/solutions/trends/iot/docs/ iot-data-analytics-white-paper ¨ http://www.dezyre.com/article/how-big-data-analysis- helped-increase-walmart-s-sales-turnover/109 5
  42. 42. @BagmarAnand about.me/anand.bagmar THANK YOU

×