I presented "What is WAAT" in "vodQA - Chennai" conference in Jan 2012. This is the slide deck I used. I walked through what is web analytics, and then how WAAT can be used to automate the testing of the web analytics tags being reported from the client browser.

1. What is WAAT?
Anand Bagmar
Software Quality Evangelist
ThoughtWorks

2. What is Web Analytics?

3. Why do we need it?

4. Performance
…
Metrics
Omniture’s
StatCounter
SiteCatalyst
Who does
Web Analytics?
Google
WebTrends
Analytics
Mint AWStats

5. How to test this?

9. The problem and challenge

10. Manual

11. Repeating over-and-over again

13. The solution

14. Flavors
WAAT-Java WAAT-Ruby
Original flavor Ruby gem implemented using WAAT-
JAVA
Available on github Available on github and rubygems
Source code + jar Uses RJB – Ruby-Java-Bridge
Supports Omniture Debugger + Supports only HttpSniffer solution
HttpSniffer solution

15. Omniture Debugger
Pros Cons
OS independent Browser dependent –
need to implement
ScriptRunner for the UI-
driver in use
Run using the regular Web-Analytic solution
test-user dependent - Omniture-
SiteCatalyst

16. HttpSniffer
Pros Cons
Web-analytic solution 3rd party libraries are OS
independent Dependent
Browser independent HTTPs not supported
out-of-the-box
UI-driver independent Run tests as ‘root’

17. Why do we do Testing?

18. Architecture

19. How to use WAAT?
• Download zip from github
• Setup
• jpcap / ScriptRunner setup
• Update existing tests

20. Update existing Tests
• Import relevant packages
• Define & provide parameter values
• Initialize Engine
• Enable Web Analytics Testing
• Define Test Data
• Verify Web Analytics reporting using WAAT
• Sample validations
• Disable Web Analytics Testing

21. Import relevant packages
Import package
com.thoughtworks.webanalyticsautomation.common.BROWSER;
com.thoughtworks.webanalyticsautomation.plugins.WebAnalyticTool;
com.thoughtworks.webanalyticsautomation.Controller.getInstance;

22. Define parameters
Parameter Default / Sample value
Engine engine
String[] urlPatterns new String[] {"GET
/ps/ifr?container=friendconnect&mid=0"};
String actionName "OpenWAATArticleOnBlog_HttpSniffer";
WebAnalyticTool webAnalyticTool WebAnalyticTool.HTTP_SNIFFER;
InputFileType inputFileType InputFileType.XML;
boolean keepLoadedFileInMemory true;
String log4jPropertiesFilePath currentDirectory() + “/resources/log4j.properties";
String inputDataFileName currentDirectory() + “/test/sampledata/TestData.xml";

23. Initialize Engine
engine = getInstance(
webAnalyticTool,
inputFileType,
keepLoadedFileInMemory,
log4jPropertiesAbsoluteFilePath
);

24. Enable Web Analytics Testing
engine.enableWebAnalyticsTesting();

25. Define Test Data
<Section
actionName="OpenUpcomingPage_HttpSniffer"
numberOfEventsTriggered="1"
tagList="pageName=upcoming:index||
cc=USD||
ch=upcoming||
events=event2||"/>

26. Verify Web Analytics Reporting
Cart.checkout();
Result verificationResult =
engine.verifyWebAnalyticsData (
inputDataFileName,
actionName,
urlPatterns,
minimumNumberOfPackets);

27. Sample Validations
assertNotNull(verificationResult.getVerificationStatus(),
"Verification status should NOT be NULL");
assertNotNull(verificationResult.getListOfErrors(),
"Failure details should NOT be NULL");
logVerificationErrors(verificationResult);
assertEquals(verificationResult.getVerificationStatus(),
Status.PASS, "Verification status should be PASS");
assertEquals(verificationResult.getListOfErrors().size(),
0, "Failure details should be empty");

28. Disable Web Analytics Testing
engine.disableWebAnalyticsTesting();

29. Remember
Minimal changes to existing test framework
Does not depend on junit / testng / …
Web Analytic tool independent (HttpSniffer)
UI Driver framework independent

30. For more information
• Blog: http://essenceoftesting.blogspot.com/search/label/waat
• Github: https://github.com/anandbagmar/WAAT
• Github: https://github.com/anandbagmar/WAAT-ruby
• RubyGems: http://rubygems.org/gems/WAAT
• Email: Anand.Bagmar@thoughtworks.com, abagmar@gmail.com

31. Anand.Bagmar@thoughtworks.com
abagmar@gmail.com