The term “cross-browser functional testing” usually means some variation of automated or manual testing of a web-based application on different mobile or desktop browsers. The aim of the testing might be to ensure that the application under test behaves or looks the same way on different browsers. Another meaning could be to verify that the application works with two or more browsers simultaneously. Malcolm Isaacs examines these different interpretations of cross-browser functional testing and clarifies what each means in practice. Malcolm explains some of the many challenges of writing and executing portable and maintainable automated test scripts which are at the heart of cross-browser testing. Learn some practical approaches to overcome these challenges, and take back manual and automated testing techniques to validate the consistency and accuracy of your applications—whatever browser they run in.

1.
nt Session
Presented by:
Malcolm Isaacs
Brought to you by:
340 Corporate Way, Suite Orange Park, FL 32073
888‐2
W2
Concurre
4/9/2014
10:30 AM
“A Guide to Cross‐Browser Functional Testing”
HP
300,
68‐8770 ∙ 904‐278‐0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com

2. Malcalm Isaacs
HP
Malcolm Isaacs is a member of the functional architecture team in HP Software’s
Application Lifecycle Management group, focusing on best practices and
methodologies across all aspects of the software development lifecycle. During the
course of his career, Malcolm has worked in various positions including software
engineer, team leader, and architect. In 2003 he joined Mercury (later acquired by
HP), where he worked on a number of products which specialize in supporting
traditional and agile software development lifecycles from planning through
deployment. Follow Malcolm on Twitter @MalcolmIsaacs, contact him at
Malcolm.Isaacs@hp.com, and read his HP blog.

3. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
A Guide to Cross-
Browser Functional
Testing
STARCanada 2014
Malcolm Isaacs
Twitter: @MalcolmIsaacs

4. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Agenda
Web Applications
Testing Web Applications
Challenges of Testing
Overcoming the Challenges

5. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Web Applications

6. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile Apps- Native

7. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile Apps - HTML

8. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile Apps - Hybrid

9. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Versions

10. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Architecture
Web Application Back-end
Services
Interne
t

11. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples
HP’s Travel Request System. Forgot to select your country?

12. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)

13. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)
Pages render differently…
Comments on the HP blogging platform:

14. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)
Pages render differently…
HP Agile Manager

15. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)
Image Source: http://thedailywtf.com/Articles/Internet-is-Broken--Time-to-Get-a-New-Phone.as

16. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)
Image Source: http://thedailywtf.com/Articles/Internet-is-Broken--Time-to-Get-a-New-Phone.as

17. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Some Examples (cont)
Login Write “1”
1
Locked
?
Loc
k
Login
Locked
?
Write
“2”
Logout
Logou
t
Unloc
k
2
2
2
Time
Image Source: http://www.pantherkut.com/2008/03/20/do-you-think-your-cat-can-order-their-own-food-online/

18. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Under
Test
Prevention

19. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
• Standard Multi-Browser testing
• Compatibility/Consistency Testing
• Multi-Version Testing
• Concurrent Testing
• Single-Browser Concurrent Testing
• Single-Browser Distributed Concurrent
Testing
• Multi-Browser Concurrent Testing
• Multi-Browser Distributed Testing
• Multi-Version Concurrent Testing
Types of Cross-Browser
Testing

20. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application
Under Test
Standard Multi-Browser
Testing

21. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application
Under Test
Compatibility or
Consistency Testing

22. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile Apps…

23. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application
Under Test
Multi-Version Browser
Testing

24. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Under
Test
Single-Browser
Concurrent Testing

25. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Under
Test
Single-Browser
Distributed Concurrent
Testing

26. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Under
Test
Multi-Browser
Concurrent Testing

27. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Under
Test
Multi-Browser
Distributed
Concurrent Testing

28. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Image Sources: http://en.wikipedia.org/wiki/File:Abraham_Lincoln_November_1863.jpg,
http://en wikipedia org/wiki/File:Phineas Taylor Barnum portrait jpg
“You can test on all the browsers some of the
time, and on some of the browsers all the time,
but you cannot test on all of the browsers all the
time.”
Best Practices –
Choose your
Browsers!

29. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test the API layer(s)
independently
Test the GUI layer for regression
automatically across all
browsers
If you can’t, use exploratory
testing to check the baseline
browser
…then use scripted testing to test
the cross-browser compatibility
Think about automating at least
some of this testing
Image Source: http://commons.wikimedia.org/wiki/File:Mille-feuille_20100916.j
Best Practices –
Methodology

30. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Maximize the viewing area
• It’s usually best to test in full-screen view
Ensure the font size and page zoom are
set correctly
Keep the typical end-user configuration in
mind when you create the baseline
For compatibility testing, test on the same
screen size and resolution as the baseline
Turn off the browser’s auto-update
feature
Make sure any HTTPS certificates are
installed
Install any plugins the application needs
Image Source: http://www.flickr.com/photos/30592906@N00/1924189728
Best Practices –
Prepare the Browser

31. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Best Practices – Write
Portable Tests

32. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Image Source: http://thestar.blogs.com/photoblog/2013/06/boris-spremo-.htm
Best Practices – Write
Portable Tests
Avoid Browser-Specific Behavior

33. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Best Practices – Write
Portable Tests
Minimize browser-specific behavior

34. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Browser("Search").Page("Search").WebEdit("q").Set “Hello world!”
Best Practices – Write
Portable Tests
Hide the HTML implementation

35. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test 1
OR…
?
Test 2 Test 3 Test 1 Test 2 Test 3 Test 1 Test 2 Test 3
Test 1 Test 2 Test 3
AND
System tests
Unit tests
Executing Tests
Sequentially

36. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test 1
Test 2
Concurrent Testing –
Multiple Browsers on
the Same Machine

37. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Independent tests
Image Source: https://wiki.jenkins-ci.org/display/JENKINS/Lo
Concurrent Testing –
Multiple Browsers on
Different Machines

38. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application
Under Test
Dependent tests
Single-Browser
Distributed
Concurrent Testing

39. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
The Future of Testing Blog
LoadRunner and Performance Center Blog
Application Lifecycle Management and App Transformation
Blog
HP Software Developers Blog
Resources

40. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you