DaKiRY_BAQ2016_QADay_Анна Берднік "Main aspects of TV Everywhere testing"

1. Main aspects of testing
TV Everywhere web-site

2. Who speaks?
Anna Berdnik
Testing Software Engineer at EPAM Systems (Dnipro).
QC experience - over 3 years
2,5 years of Adobe CQ Testing
Majors in Functional Testing

3. What about you?

4. What`s on today?
• TV that goes where you go.
• Project overall description.
• Risks and estimations.
• TV Everywhere website main components.
• What do we test? How?
• New strange words - MPX, Live Player and Companion Ad.

5. The story of TV that goes where you go
• 2009, TV Everywhere initiative was firstly announced.
• By 2012 – TVE reached Europe and Asia.
• In 2013 - 2 out of 10 pay television subscribers used TV Everywhere services at least once a week.
• In December 2015, 53% of the United States' pay television subscribers have used a TV Everywhere
service at least once.

6. What is TV Everywhere?

7. What is TV Everywhere?
TV Everywhere is an authentication system whereby certain premium content
(movies, TV shows, etc.) are accessible online via a variety of display devices
including PC, mobile and TV — but only if you can prove (or “authenticate”) that you
have a subscription to a multiservice operator (satellite, cable, telco TV, etc).

8. TV Everywhere as project

9. TV Everywhere as project
This kind of project is usually about implementing Online TV
Catalog and equipped with Live Broadcasting Player, Offline
Player and Video Files storage.
Technologies mostly used
• Java, Python, PHP
• Apache, Nginx
• JavaScript, HTML
• Adobe CQ, Drupal

10. Object of testing
TV Everywhere web-site for
desktop and mobile devices.
• Functional (black-box) testing
• Component and Integration
testing
• UI testing
• Smoke testing
• Full Regression testing – before
release
• Using test cases
How to test?

11. Website Pages and components to be tested

12. Website Pages and components to be tested
• Main Landing page
• Home page
• Show Page
• Search page
• Live Streaming page
• Help/FAQ pages
• Search form
• Authorization to provider
• Player
• Advertisement
• Live player
• Next episode element

14. Signing in
• Authentication and authorization
• Have you really signed in to the provider?
• Integration with player

15. Watching TV episodes on demand
Media companies use online video platforms (OVP) to monetize their content
libraries.
MPX is SaaS. This OVP permits users to publish and manage videos online. It is
optimized for most viewing devices.
Keep in mind:
• Video restrictions
• Companion add
• Player UI
• Close Captioning Menu
• Full screen mode

16. Offline Player and Companion Ad
• While providing
Over-The-Top
content TVE
channels use
several types of
advertisement
• Advertisement
banner in Player
and Companion Ad
component should
match

17. Live Streaming player
Main features
• HD content – up to
4326kpbs
• Premium Video in a real
time
• Ability to pause and
return later
• Next video component
• Metadata update
• Subtitles
• Full screen

18. TV Everywhere devices

19. Risks Assessment for TV Everywhere web-site
Based on the likehood and predicted impact.

20. Risks Assessment for TV Everywhere web-site
Based on the likehood and predicted impact.
Main risks:
• Site is not working.
• Video-on-demand episodes are unavailable.
• Live stream is not working.
• Episode Pictures are messed up.
• Ad is not working properly.

21. Estimation of testing
On the base of:
- specification;
- test cases;
- previous experience and common sense.

22. Estimation of testing
Keep in mind:
• Live video changes once an hour.
• Player testing includes watching.
• Ad testing from 15sec till 4 min of add that cannot be skipped.
• Video Assets need some time to load.
• Authorization time out.
• Time for Bug fix.
• The same test-cases are performed for several times – for different
browsers and mobile devices.

23. Tools used while testing
• JIRA – task and bug tracker
• Clip2Net, PrtSC - for Screenshot
• Google Docs and Sheets – for
test cases or links storage
• Invisionapp – for markups
• Page Ruler – for UI testing
• BitBucket – for Git Viewing
• HipChat, Skype for Business –
for communication

24. Where is it all going?
In December 2015
• Over 59 mill of TVE subscriptions in USA
• 78% of cable TV Subscribers in Europe use second screen
• Authenticated viewing on TV-connected devices, such as Apple TV
and Roku, grew 110% year-on-year

25. Hey, it`s time to recap!
• TVE everywhere is a great concept
• It is Geo Bounded
• The authorithation is tricky
• TVE web-site has many parts and components
• The heart of TVE-website is Player
• Live broadcasting is the second heart of TVE
• As the usage of TVE increases in Europe and Asia we should stay
prepared

27. Thank you!
Have a nice day!