The document is a case study presentation on IoT and embedded testing, specifically focusing on Roku devices, delivered by Rick Faulise, a seasoned expert in automated testing. It outlines his extensive experience in managing automated test suites across various platforms and details unique testing considerations for streaming performance and functionality specific to Roku. The session includes logistics for audience participation and a Q&A segment, emphasizing the integration of QA activities throughout the development life cycle.

1. T12
Session
10/27/2016 13:30
IoT and Embedded Testing:
A Roku Case Study
Presented by:
Rick Faulise
tap | QA
Brought to you by:
350 Corporate Way, Suite 400, Orange Park, FL 32073
888-­‐268-­‐8770 ·∙ 904-­‐278-­‐0524 - info@techwell.com - http://www.starcanada.techwell.com/

2. Rick Faulise
tap | QA
Delivery director Rick Faulise has been working in the automated testing space
for eighteen years—managing teams building fully automated test suites and
pioneering new automation technologies. He has worked to expand automation
capabilities outside standard methodologies and into new platforms—mobile
devices, streaming devices, TVs, and autos. With his management experience
Rick has successfully integrated QA activities throughout the entire development
lifecycle. He is well versed in implementing and defining CI processes for clients
across multiple industries and platforms.

3. Bending Roku to your Testing Needs

4. Speaker introductions
Formal 5 min break around halfway through
Q&A at the end - plan to end 5 minutes before the hour
Feel free to hang out with us afterwards
Take a business card and leave your name and email to keep in
touch! Overview
Session Logistics

5. Cell phones to vibrate
Open minds
Sit close to the front – I don’t bite!
Be present
This is for you…soak it in
Session Ground Rules

6. Speaker
Richard Faulise
Delivery Director
Rick Faulise has been working within the automated testing space for the last 18
years; both managing teams building fully automated test suites as well as
pioneering new automation technologies. He has worked to expand automation
capabilities outside of standard methodologies and into new platforms. Those
platforms include mobile devices, streaming devices, TV’s, and autos. With his
management experience he has been able to successfully integrate QA activities
within the entire development life cycle. He is also well versed in implementing and
defining CI processes for various clients across multiple industries and platforms.

8. Video Streaming
Have you
done this yet?

9. Automating Roku

10. Brightscript
Open-platform
Written in a “Channel” format
Based on Basic but more similar to
Visual Basic or JavaScript
Uses an object model:
Core
Platform

11. Ruby
Open-platform
Uses Telnet to communicate with
ROKU device
Send commands to:
Navigate
Query for information
Text validation
Images are restricted
Roku Device
Brightscript
Ruby GEM

12. Broadcast Environments

13. Measuring Streaming Performance

14. Unique Roku Test Types
Validate Stream is open and working
Screen sizing
Remote simulation
Video Looping
LED interactions
Very similar to web apps

15. Special Roku Testing Considerations

16. Example / Demo

17. What To Test
Device Content
Channel Update
Channel Selection
Regional Video Support
Playback
Test Pattern
Calibration
Loading Content
Search
Device Environment
Performance / Speed
Wired vs WiFi
Bad Connection
No Connection
Secure Connection
Live Streaming
Reloading Content
Security

18. Recommended Test Sequence
Setup Ruby
Framework
Define test
scenarios ExecuteScript
Validate
Streams
Validate
Objects
Navigate
Channel
Framework
Test Process

19. Streaming Device Testing Comparison
Roku Fire TV and Chromecast

20. Questions?

21. Thank You for Attending!