Testing in the New Internet Era

Testing in the New Internet Era Tony Chung QA Manager

A Trip down Memory Lane...

The Internet of Yesterday

The Internet of Today

What Will we Cover Today?

What Will we Cover Today?• My Top 4 Internet Themes• Why, Mozilla?• Testing Approaches• Ways to Get involved!

Mozilla Mission

http://www.mozilla.org/about/mission.html

Top 4 Internet Themes

#4: Desktop

#4: Desktop Browsing

#4: Desktop Browsing• Despite slowing growth on PC usage, still the top way to access internet• Users still averaging ~7.7 hours a day usage* • In Southeast Asia, average 14-25 hours a week (source: Nielsen Wire, Nov 2011)*• Users still spend 1/3 of time online using Email, Search, Social, Gaming, and video• Security and Privacy even more important than ever

#4: Desktop Browsing • Despite slowing growth on PC usage, still the top way to access internet • Users still averaging ~7.7 hours a day usage* • In Southeast Asia, average 14-25 hours a week (source: Nielsen Wire, Nov 2011)* • Users still spend 1/3 of time online using Email, Search, Social, Gaming, and video • Security and Privacy even more important than ever* Source: http://blog.nielsen.com/nielsenwire/global/surging-internet-usage-in-southeast-asia-reshaping-the-media-landscape/

#4: Why, Mozilla?

#4: Why, Mozilla?• Firefox is still our Flagship gateway to the Internet• Always pushing for Open Standards• 18-week release support (Nightly, Aurora, Beta)• Accelerated deployments has introduced new headaches, so still lots of work to improve on

#4: Testing Approach

#4: Testing Approach• Over 30,000 automated nightly tests ran, multiple platforms• Test Execution every week against Nightly, Aurora, and Beta channels• Automated regression tests via Mozmill Test Framework• Keeping up with new features and Testplans• Cross platform coverage, Localization, Security releases, Support• Web Compatibility and Exploration through Crowdsourcing

#3: Cloud

#3: Cloud• Online Storage: Access your data from Any device• Online computing: Relying less power on native apps• Apple, Google, Amazon, Netﬂix, etc.. investing hundreds of millions into Cloud storage and infrastructure • Storing music, video, apps, photos, docs• Broadband and Virtualization brings speed up, costs down

#3: Why, Mozilla?

#3: Why, Mozilla?• Cloud Services are important building blocks to provide better User experiences• Built out 3 co-locations to support 1.6M Sync users• Secure: Ease of setup, yet Encrypted Desktop to Phone data syncing• building reusable libraries into a framework for Developers using REST apis

#3: Testing Approach

#3: Testing Approach• Weekly test coverage on Client & Server deployment trains• Functional feature coverage on Dev and Staging environments while generating balanced load• New coverage on upcoming services products like BrowserID and Notiﬁcations• Better ways to support new Service Apps, RESTful APIs

#2: Web Apps

#2: Web Apps• Applications moving to Cloud, less relying on native OS• Mobile applications is redeﬁning browsing and usage• Light storage, rapid application, Ubiquitous• Distribution model through Web stores and marketplaces

#2: Why, Mozilla?

#2: Why, Mozilla?• Web Developers want an Appstore model for the web to showcase their work without proprietary silos• An OpenWebApp store to promote Apps written in HTML5, CSS, and Javascript• Uphold high security guidelines while respecting user privacy

Preview of OWA

Preview of OWA Click

#2: Test Approach

#2: Test Approach• Cross Functional teams, lots of collaboration• Manual and automated testing approach• Project management challenge: Team dependencies, Mix of Code repositories, Independent deadlines, mixture of tools and bug tracking systems

#1: Mobile

#1: Mobile• Mobile is Everywhere! Now world’s most widely distributed computing system• Smartphones and Tablets are ﬂooding the market • iOS: 27.3%, Android: 43.7%, Others: 30%* • Has led to explosion of mobile Applications• Affordable and Plentiful • “The mobile revolution is moving from Ear to Hand” - Jussi Hinkkanen, Head of Policy, Nokia Africa

#1: Mobile • Mobile is Everywhere! Now world’s most widely distributed computing system • Smartphones and Tablets are ﬂooding the market • iOS: 27.3%, Android: 43.7%, Others: 30%* • Has led to explosion of mobile Applications • Affordable and Plentiful • “The mobile revolution is moving from Ear to Hand” - Jussi Hinkkanen, Head of Policy, Nokia Africa* comScore, Inc, US household, Aug 2011

* Source: Mobile Usage Statistics, Stats & Facts 2011 | Digital Buzz Blog

#1: Why, Mozilla?

#1: Why, Mozilla?• We need to go where the internet is going, and uphold our mission doing it.• Firefox on Android. from XUL to Native• Web APIs support to mobile platform• Large investment in Boot 2 Gecko OS• Apps need to be on a common platform, not walled-garden approaches

B2G and WebAPI

#1: Test Approach

#1: Test Approach• Lots of challenges: regional, hardware limitations, distribution channels• Firefox Android follows 18-week progression cycle• Manual and Automated testing of features and behavior • Execute litmus tests, building automated test harness• Web and Device compatibility coverage, More Crowdsourcing!

Who can help with Testing?

You Can!

You Can!• Do you have a computer or Android phone? Yes!• Do you want to produce quality products? Yes!• Do you support the Open Web? Yes!• Here’s how you can help...

Desktop Testing

Desktop Testing• Download a Firefox build on Nightly, Aurora, or Beta• Run Litmus tests on a localized build• File bugs in bugzilla!• Join our Firefox Testdays for real-time interaction with the community

Cloud Services Testing

Cloud Services Testing• Set Up Sync on Firefox!• Sync your bookmarks and history• Visit or Create a site using Browser ID and report bugs• File bugs in bugzilla!• Join our Sync or BrowserID Testdays for real-time interaction with the community

Open Web Apps Testing

Open Web Apps Testing• Download a Web App through the App Marketplace (coming soon)• Create a Web App and upload one!• File bugs in bugzilla!• Join our WebApp Testdays for real-time interaction with the community

Mobile Testing

Mobile Testing• Android phone users -- install Firefox for Android• Visit your favorite websites on different devices• Develop automated java tests in Robotium against Firefox Android• File bugs in bugzilla!• Join our Mobile Testdays for real-time interaction with the community

• Get started by visiting • http://quality.mozilla.org• Chat with us real-time on • irc.mozilla.org, channel #qa• File and Verify Bugs!

Join Us!

Testing in the New Internet Era

by dknite

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 1

Statistics

Testing in the New Internet Era Presentation Transcript