Using JMeter and Google Analytics for Software Performance Testing
Why uTest?
1. Why uTest?
uTest is the world’s largest provider of in-the-wild testing
services with over 70,000 testers from across 190 countries
Functional, Load,
25,000+ Usability, L10N &
test cycles Security
Web, Mobile
2,000+ & Desktop apps
customers
Enterprises, SMBs & universities
| 1
2. The uTest Advantage
• Better Applications
– In-the-wild testing: live testers, real devices, real-world conditions
– Unmatched coverage across large matrix of OS/browser/location
– Customers rate testers, so best testers win
• Faster Time to Market
– Test cycles created in minutes; underway in hours; completed in days
– Test cycle can be executed overnight or during weekends
• Lower Total Cost of Testing
– On demand means no long-term contracts
– Lower total cost of testing than near-shore boutiques or offshore shops
• Scalability
– 70,000+ professional testers from 190 countries
– Scale size of test team up or down at will
| 2
4. Functional Testing
• Real-world functional testing
– Highly complimentary to in-house efforts
– Real-world testing, across:
- OS & browser
- ISP, firewall & anti-virus
– Exploratory or test case execution
– Manual or Automated
– Can also test integration between your product and third-
party apps (EG: Facebook, Twitter, YouTube, Slideshare)
| 4
5. Usability Testing
• Real-world usability testing
– Survey-based usability and UAT
– Virtual focus groups by:
- Age , gender & location
- Education level & employment status
- Industries & hobbies
– UX experts available for:
- Objective usability audit
- Survey writing
- Focus group management
- Results validation and data analysis
| 5
6. Load Testing
• Real-world load testing
– Complimentary to existing efforts
– Three flavors of load & performance testing
- Live load
- Synthetic load
- Hybrid load
– Can utilize automated load tools
– Performance benchmarking also available
| 6
7. Localization Testing
• Real-world localization testing
– Reported issues validated by 2nd party
– Real-world localization validation, across:
- Locations & languages (native speakers)
- Age & education level
– Validating all facets of localization:
- Language translation
- Currency conversion
- VATs and other taxes
- Shipping options
| 7
8. Security Testing
• Real-world security testing
– Augments in-house efforts
- Team or solo security probes
- Dynamic manual and automated testing
– Helps achieve PII- and PCI-compliance
– Utilize industry-leading tools
– Protection against common vulnerabilities checklist
- OWASP 10
- SANS 25
– Focus is on black box security testing
- Probing front end UI for security- or privacy-related vulnerabilities
| 8
10. Case Study: Google
Global power Google taps into the crowd
to augment its in-house testing resources
– Challenge:
- Google’s top tech execs sought to scale their testing to keep up with their world-class
dev teams. At the same time, they wanted to ensure their testing had real-world
relevance to their end-users’ experience.
– Strategy:
- Having invested heavily in outsourcing, in-house resources and automated testing,
Google needed a better, more scalable approach to in-the-wild testing.
- Google explored a wide variety of alternatives and found uTest.
– Results:
- After an extensive pilot project, Google expanded its use of uTest to 18+ web,
desktop and mobile apps; now leverages uTest broadly and frequently.
- As Google ramped up, uTest put a person on site full-time and is now a critical piece
of Google’s overall testing equation
| 10