More Related Content Similar to Game testing inGenuity'12 Similar to Game testing inGenuity'12 (20) More from Indium Software More from Indium Software (20) Game testing inGenuity'121. INDIUM SOFTWARE
An Independent Software Testing Firm
Game Testing – An Arena for Game
Changers (Testers)
“Business Assurance through Quality Assurance”
2. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
Introduction to Gaming Industry
Industry Challenges – Baddies
Solution to challenges – Power Pellets
Game Testing
3 Major Testing Challenges of Online Games
Approaches to online game testing
Future of game testing
3. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Game Industry
3
Last Decade Current Decade
Audiences
Affordable users
Hardcore gamers
Hardcore games
Children
Women
Seniors
Platform
PC
Console
PC
Console
Browser
Mobile
Social network
Tablet
Business
model
Boxed sale
CDs
CDs
Downloads
Installed on gaming
devices
Online
Subscription
Trial Access
App Store
Style
Mostly single
player
Rarely multi
player
Single player
Multi player
Online across the globe
Device &
Graphics
Traditional
console game
Little graphics
Better graphics
3D
Interactive
Simulate real world
Introduction to Gaming
Online Multi Player Single
4. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Game Industry - Baddies
4
Piracy High Development Cost Lack of creativity
illegally downloaded games
up 20% in five years
Nintendo claims that they lost
$975 million
Call of Duty – Black Ops: No
1 game in top 10 most pirated
games of all time. 4.27 million
downloads
Video consoles are triple the
cost as compared to 6th
generation
Huge Licensing , royalty,
marketing & distribution fees
Difficult to convince people to
buy high price for games
Guitar Hero, one of the hottest
sequel, released 11 times in last
5 years
In 2011, only 15 – 30% of
games were new
Gamers thinks twice if the title
has ‘Version’ next to it
……..………..
……..………..
……..………..
……..………………………..
……..………………………..
……..………………………..
5. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Solutions – Power Pellets
5
……..………..
……..………..
……..………..
……..………………………..
……..………………………..
……..………………………..
Against Piracy Bring down development cost Improve Creativity
Implement Digital Rights
Management
Know your customer
willingness to pay the price
Release demo version
Encryption
Digital distribution
Shut down game shops – No
middle man
Graphics alone is not a game
Always do not develop
games behind newest
technologies
New ideas
Shorter games
Incorporate creative missions
6. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Game Testing
6
Importance
of testing
7. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approaches to testing online games
7
Usability Testing Network Testing Security Testing
• Standard Vs Game usability
Know your user
Consistency
Function vs. Mood
• Types of usability testing
Heuristics Analysis
Focus group
Real user testing
8. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approaches to testing online games
8
Usability Testing Network Testing Security Testing
• Case study for usability testing
Game 1 : Halo –
Heuristics Approach
Usability Checklist Description
Consistency poor hit detection ,inconsistent response to input
Customizability
Restrict user to change video and
audio settings, difficulty, or game speed
Artificial Intelligence problems with path finding
View mismatch bad camera angle, view is obstructed
Skip content cannot skip video and audio clips,
Input mapping bad input mappings, limited device support
Controls oversensitive and unresponsive controls
Game status
does not provide adequate information on
character
Visual Representation too much screen clutter, too many characters
Training & Help Does not provide adequate training mission
9. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approaches to testing online games
9
Usability Testing Network Testing Security Testing
Testing In LAN
Distributed Testing
Setting up real test environment
Emulator – An ideal approach
10. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approaches to testing online games
10
Usability Testing Network Testing Security Testing
Cheats
(Threads)
Description Testing Techniques
Tests for cheaters
who violate game or
Denying service to
peer
Disconnecting when
player about to lose
Disturb peer and not
let to play their
games
Tests player ratings if he does
not finish the game as per the
procedures.
Exploiting misplaced
trust or cheating by
exploiting client-
server infrastructure
Cheaters modify the
game configuration ,
data
Verify the two-way
authentication between game
server and client
Cheating by collusion
or Game Specific
Cheats
Misbehavior
Game cheats
Verify chat logs, game logs and
audit trail
11. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approaches to testing online games
11
Usability Testing Network Testing Security Testing
Cheats Description
Cheating by Exploiting
Misplaced trust
The player might abuse the trust and
modify the game code
Cheating related to virtual
assets
Includes players that have received
real life money for an in-game item.
Cheating by exploiting machine
intelligence
The player uses artificial intelligence
in online games to gain an advantage
over his opponent.
Cheating by Exploiting Lack of
Secrecy
Communication packets are
eavesdropped by a cheater
Cheating by collusion Gain unfair advantage over honest
players
Cheating related to internal
misuse
cheats resulted due to an abuse of
privileges from an insider.
Cheating using social
engineering
use psychological methods to coerce
the player to willingly give confidential
information from their accounts.
• Case study for security testing
Starcraft 1 – Win trading
12. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Future of Gaming
12
14. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
14
Thank You
USA:
americas.sales@indiumsoft.com
EMEA & APAC:
apac.sales@indiumsoft.com
emea.sales@indiumsoft.com
INDIA:
sales@indiumsoft.com
Sunnyvale
Suite 210, 1250 Oakmead Parkway
Sunnyvale, CA – 94085.
Phone: +1(408) 501-8844
Fax: +1(408) 501-8808
Atlanta
Crown Office Suites
1870 The Exchange, Suite 100
Atlanta, GA 30339
Phone: +1 (678) 608-0809, +1(770) 989-7302
New Delhi
F-1/5 Okhla Industrial Area Phase-I,
New Delhi – 110 020.
Phone: +91-11-6613 0400
Bengaluru
SRS Plaza, No. 246, 2nd & 3rd Floor
13th Cross, Indira Nagar 2nd Stage
Bengaluru – 560 038.
Phone: +91-80-4914 7777
Chennai
VDS House
41, 2nd Floor, Cathedral Road
Chennai – 600 086.
Phone: +91-44-2811 6330
Fax: +91-44-4210 4033