Ryvuss Search Testing Project
TAPAN MEHTA – 4944100
ATULYA ARAVINDAN – 4942906
SYEDA SHARFUNNISA - 4969278
1
Our Team
 Tapan Mehta – Project Lead
 Atulya Aravindan – Test lead
 Syeda Sharfunnisa – Document Lead
2
Client - Carsales.com.au
 Australia's number one automotive classified website.
 Carsales network of websites also includes CarPoint.com.au,
bikesales.com.au, RedBook.com.au as well as leading boat,
caravan, and truck and machinery classified websites
 400+ Staff nationwide and increasing.
3
Ryvuss Search Testing Project
 Testing Ryvuss search engine built by
Carsales that powers all their classified
and mobile Apps in Australia, Brazil and
Korea.
What is Ryvuss?
 Ryvuss is an intelligent search engine
designed in such a way that it easily
indexes data from any sources either in
cloud or from dedicated data centres and
can handle and maintain complex
searches allowing custom refinements.
4
Current Problems
Currently there are two problems associated with Ryvuss
search:
 Oracle & Automation problem
 Test Case Generation
5
Objectives
 To propose a testing methodology which will assist carsales.com.au
to refine their search criteria in Ryvuss.
 To design test scripts that can be used for functional
Implementation.
 Analysis report for future references.
6
Testing Methodology Proposed
 Metamorphic Testing – To Overcome Oracle problem
 Category Partition Method – To design Test Case Specifications
 Adaptive Random Testing – Test Case Generation
7
Metamorphic Testing
 Technique used to create follow up test cases bases on existing test cases.
 Mainly done to alleviate the oracle problem
 Checks relations among several executions rather then correctness of
individual outputs.
 Three main steps involved in metamorphic testing:
 Construction of Metamorphic relations
 Generation of follow up test cases
 Execution of Metamorphic tests
8
Example
 Assume, A as a Make - Holden
 A1 as a subcategory (Model) of Holden – Commodore.
 Now logically, as any Make is a Parent node of any Models
in Ryvuss Search Engine, the Overall Count of Make must
be always equal to Total Sum of individual counts of
models.
 I.e. Count (A) = Sum of Count (a1 + a2 + a3 + ………… +
an)
 And,
 Say, Count (X) = Count (A and A1)
 Then, the metamorphic relation can be formed as:
 Count (X) <= Count (A)
 Where, Count (X) = Result Count on selecting Holden and
Commodore
 Count (A) = Result Count for Holden.
9
Example
10
Category Partition Method
 It is a black box testing approach.
 A method that goes from Specifications(Description of the system , to a
test) that are analysed and test cases are built.
 It’s a 6 step approach :
 Identify independent testable feature
 Identify categories
 Partition categories into choices
 Identify constraints among choices
 Produce/ evaluate test case specification
 Generate test cases from test case specification
11
Example
12
Adaptive Random Testing
 It is a black box testing method.
 It is simple and can be easily implemented
 Test cases are chosen randomly
 As it depends on the failure rates it is not considered to be a powerful testing
method.
13
Summary
14
Reflection
 Understanding Requirements
 Communication Skills
 Team Work/ Performance
 Managing the Project with
Changing Scope
15
16

Ryvuss Search Testing Project_Final

  • 1.
    Ryvuss Search TestingProject TAPAN MEHTA – 4944100 ATULYA ARAVINDAN – 4942906 SYEDA SHARFUNNISA - 4969278 1
  • 2.
    Our Team  TapanMehta – Project Lead  Atulya Aravindan – Test lead  Syeda Sharfunnisa – Document Lead 2
  • 3.
    Client - Carsales.com.au Australia's number one automotive classified website.  Carsales network of websites also includes CarPoint.com.au, bikesales.com.au, RedBook.com.au as well as leading boat, caravan, and truck and machinery classified websites  400+ Staff nationwide and increasing. 3
  • 4.
    Ryvuss Search TestingProject  Testing Ryvuss search engine built by Carsales that powers all their classified and mobile Apps in Australia, Brazil and Korea. What is Ryvuss?  Ryvuss is an intelligent search engine designed in such a way that it easily indexes data from any sources either in cloud or from dedicated data centres and can handle and maintain complex searches allowing custom refinements. 4
  • 5.
    Current Problems Currently thereare two problems associated with Ryvuss search:  Oracle & Automation problem  Test Case Generation 5
  • 6.
    Objectives  To proposea testing methodology which will assist carsales.com.au to refine their search criteria in Ryvuss.  To design test scripts that can be used for functional Implementation.  Analysis report for future references. 6
  • 7.
    Testing Methodology Proposed Metamorphic Testing – To Overcome Oracle problem  Category Partition Method – To design Test Case Specifications  Adaptive Random Testing – Test Case Generation 7
  • 8.
    Metamorphic Testing  Techniqueused to create follow up test cases bases on existing test cases.  Mainly done to alleviate the oracle problem  Checks relations among several executions rather then correctness of individual outputs.  Three main steps involved in metamorphic testing:  Construction of Metamorphic relations  Generation of follow up test cases  Execution of Metamorphic tests 8
  • 9.
    Example  Assume, Aas a Make - Holden  A1 as a subcategory (Model) of Holden – Commodore.  Now logically, as any Make is a Parent node of any Models in Ryvuss Search Engine, the Overall Count of Make must be always equal to Total Sum of individual counts of models.  I.e. Count (A) = Sum of Count (a1 + a2 + a3 + ………… + an)  And,  Say, Count (X) = Count (A and A1)  Then, the metamorphic relation can be formed as:  Count (X) <= Count (A)  Where, Count (X) = Result Count on selecting Holden and Commodore  Count (A) = Result Count for Holden. 9
  • 10.
  • 11.
    Category Partition Method It is a black box testing approach.  A method that goes from Specifications(Description of the system , to a test) that are analysed and test cases are built.  It’s a 6 step approach :  Identify independent testable feature  Identify categories  Partition categories into choices  Identify constraints among choices  Produce/ evaluate test case specification  Generate test cases from test case specification 11
  • 12.
  • 13.
    Adaptive Random Testing It is a black box testing method.  It is simple and can be easily implemented  Test cases are chosen randomly  As it depends on the failure rates it is not considered to be a powerful testing method. 13
  • 14.
  • 15.
    Reflection  Understanding Requirements Communication Skills  Team Work/ Performance  Managing the Project with Changing Scope 15
  • 16.