2. Our Team
Tapan Mehta – Project Lead
Atulya Aravindan – Test lead
Syeda Sharfunnisa – Document Lead
2
3. Client - Carsales.com.au
Australia's number one automotive classified website.
Carsales network of websites also includes CarPoint.com.au,
bikesales.com.au, RedBook.com.au as well as leading boat,
caravan, and truck and machinery classified websites
400+ Staff nationwide and increasing.
3
4. Ryvuss Search Testing Project
Testing Ryvuss search engine built by
Carsales that powers all their classified
and mobile Apps in Australia, Brazil and
Korea.
What is Ryvuss?
Ryvuss is an intelligent search engine
designed in such a way that it easily
indexes data from any sources either in
cloud or from dedicated data centres and
can handle and maintain complex
searches allowing custom refinements.
4
5. Current Problems
Currently there are two problems associated with Ryvuss
search:
Oracle & Automation problem
Test Case Generation
5
6. Objectives
To propose a testing methodology which will assist carsales.com.au
to refine their search criteria in Ryvuss.
To design test scripts that can be used for functional
Implementation.
Analysis report for future references.
6
7. Testing Methodology Proposed
Metamorphic Testing – To Overcome Oracle problem
Category Partition Method – To design Test Case Specifications
Adaptive Random Testing – Test Case Generation
7
8. Metamorphic Testing
Technique used to create follow up test cases bases on existing test cases.
Mainly done to alleviate the oracle problem
Checks relations among several executions rather then correctness of
individual outputs.
Three main steps involved in metamorphic testing:
Construction of Metamorphic relations
Generation of follow up test cases
Execution of Metamorphic tests
8
9. Example
Assume, A as a Make - Holden
A1 as a subcategory (Model) of Holden – Commodore.
Now logically, as any Make is a Parent node of any Models
in Ryvuss Search Engine, the Overall Count of Make must
be always equal to Total Sum of individual counts of
models.
I.e. Count (A) = Sum of Count (a1 + a2 + a3 + ………… +
an)
And,
Say, Count (X) = Count (A and A1)
Then, the metamorphic relation can be formed as:
Count (X) <= Count (A)
Where, Count (X) = Result Count on selecting Holden and
Commodore
Count (A) = Result Count for Holden.
9
11. Category Partition Method
It is a black box testing approach.
A method that goes from Specifications(Description of the system , to a
test) that are analysed and test cases are built.
It’s a 6 step approach :
Identify independent testable feature
Identify categories
Partition categories into choices
Identify constraints among choices
Produce/ evaluate test case specification
Generate test cases from test case specification
11
13. Adaptive Random Testing
It is a black box testing method.
It is simple and can be easily implemented
Test cases are chosen randomly
As it depends on the failure rates it is not considered to be a powerful testing
method.
13
