image transformation

1. Search result(s): for the purposes of
this HitApp any potentially related
image(s) returned by the search
In this HitApp we are determining the relevance of search queries and search results. All the
queries were issued on the Images Tab; hence the results are images.
Search query: terms used for search on web, for example {cats}
Images Tab
Search relevance: how good is the image in
the result considering the search query.
Let’s help the internet searchers find the
best images on web!
Relevant: exactly what the searcher
was looking for.
Relevant but Imperfect:
• There is a distraction, and the
query is not the focus of the
image, rather a secondary topic
• Not a common version, for
example, a toy or an artwork
• There is a foreign text in the image
Related: could be of interest to the
searcher but is not what they asked
for. It can be a feature, location or
any other mismatch.
Not Related: no topical connection
with the query and won’t be
interesting
Detrimental: you wouldn’t expect to
see this on TV or in a newspaper
Start
Image contains pornography,
offensive text or other
unacceptable content
Image is a good result, but
queried topic is not the only
/ main one, or there is a
distraction from topic
Not Related
Relevant
Yes
Yes
No
No
Image is not topically related
to the query
Detrimental
Yes
Image has some topical
connection to the query, but
there is a mismatch
Related
No
Yes
Relevant but
Imperfect
No
Please note: if you cannot
understand the query even after
some research, please, use a
checkbox “I cannot understand to
query” to skip a hit.
Quality of the image is evaluated in another HitApp, please, do not downgrade based on
quality!
Image Relevance Quick Guide

2. You can research the query in Bing or
Google search, or even translate it using
the links on top or CTRL + [key letter]
You can see the query and some context
including where the query was issued.
In case images are not
loading, please make
sure to use the links to
research the result
Use the checkbox in case you don’t understand the query,
buttons in the tool or the hot keys on the keyboard as
described on the very bottom of the page and Submit button
to make your judgment.
UHRS has a bunch of helpful functions that can help you make a good judgment. Please, find
some of them below.
Query Result Comment
Examples and exceptions for RELEVANT
{heart-shaped
cloud}
[clearly manipulated
artistic image with cloud
shaped as a heart]
Query is not asking for a not photoshopped image
and having a natural image satisfying the query is a
great luck. It is what the searcher was looking for,
hence RELEVANT.
{samurai}
[someone’s photo from a
book or magazine]
It is an image quality problem which is evaluated
in another HitApp. If this image is Relevant to the
query – please, do not downgrade it. RELEVANT.
{grasshopper}
Even though pink grasshopper is not the most
common, it is still okay to select RELEVANT. The
searcher has not specified exact color, so any color
grasshopper should be fine.
Image Relevance Quick Guide

3. Query Result Comment
Examples and exceptions for RELEVANT but IMPERFECT
{famous
destination}
[correct destination, but
the focus of image is
clearly on tourists]
RELEVANT result would ideally be focused on the
query. Since the focus is on tourists, this one is
RELEVANT BUT IMPERFECT.
Please note, for example {Paris} -> [image of Eiffel
tower] is RELEVANT, because Eiffel tower is a great
generic representation of Paris for many searchers.
{sea}
The pathway is clearly the focus of the image. Since
the query is a secondary topic in the picture, it is
RELEVANT BUT IMPERFECT.
{festival}
issued in China
Cultural Background: In the U.S. ‘festivals’ are
mostly music festivals, e.g., pictures of concerts
with a prominent stage and lots of people would be
RELEVANT. In Chinese ‘festival’ tends to be more
about cultural festivals, for example pictures of
lanterns for mid-fall.
Considering the background, this result for a query
issued in China is RELEVANT BUT IMPERFECT.
Examples and exceptions for RELATED
{couch in Moscow} [couch sold in New York]
The result is the queried object but with different
location. Since it might be still of interest to the
searcher, RELATED
{flower name}
[perfume with the name
of this flower]
The result has distant topical connection with the
query, and can still be of interest to the searcher,
hence RELATED
{3 pack tshirts size
XL Pink/Purple}
[3 yellow t-shirts]
Nor exactly what the searcher was looking for. Not
correct, but close and still might be of interest,
hence RELATED
Examples and exceptions for NOT RELATED
{vegetable tanning}
[lime pits used for old
style tanning process
itself, but not the new,
organic vegetable
tanning]
A bit too far from the query meaning, so it is NOT
RELATED. Though since there still is some topical
connection, it can be RELATED as well.
Thank you for helping make search results better!
Image Relevance Quick Guide