Co-innovate with Visual Search to Launch New Products

Regalix ProductSnap
Co-innovate with Companies to Launch New Products and Accelerate Revenue Growth
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
1

ProductSnap
 Recognizes products from print collateral and product packaging when a user takes a
picture
 Recognizes products from snapshots of 3D items (“ProductSnap 3D”) where reference
images from multiple perspectives are available
 Optimizes product searching for the mobile user experience: photos instead of text
 Links offline marketing spend with trackable mobile commerce
 Provides valuable stream of trackable transaction & behavioral data
2

What is Visual Search?
3

Retail Example: “I like that hat!”
With Visual Search
4
One snap:
• more info
• quick purchase
• bookmark
• social integration
• comparison shop
• and more…
Hotspots = image + location + metadata
 Nine West Hat
 Large Brim Felt
 Women
 ID: 737624

Multiple Matches Possible from a Single Display
Single images may contain multiple
hotspots that are targets for discovering
related, online information
5
• Nine West Hat
• Large Brim Felt
• Women
• ID: 737624
Hotspots = image + location + metadata
• Pink Shawl
• Women
• ID: 637364
• Black belt
• Women
• ID: 923746
• Go boots
• Women
• ID: 923746

Visual Search User Flow
6

User Takes a
Photo: User can
focus in on a single
item within a multi-item
presentation
Photo is searched
against the
company’s
product database
User is taken to the
snapped item’s
detail page:
User can view reviews,
product bundles,
discounted specials,
and add the item to
their shopping cart
2
3
Visual Search User Flow
1

ProductSnap Applications and
Examples for your Mobile App
8

ProductSnap Applications
 ProductSnap 2D - Customers can snap a picture from any promotional material such as catalogs, newspaper or
magazine inserts, posters, product packaging, in-store displays
 ProductSnap 2D Pro - Customers can snap any promotional material or product packaging from any source, any
brand, any merchant to invoke comparative shopping from within Advertiser’s catalog, Affiliate-merchants or other
partners
 ProductSnap 3D - Customers can snap products from in-store sections to learn, share and buy products
 ProductSnap 3D Pro - Customers can snap products from within stores, at home or in other stores to invoke
comparative shopping from within Advertiser’s catalog, affiliate-merchants or other partners

Adding ProductSnap to Your Mobile App
 Extend your mobile app with ProductSnap to additionally introduce:
• Search by photographing item [ProductSnap]
• Search by scanning barcode
10

Snap Item
 Shopper can photograph item directly on the shelf at a physical store –
either one of your retail stores or even any other location, if you so
desire – by using your app.
 Shopper can also switch to barcode scan view (for greater
precision/accuracy) if desired.
11

Product Matched
 If the photographed item matches product images in your database,
ProductSnap can pull up the appropriate content (e.g., your product
page) and/or any related actions.
• Shopper can:
o ‘Like’ or bookmark the item
o Place the item in a wish-list
o Share the item on social networks
o Add the item to their shopping cart.
• Shopper can also:
o Scan a barcode
o Snap another photo
o Explore other items related to the matched product page.
12

Adding to Your Cart
 Shopper can add the matched item to their online shopping
cart using your current app experience.
• Shopper can also continue shopping by:
• Snapping more photos
• Scanning more barcodes
13

Recognize Items from
Print Sources
 User snaps a photo from
either your printed
catalog, signs, labels,
banners and billboards
to look up items online.
There they can learn
more about the item,
share it with friends, and
also purchase it.
14
Catalog Item Match
 Once ProductSnap
identifies the item,
your user can be
taken to the snapped
item’s page on your
mobile site or app to
complete the
transaction

 User can view item
details and choose
customizations --
sizes, colors, etc.,
based on availability
or inventory --
before completing
the transaction.
15
Extend Search to Partner
Sites
 If the item is not found
in your own product
database, the user can
be given the option to
automatically search
your partner
catalog/sites for
matches.
Select Item Details

ProductSnap Visual Search Technology
16

Image
database
Metadata
database
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 17
 Authoring
• Index any 2D image
• 3D matches possible with images
from many perspectives
• Virtual layers can be applied to
tag multiple items per image
• Assign online content
 Indexing/Recognition
• Adding documents to your
image database
• Recognizing query images
• Hosted in the cloud
 Client Apps
• User experience
• Delivery of online information
Main Elements of the Technology

What ProductSnap can Recognize
Products Logos Distinctive Clothing
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 18

ProductSnap Visual Search Platform
19

Visual Search Authoring: Content Association
 Using our Web-based Portal, online content is associated with images
via “hotspots”
• Hotspot contains links to online content
• Link can be URL, video, audio, tweet, phone number, SMS, etc. or custom
type (JSON or XML string)
 Two ways to create hotspots:
• Single hotspot per image
o Contains one or more links inside
• Multiple hotspots per Image
o Create unique experience in specific regions of image
o Each hotspot contains one or more links inside
 Batch mode: use scripts to populate your content association database
• Upload images plus metadata content, e.g. XML
• Automatically generates single hotspot per image
20
Sample Image
Single Hotspot
Multiple Hotspots

Product Authoring: Assign Digital Experiences
21
Social
Coupons
Info
Info
Social
Games
eComm
Games
Video
Coupons
Info
GAME
Social
Info

Product Authoring: Deliver Digital Experiences
22
Info
Social
Games

ProductSnap Web Services Platform
 RESTful APIs for indexing, recognition and metadata
Developers & Content
Owners
retrieval
 Supports a variety of OS’s: Android, iOS, Windows,
desktop, etc.
 Developers & content owners interact with Web-based
Portal to manage database
 Client apps interact with fast Gateway servers to
submit queries and get results
 Analytics can provide valuable data on usage patterns
23
Desktop
Feature
Phone
Client Apps
Windows 8 iPhone Android

 Collection API: Recognition & Indexing
• Recognition:
o Captured query image submitted to server for recognition
o Server returns match result, includes unique identifier associated
with source image
 Store API: Metadata Storage & Retrieval
• Unique identifier used to retrieve digital content associated with
source image
• Association done via authoring interface
• Developer controls end-user experience by formatting metadata in
the app
• Or, bypass Store server; connect directly to your own server
instead to retrieve metadata
24
ProductSnap API Descriptions

Your App Retains Full Control of Metadata and User Experience
1c
2b
2a
25
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
1b
Submit Image
via Collection API
Retrieve Metadata:
XML/JSON string
represents links to web
content or database
query
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
Present Content:
Metadata formatted for mobile
& integrated into UI
3

3rd Party Data
1b
Submit Image 1c
2b
2a
26
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
via Collection API
Request from 3rd party:
Use unique label to request
metadata from 3rd party server
(e.g., eBay)
3a
3rd Party Web
Service
Retrieve Metadata:
XML/JSON string
represents links to web
content or database
query
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
Retrieve
Metadata
3b
Present Content:
Metadata formatted
for mobile &
integrated into UI
4
OP T IONAL

Common Implementation Questions
 Index Creation Process / Scalability
• We can run scripts against a copy of your product DB or your API
• Currently supports >1MM images
• Recommendation: phase in by subsets of ~500k SKUs each to progressively tune, optimize and scale
 Query speeds
• Response time < 1 sec on WiFi; longer if images uploaded over 3G/LTE
 Integration with your Mobile App
• Via integration with RESTful APIs + additional supporting app logic
27

Discussion & Next Steps
Contact us at | inquiry@regalix-inc.com | Phone: 650-331-1167
28

Co-innovate with Visual Search to Launch New Products

Recommended

Recommended

More Related Content

Similar to Co-innovate with Visual Search to Launch New Products

Similar to Co-innovate with Visual Search to Launch New Products (20)

More from Regalix

More from Regalix (20)

Recently uploaded

Recently uploaded (20)

Co-innovate with Visual Search to Launch New Products