More Related Content Similar to Regalix ProductSnap (20) Regalix ProductSnap1. Regalix ProductSnap
Co-innovate with Companies to Launch New Products and Accelerate Revenue Growth
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
1
2. ProductSnap
Recognizes products from print collateral and product packaging when a user takes a
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
picture
Recognizes products from snapshots of 3D items (“ProductSnap 3D”) where reference
images from multiple perspectives are available
Optimizes product searching for the mobile user experience: photos instead of text
Links offline marketing spend with trackable mobile commerce
Provides valuable stream of trackable transaction & behavioral data
2
3. What is Visual Search?
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
3
4. Retail Example: “I like that hat!”
With Visual Search
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
4
One snap:
• more info
• quick purchase
• bookmark
• social integration
• comparison shop
• and more…
Hotspots = image + location + metadata
Nine West Hat
Large Brim Felt
Women
ID: 737624
5. Multiple Matches Possible from a Single Display
Single images may contain multiple
hotspots that are targets for discovering
related, online information
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
5
• Nine West Hat
• Large Brim Felt
• Women
• ID: 737624
Hotspots = image + location + metadata
• Pink Shawl
• Women
• ID: 637364
• Black belt
• Women
• ID: 923746
• Go boots
• Women
• ID: 923746
6. Visual Search User Flow
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
6
7. © 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
User Takes a
Photo: User can
focus in on a single
item within a multi-item
presentation
Photo is searched
against the
company’s
product database
User is taken to the
snapped item’s
detail page:
User can view reviews,
product bundles,
discounted specials,
and add the item to
their shopping cart
2
3
Visual Search User Flow
1
8. ProductSnap Applications and
Examples for your Mobile App
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
8
9. ProductSnap Applications
ProductSnap 2D - Customers can snap a picture from any promotional material such as catalogs, newspaper or
magazine inserts, posters, product packaging, in-store displays
ProductSnap 2D Pro - Customers can snap any promotional material or product packaging from any source, any
brand, any merchant to invoke comparative shopping from within Advertiser’s catalog, Affiliate-merchants or other
partners
ProductSnap 3D - Customers can snap products from in-store sections to learn, share and buy products
ProductSnap 3D Pro - Customers can snap products from within stores, at home or in other stores to invoke
comparative shopping from within Advertiser’s catalog, affiliate-merchants or other partners
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
10. Adding ProductSnap to Your Mobile App
Extend your mobile app with ProductSnap to additionally introduce:
• Search by photographing item [ProductSnap]
• Search by scanning barcode
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
10
11. Snap Item
Shopper can photograph item directly on the shelf at a physical store –
either one of your retail stores or even any other location, if you so
desire – by using your app.
Shopper can also switch to barcode scan view (for greater
precision/accuracy) if desired.
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
11
12. Product Matched
If the photographed item matches product images in your database,
ProductSnap can pull up the appropriate content (e.g., your product
page) and/or any related actions.
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
• Shopper can:
o ‘Like’ or bookmark the item
o Place the item in a wish-list
o Share the item on social networks
o Add the item to their shopping cart.
• Shopper can also:
o Scan a barcode
o Snap another photo
o Explore other items related to the matched product page.
12
13. Adding to Your Cart
Shopper can add the matched item to their online shopping
cart using your current app experience.
• Shopper can also continue shopping by:
• Snapping more photos
• Scanning more barcodes
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
13
14. Recognize Items from
Print Sources
User snaps a photo from
either your printed
catalog, signs, labels,
banners and billboards
to look up items online.
There they can learn
more about the item,
share it with friends, and
also purchase it.
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
14
Catalog Item Match
Once ProductSnap
identifies the item,
your user can be
taken to the snapped
item’s page on your
mobile site or app to
complete the
transaction
15. User can view item
details and choose
customizations --
sizes, colors, etc.,
based on availability
or inventory --
before completing
the transaction.
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
15
Extend Search to Partner
Sites
If the item is not found
in your own product
database, the user can
be given the option to
automatically search
your partner
catalog/sites for
matches.
Select Item Details
16. ProductSnap Visual Search Technology
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
16
17. Image
database
Metadata
database
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 17
Authoring
• Index any 2D image
• 3D matches possible with images
from many perspectives
• Virtual layers can be applied to
tag multiple items per image
• Assign online content
Indexing/Recognition
• Adding documents to your
image database
• Recognizing query images
• Hosted in the cloud
Client Apps
• User experience
• Delivery of online information
Main Elements of the Technology
18. What ProductSnap can Recognize
Products Logos Distinctive Clothing
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 18
19. ProductSnap Visual Search Platform
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
19
20. Visual Search Authoring: Content Association
Using our Web-based Portal, online content is associated with images
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
via “hotspots”
• Hotspot contains links to online content
• Link can be URL, video, audio, tweet, phone number, SMS, etc. or custom
type (JSON or XML string)
Two ways to create hotspots:
• Single hotspot per image
o Contains one or more links inside
• Multiple hotspots per Image
o Create unique experience in specific regions of image
o Each hotspot contains one or more links inside
Batch mode: use scripts to populate your content association database
• Upload images plus metadata content, e.g. XML
• Automatically generates single hotspot per image
20
Sample Image
Single Hotspot
Multiple Hotspots
21. Product Authoring: Assign Digital Experiences
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
21
Social
Coupons
Info
Info
Social
Games
eComm
Games
Video
Coupons
Info
GAME
Social
Info
22. Product Authoring: Deliver Digital Experiences
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
22
Info
Social
Games
23. ProductSnap Web Services Platform
RESTful APIs for indexing, recognition and metadata
Developers & Content
Owners
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
retrieval
Supports a variety of OS’s: Android, iOS, Windows,
desktop, etc.
Developers & content owners interact with Web-based
Portal to manage database
Client apps interact with fast Gateway servers to
submit queries and get results
Analytics can provide valuable data on usage patterns
23
Desktop
Feature
Phone
Client Apps
Windows 8 iPhone Android
24. Collection API: Recognition & Indexing
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
• Recognition:
o Captured query image submitted to server for recognition
o Server returns match result, includes unique identifier associated
with source image
Store API: Metadata Storage & Retrieval
• Unique identifier used to retrieve digital content associated with
source image
• Association done via authoring interface
• Developer controls end-user experience by formatting metadata in
the app
• Or, bypass Store server; connect directly to your own server
instead to retrieve metadata
24
ProductSnap API Descriptions
25. Your App Retains Full Control of Metadata and User Experience
1c
2b
2a
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
25
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
1b
Submit Image
via Collection API
Retrieve Metadata:
XML/JSON string
represents links to web
content or database
query
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
Present Content:
Metadata formatted for mobile
& integrated into UI
3
26. 3rd Party Data
1b
Submit Image 1c
2b
2a
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
26
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
via Collection API
Request from 3rd party:
Use unique label to request
metadata from 3rd party server
(e.g., eBay)
3a
3rd Party Web
Service
Retrieve Metadata:
XML/JSON string
represents links to web
content or database
query
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
Retrieve
Metadata
3b
Present Content:
Metadata formatted
for mobile &
integrated into UI
4
OP T IONAL
27. Common Implementation Questions
Index Creation Process / Scalability
• We can run scripts against a copy of your product DB or your API
• Currently supports >1MM images
• Recommendation: phase in by subsets of ~500k SKUs each to progressively tune, optimize and scale
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Query speeds
• Response time < 1 sec on WiFi; longer if images uploaded over 3G/LTE
Integration with your Mobile App
• Via integration with RESTful APIs + additional supporting app logic
27
28. Discussion & Next Steps
Contact us at | inquiry@regalix-inc.com | Phone: 650-331-1167
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
28