WDC Vision Services is the technology suite which enables customers to find new insight, derive significant value, and take meaningful action on visual information of any kind.
Learn more about these services.
AlchemyVision: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/alchemy-vision.html
Visual Insights: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-insights.html
Visual Recognition: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-recognition.html
3. 3
WDC Vision Services is the
technology suite which enables
customers to find new insight, derive
significant value, and take
meaningful action on visual
information of any kind.
4. Vision Services are available on IBM Watson Developer Cloud!
4
General Availability Experimental BETA (GA Q1 2016)
5. 5
Use Cases by API Building Block
Image Tagging
Text from
images
Visual
Learning
Facial
Detection
Link extraction
Similarity
Search
Visual Insights
AlchemyVision (beta)
Use Case: “Tell me If there is a person is in this picture so that I can identify them
AlchemyVision
Use case: “Get the most relevant image off of this website URL”
Visual Insights (experimental)
Use Case: “Tell me common themes contained in this group of images”
AlchemyVision
Use Case: “Give me natural language which describes this image ”
AlchemyVision (beta)
Use Case: “Transcribe any text or natural language contained in this image”
AlchemyVision
Use Case: “Find other images similar to this image”
VisualRecognition (beta)
Use Case: “Learn about my custom content in this image as a unique classifier”
6. Use Watson Vision to answer these questions
6
• What is this a picture/video/image of?
• Which ones and how many pictures/videos/images do I have which are
similar to this one?
• What is the relevance to my bottom line of using one image vs. another
image?
• What are the common themes in this batch of 1MM photos?
• Is this ship a known entity?
• What is my audience interested in?
• What user-generated content matches which products I sell?
• Which images will resonate best in a marketing campaign?
• Which image should I feature on my front page of my app?
8. WDC Vision Services takes images and matches them with known tags
and classifiers.
8
1. Input image 2. Train image in classifier 3. Output classifier likelihood
2a. Image is
expressed as
RGB values for
set of pixels
2b. Values
converted into
highly dimensional
representation
(features)
2c. Features are
either mapped
positively or
negatively to
classifier
10. Branding Strategy
Design more efficient
promotions & campaigns
Brand sentiment analysis
Campaign performance
improvements
Audience segmentation
Personalized advertising
by offering individualized
value
Campaign creation image
search
*Diagnostic assistance
*Voice of the patient
*Suicide Prevention
*Care givers & patients
matching
Customer Segmentation
and Promotions
Product Search
Conversion optimization
Review analysis and user-
generated content
placement
Extract life-changing
events from social media
for reengagement
campaigns
Finance
Use Cases By Industry
* In grey are listed use cases that we still need to develop with your help
Marketing +
Advertising
Brand
Analytics Healthcare* Retail Finance
10
11. Industry Use cases: detail
Solution
Play
Commerce IoT / Geo-Spatial Healthcare Security
High Level
Descriptio
n
Conversion improvements for
clients with consumer facing
products and services.
Auditing need for action from
physical location of things.
Driving speed and reliability
of medial diagnosis on
individual and group scale.
Improving security of
transactions and facilities
leveraging visual data.
Vision
Offering:
Solution
Package
- Visual Recognition API
- Visual Insight API
- Social media integration
- IBM Commerce integration
(*in development)
- Visual Recognition API
- Visual Insight API
- Weather Channel data
integration
- Video Analytics
- Trigger-event alerting
- Solution Architecture
- Visual Recognition API
- Watson Health / Merge
Integration
- HIPPA Compliance
- Visual Recognition API
- Visual Insight API
- Facial Recognition
- Video Analytics
- Trigger-event alerting
- PII compliant
Use Cases • Social Commerce (Analyze
social images for improved
engagement and conversion.)
• Contextual Ad placement
(tell me what this content is
about so I can place relevant
ads)
• Audience Segmentation
(Extract customer
demographic, and interests so
I can created targeted
campaigns)
• Visual Search / Find Similar
(surface like products from
broad inventory to increase
conversion)
• Market Research (Inform
me of global changes in
weather or other physicality
changes which can impact
my local business)
• Auditing (Alert me when
physical items are out of
compliance or have a state
change which requires
intervention)
• Operational Efficiency (tell
me where I should drill for oil
based on geographic
patterns)
• Diagnosis (Inform me if a
patient has an abnormality
that requires follow up)
• Research (find patterns in
groups of images to inform
me of insights)
• Accessibility (Help me
“see” the world better if I
am visually impaired)
• Authentication (Ensure
that personal
transactions are being
made by the
authenticated individual
ex: Samsung payments)
• Physical Site Security
(Alert me when
abnormalities are
happening in a secure
facility)
Future Development
12. Commerce Use Cases: Deep Dive
Domain Solution Pattern Use Cases Example
Target
Customers
Marketing Visual Recognition:
Custom Learning
Visual Insights: Audience
Segmentation
Visual Recognition
Visual Recognition:
Personalization
Use Case #1: Identify my logo in social media posts so that I can
understand ROI of marketing activities
Use Case #2: Extract customer demographic, emotions, and interests
so I can created targeted campaigns
Use Case #3: Tell me what this user-posted is about so that I can
organize and place in an appropriate place on my product reviews
Use Case #4: Which image should I use to drive the best conversion
for click-through?
Conversion
Optimization
Visual Recognition:
Similar Images
Visual Recognition:
Similar Images
Use Case #1: Find similar products to offer to my customer to
increase conversion.
Use Case #2: Watsonize product search and search for products
based on images captured.
Purchase and
Authentication
Visual Recognition:
Custom Learning &
Facial Recognition
Use Case #1: Watsonize a banks mobile app leveraging facial
recognition for authentication.
IBM
16. CrowdFlower classifies images and organizes data
CrowdFlower trains Visual Recognition to turn big data into rich data that is useful
Need
Save time determining what is
going on in images
Organize photos and classify
them
Solution
Human-curated training models
using rich data to determine if
humans are present in photos
or in medical cases, determine
if tumors are present in photos
Benefits
Reduce human effort and time
categorizing photos
Streamline data enrichment and
classify accurately
16
17. Ad Agency transforms everyday photos into marketing content
An ad agency harnesses the power of Visual Recognition to categorize and recommend photos posted on
Social Media channels for marketers
Need
Derive context within photos
Intelligently categorize photos
based on a variety of criteria
Solution
A sophisticated
recommendation algorithm to
provide relevant user
generated content for brands to
use in marketing
Benefits
Identify top brand influencers
Personalize marketing and ad
campaigns with user created images
Increased marketing ROI
17
18. A retailer recommends products based on customer taste
Retailers can train Watson through customer’s history searches and product catalog
Need
Provide visually similar product
recommendations for existing
catalog
Provide personalized shopping
experience
Solution
Spidering retailer website and
extracting and indexing product
information and photos into an
AlchemyVision instance
Benefits
Enhanced faceted search capability
(ex. “Show me dresses under $50
that look like this one”)
Avoid cold start problem common in
many recommendation engines (ex.
Recently added products to the
catalog)
18
20. Support for WDC Vision Services Engagements
1) Watson Developer Cloud
1) AlchemyVision
http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/alchemy-vision.html
2) Visual Recognition
http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-recognition.html
3) Visual Insights
http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-insights.html
• Documentation about WDC Vision APIs on WDC
• Live demonstrations and demo scripts
• Videos
3) Contact our team
Alyssa Simpson
Senior Offering Manager:
Watson Vision
sasimpson@us.ibm.com
Rahul Singhal
Program Director: IBM Watson
Product
Management & Strategy
John Smith
IBM Fellow
IBM Research
Devin Harper
Dev Team Lead: Watson
Vision