SlideShare a Scribd company logo
1 of 33
Download to read offline
IBM Social Media Analytics 1.2
A Big Data Application
Presenter Dillip Kumar Majhi –Bigdata And Social Analytics Solution Architect
Agenda
 The scope of social media analytics
 Demo
 IBM Social Media Analytics: Architecture and Framework
 Filtering the noise: configuring relevant social media analytics
 A deeper look at some of SMA‘s built-in analytics capabilities
2
 A deeper look at some of SMA‘s built-in analytics capabilities
 No silos: Integrating Social into a 360 degree customer view
 Our successful journey to „Application as a Service“
“Social Business” – more than just a facebook page
Uses for social business1
Respond to
customer questions
Capture
customer data
78%
60%
79%
55%
3
33 3
Source: Institute for Business Value; Business of Social Business Study, 1 Based on responses from individuals having personal experience with customer-related social business
activities (n = 599)
Solicit customer
reviews and opinions
customer data
Identify and manage
key influencers
Today Next two years
79%
71%
44%
69%
37%
Cognos Consumer Insight 1.1
IBM Social Media Analytics 1.2
Cognos Consumer Insight 1.1
IBM Social Media Analytics 1.2
Organizations are moving beyond promotion towards driving
sales and support
Promote events/
marketing campaigns
Generate sales leads
and revenue
83%
71%
74%
51%
4
4
Provide product and
services support
Sell products directly
to customers
Today Next two years
69%
46%
61%
35%
Source: Institute for Business Value; Business of Social Business Study, 1 Based on responses from individuals having personal experience with customer-related social business
activities (n = 599)
Cognos Consumer Insight 1.1
IBM Social Media Analytics 1.2
IBM Social Media Analytics (SMA) targets many Business Issues -
driving actions, not just listening
What are your
How can I identify sales
leads ?
Marketing
SalesAre my suppliers
getting a bad
reputation?
Supply ChainSupply Chain
5
What are your
questions?
How do
consumers feel
about our new
messages / ads?
What are emerging
customer questions to
prime our call center
agents with?
Customer Service
5
What features are our
customers asking for?
Product Development
A Social Media Analytics application requires more than
Analytics
Deliver results
to more than
one employee
Provide meaningful
Social Media Metrics
Take IT
out of the picture
for daily operation
6
Text Analytics
- Detect Brands, Products
- Sentiment
- Author Geo, Demographics,
Behavior Collection Analysis
- Detect emerging topics
in Social Media
Statistics
- Automatically discover
relationships& affinities
Influencer
Identification
Agenda
 The scope of social media analytics
 Demo
 IBM Social Media Analytics: Architecture and Framework
 Filtering the noise: configuring relevant social media analytics
 A deeper look at some of SMA‘s built-in analytics capabilities
7
 A deeper look at some of SMA‘s built-in analytics capabilities
 No silos: Integrating Social into a 360 degree customer view
 Our successful journey to „Application as a Service“
Demo Scenario: Addressing new customer segments for a grocery store
 Business problem: Imagine you‘re Wegmans...
 ...and you want to enhance your market positioning
around „healthy foods“
 Approach: Analyze competitors, as well as some key aspects of shopping experience in
8
 Approach: Analyze competitors, as well as some key aspects of shopping experience in
social media
Start: SMA Welcome Page
All your analysis
projects in one place
9
Save and share
configurations across
projectsLaunch the
relevant UI
SMA Reporting Application Dynamically select
analysis criteria
1
Guided
Navigation
according to
Social Media
Framework Individual KPIs
Share of Voice – Check the overall „Brand Health“
I (Wegmans) „lag“
behind my peers
in this space
1
Less positive
sentiment, compared
to peers
Certainly room for
improvement
Reach – what are the Top 10 sites where people talk?
Twitter? No surprise –
What‘s tripadvisor
doing here – and why
am I missing?
1
Twitter? No surprise –
let‘s focus on other
sources....
Proximity to a „Healthy Food“ store is seen as a plus:
The underlying data is always only
one click away
1
Start co-marketing activities with certain hotels to pull
„healthy food“ shoppers to nearby Wegmans locationsAction
Sanity check – are there certain aspects of the shopping
experience we should improve?
Narrow down to a
certain aspect
Positive/Negative
1
Positive/Negative
sentiment ratio
significantly worse
Product
recall
Store
Layout
Shaping my message: who‘s talking – and about what ?
1
More females talking
around „healthy food“
stores, but sizeable
number of men as well
Overall themes the
same, but with different
priority
Understanding what aspects actual shoppers talk about
Trader Joe‘s shoppers
significantly different
See „actual shoppers“
for further engagement
1
Evolving Topics – identify & react to the unexpected
1
Topics in social media
over time, automatically
identified by SMA
Action
Check supply chain to pro-actively
avoid this problem
Agenda
 The scope of social media analytics
 Demo
 IBM Social Media Analytics: Architecture and Framework
 Filtering the noise: configuring relevant social media analytics
 A deeper look at some of SMA‘s built-in analytics capabilities
1
 A deeper look at some of SMA‘s built-in analytics capabilities
 No silos: Integrating Social into a 360 degree customer view
 Our successful journey to „Application as a Service“
ReportingAdministration Analysis
Welcome Page
Project
Project
Project
Project
Security
Multi-
tenancy
SSO
1
19
Analytics Platform
Message boards
Blogs
News
Cognos 10.1.1Text Analytics
IBM BigInsights 1.3
Search
Index
RDBMS g DB
Twitter
Evolving Topics
Facebook
Reviews
Video
Project
Project
Security
E2E Orchestration
Influencer
Identification
SMA Analytics Pipeline – deeper dive
Fetched
Data
(Json)
Document Analysis
 Identify Concept mentions
 Detect Sentiment
 Extract Author Location,
Demographics, Behavior
Evolving Topics
 Topic detection
 Assignment of
Mentions to Topics
Analysis
Results
(CSV +
Json)
BigInsights Orchestrator Job definition
SMA Flowmanager Job definition
2
 Document Analysis & Evolving Topics are running in BigInsights
 Document Analysis: Jaql scripts for document preprocessing + BigInsights
text
analysis rule engine (actual text analysis rules are part of SMA)
 Evolving Topics: Jaql scripts for document pre/postprocessing +
Java algorithm for topic detection
 Processing phases triggered through a 2-level workflow:
BigInsights Orchestrator for steps within Hadoop, SMA „FlowManager“ for
E2E orchestration (e.g., including „data in + data out“ steps)
SMA Flowmanager Job definition
Whatever we do – our users must not need to care
2
Hadoop, DB2, Cognos,...
totally transparent to analysts
- they just work with
SMA Administration
Results delivered at the right time
 CCI 1.1 provided the capability to update social media content once per day
 Some use cases call for a higher update frequency:
– Identifying sales leads
– Monitoring of an ongoing campaign or event
– Identifying 1:1 customer engagement opportunities
 SMA 1.2 provides additional update frequencies
– every 20 minutes
– every 2 hours
2
– every 2 hours
 All trend reports support a breakdown on „hour“ level
 Create Cognos alerts for „author with Klout score > 80 expresses negative sentiment about
us“
Agenda
 The scope of social media analytics
 Demo
 IBM Social Media Analytics: Architecture and Framework
 Filtering the noise: configuring relevant social media analytics
 A deeper look at some of SMA‘s built-in analytics capabilities
2
 A deeper look at some of SMA‘s built-in analytics capabilities
 No silos: Integrating Social into a 360 degree customer view
 Our successful journey to „Application as a Service“
The challenge in Social Media....
OBI in the German DIY world OBI in the rest of the world
2
OBI in the German DIY world OBI in the rest of the world
Persil for Germans
Persil for the French
All Social
Media
Data
fetcher
Keyword QueriesConfigure
1
Our approach: a multi-level „relevance funnel“
Relevant Blog ,
Board , Video
2
Analysis
 Flexible Type/Concept
hierarchy
 Text Analysis Patterns
Analyze
2
Board , Video
entries…
Product X
Product y
Product Z
Configuration Experience
Word lists and
regular
expressions define
a particular
concept
2
„Types“ and „Concepts“ define the
scope of the analysis – anything from
brands to products to services to
events to customer touchpoints to...
Include terms „make up“
the concept
Exclude terms „rule out “
irrelevant meanings
Context terms describe
relevant contexts
Agenda
 The scope of social media analytics
 Demo
 IBM Social Media Analytics: Architecture and Framework
 Filtering the noise: configuring relevant social media analytics
 A deeper look at some of SMA‘s built-in analytics capabilities
2
 A deeper look at some of SMA‘s built-in analytics capabilities
 No silos: Integrating Social into a 360 degree customer view
 Our successful journey to „Application as a Service“
Approach: Multi-lingual, rule-based, deep natural language
processing
 All our analysis capabilities are provided for multiple languages and multiple data
sources
– There‘s value beyond English tweets
 SMA uses the BigInsights text analysis engine for base text processing, and runs
SMA‘s text analysis rule resources in this engine for „our“ capabilities
My Nikon D5000 doesn‘t work well in fuzzy light conditions. Text
[My] [Nikon] [D5000] [does] [n‘t] [work] [well] [in] [fuzzy] [light] [conditions] Tokens
Part-of-SpeechPP NP NP VAUX NEG VB ADV PREP ADJ NN NN
[My Nikon D5000] [doesn‘t work well] [in fuzzy light conditions]. Syntax Analysis
[My Nikon D5000] doesn‘t work well in fuzzy light conditions. Behavior
[My Nikon D5000 doesn‘t work well] in fuzzy light conditions. Sentiment
BigInsights
SMA
Identifying author behavior in English, German, Spanish, French
 Users of a certain product or service
– What product features are relevant for them?
 Recommenders
– E.g., authors mentioning „you should use X“
 Detractors
– e.g. authors mentioning „stay away from X“
2
e.g. authors mentioning „stay away from X“
 Prospective users
– Potential sales leads for 1:1 engagement
– Identify sites where prospective users congregate
SMA as a service
 Hosted on SmartCloud Enterprise+
 Every customer has their own SMA deployment
 SLA: maximum of 2 days between „custom places order“ and „customer
receives URL to their SMA welcome page“
 Pricing according to the number of social media documents a customer
3
Pricing according to the number of social media documents a customer
retrieves per month
 Besides the user interfaces, customers can also access the SMA Social
Warehouse to integrate SMA data into their local business processes
– Through ODBC over SSL
Summary
 IBM Social Media Analytics targets multiple use cases in marketing, sales, PR,
customer service and product development
– Our Social Media Framework helps to map the right KPIs to a particular use case
 IBM Social Media Analytics is an integrated analytic application, harnessing „best
of breed“ IBM products
– Using the IBM Big Data platform for content processing
– Easy access to insights through Social Media Warehouse and Cognos BI
– Optimized data access for predictive analytics
3
– Optimized data access for predictive analytics
– Sentiment detection in English, French, German, Spanish, Dutch and Chinese
(Simplified and Traditional)
– Extracting Geographic, Demographic and Behavioral data for Social Media Authors in
English, French, German and Spanish
 „Becoming SaaS“ did not only change the way we do installation: it changed our
mindset on things like „performance“, „ease of maintenance“, „migration to new
versions“,... (and will continue to do so)
To find out more...
 External:
http://www-01.ibm.com/software/analytics/solutions/customer-analytics/social-media-analytics/
 Product videos (tech, not marketing) – also external
http://ibmtvdemo.edgesuite.net/software/analytics/cognos/videos/HTVs/sma-1-2/index.html
 „Sales Kit“ with Demos, Resources,...
3
 „Sales Kit“ with Demos, Resources,...
https://w3-03.sso.ibm.com/software/xl/portal/content?synKey=Q420240R36382M68#overview
 Integrating SMA data with BI and Predictive Analytics
http://www-01.ibm.com/support/docview.wss?uid=swg27038638
3
33

More Related Content

What's hot

GGV Capital: Venture Investing and the Cloud (2012)
GGV Capital: Venture Investing and the Cloud (2012)GGV Capital: Venture Investing and the Cloud (2012)
GGV Capital: Venture Investing and the Cloud (2012)GGV Capital
 
Big Data Analytics and its Application in E-Commerce
Big Data Analytics and its Application in E-CommerceBig Data Analytics and its Application in E-Commerce
Big Data Analytics and its Application in E-CommerceUyoyo Edosio
 
Big data for sales and marketing people
Big data for sales and marketing peopleBig data for sales and marketing people
Big data for sales and marketing peopleEdward Chenard
 
How to identify the Return on Investment of Big Data
How to identify the Return on Investment of Big DataHow to identify the Return on Investment of Big Data
How to identify the Return on Investment of Big DataJose Pablo Fernandez
 
Worst practices in Business Intelligence setup
Worst practices in Business Intelligence setupWorst practices in Business Intelligence setup
Worst practices in Business Intelligence setupThe Marketing Distillery
 
Dark Data Revelation and its Potential Benefits
Dark Data Revelation and its Potential BenefitsDark Data Revelation and its Potential Benefits
Dark Data Revelation and its Potential BenefitsPromptCloud
 
Leveraging Service Computing and Big Data Analytics for E-Commerce
Leveraging Service Computing and Big Data Analytics for E-CommerceLeveraging Service Computing and Big Data Analytics for E-Commerce
Leveraging Service Computing and Big Data Analytics for E-CommerceKarthikeyan Umapathy
 
Emergence of Big Data in Digital Marketing
Emergence of Big Data  in Digital MarketingEmergence of Big Data  in Digital Marketing
Emergence of Big Data in Digital MarketingKrishnan Parasuraman
 
Capitalize On Social Media With Big Data Analytics
Capitalize On Social Media With Big Data AnalyticsCapitalize On Social Media With Big Data Analytics
Capitalize On Social Media With Big Data AnalyticsHassan Keshavarz
 
Big Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceDavid Feinleib
 
exploit_big_data_v1
exploit_big_data_v1exploit_big_data_v1
exploit_big_data_v1Attila Barta
 
Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data DATAVERSITY
 
What Does 2018 Have In Store For The Big Data Industry
What Does 2018 Have In Store For The Big Data IndustryWhat Does 2018 Have In Store For The Big Data Industry
What Does 2018 Have In Store For The Big Data IndustryPromptCloud
 
Hidden security and privacy consequences around mobility (Infosec 2013)
Hidden security and privacy consequences around mobility (Infosec 2013)Hidden security and privacy consequences around mobility (Infosec 2013)
Hidden security and privacy consequences around mobility (Infosec 2013)Huntsman Security
 
Web Scraping reveals top tech trends and company’s media mentions in 2017
Web Scraping reveals top tech trends and company’s media mentions in 2017Web Scraping reveals top tech trends and company’s media mentions in 2017
Web Scraping reveals top tech trends and company’s media mentions in 2017PromptCloud
 

What's hot (20)

GGV Capital: Venture Investing and the Cloud (2012)
GGV Capital: Venture Investing and the Cloud (2012)GGV Capital: Venture Investing and the Cloud (2012)
GGV Capital: Venture Investing and the Cloud (2012)
 
Big Data Analytics and its Application in E-Commerce
Big Data Analytics and its Application in E-CommerceBig Data Analytics and its Application in E-Commerce
Big Data Analytics and its Application in E-Commerce
 
Big data for sales and marketing people
Big data for sales and marketing peopleBig data for sales and marketing people
Big data for sales and marketing people
 
The ABCs of Big Data
The ABCs of Big DataThe ABCs of Big Data
The ABCs of Big Data
 
How to identify the Return on Investment of Big Data
How to identify the Return on Investment of Big DataHow to identify the Return on Investment of Big Data
How to identify the Return on Investment of Big Data
 
Worst practices in Business Intelligence setup
Worst practices in Business Intelligence setupWorst practices in Business Intelligence setup
Worst practices in Business Intelligence setup
 
Dark Data Revelation and its Potential Benefits
Dark Data Revelation and its Potential BenefitsDark Data Revelation and its Potential Benefits
Dark Data Revelation and its Potential Benefits
 
Leveraging Service Computing and Big Data Analytics for E-Commerce
Leveraging Service Computing and Big Data Analytics for E-CommerceLeveraging Service Computing and Big Data Analytics for E-Commerce
Leveraging Service Computing and Big Data Analytics for E-Commerce
 
Emergence of Big Data in Digital Marketing
Emergence of Big Data  in Digital MarketingEmergence of Big Data  in Digital Marketing
Emergence of Big Data in Digital Marketing
 
National Conference - Big Data - 31 Jan 2015
National Conference - Big Data - 31 Jan 2015National Conference - Big Data - 31 Jan 2015
National Conference - Big Data - 31 Jan 2015
 
Capitalize On Social Media With Big Data Analytics
Capitalize On Social Media With Big Data AnalyticsCapitalize On Social Media With Big Data Analytics
Capitalize On Social Media With Big Data Analytics
 
Making sense of consumer data
Making sense of consumer dataMaking sense of consumer data
Making sense of consumer data
 
Big Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 Conference
 
exploit_big_data_v1
exploit_big_data_v1exploit_big_data_v1
exploit_big_data_v1
 
Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data
 
Big Data Analytics
Big Data AnalyticsBig Data Analytics
Big Data Analytics
 
What Does 2018 Have In Store For The Big Data Industry
What Does 2018 Have In Store For The Big Data IndustryWhat Does 2018 Have In Store For The Big Data Industry
What Does 2018 Have In Store For The Big Data Industry
 
Hidden security and privacy consequences around mobility (Infosec 2013)
Hidden security and privacy consequences around mobility (Infosec 2013)Hidden security and privacy consequences around mobility (Infosec 2013)
Hidden security and privacy consequences around mobility (Infosec 2013)
 
Web Scraping reveals top tech trends and company’s media mentions in 2017
Web Scraping reveals top tech trends and company’s media mentions in 2017Web Scraping reveals top tech trends and company’s media mentions in 2017
Web Scraping reveals top tech trends and company’s media mentions in 2017
 
Big data analytics
Big data analyticsBig data analytics
Big data analytics
 

Similar to Bigdata and Social Media Analytics

Social Insight into Action: Integrating social media intelligence into busine...
Social Insight into Action: Integrating social media intelligence into busine...Social Insight into Action: Integrating social media intelligence into busine...
Social Insight into Action: Integrating social media intelligence into busine...default default
 
Creating a Content Strategy Ecosystem
Creating a Content Strategy EcosystemCreating a Content Strategy Ecosystem
Creating a Content Strategy EcosystemAndrea L. Ames
 
Social Intelligence 2014
Social Intelligence 2014Social Intelligence 2014
Social Intelligence 2014Stratebi
 
Strategic thinking for a digital age
Strategic thinking for a digital ageStrategic thinking for a digital age
Strategic thinking for a digital ageOmar Khan
 
New product launch solution
New product launch solutionNew product launch solution
New product launch solutionNetBase
 
Unlocking Social CRM for your Organisation (Keynote)
Unlocking Social CRM for your Organisation (Keynote)Unlocking Social CRM for your Organisation (Keynote)
Unlocking Social CRM for your Organisation (Keynote)Joakim Nilsson
 
How to Identify Relevant Product KPIs by Roomgo Head of Product
How to Identify Relevant Product KPIs by Roomgo Head of ProductHow to Identify Relevant Product KPIs by Roomgo Head of Product
How to Identify Relevant Product KPIs by Roomgo Head of ProductProduct School
 
Mastering Social Media: Workshop 1 Exercises
Mastering Social Media: Workshop 1 ExercisesMastering Social Media: Workshop 1 Exercises
Mastering Social Media: Workshop 1 ExercisesHamill Associates Ltd
 
Final Presentation - SAP
Final Presentation - SAPFinal Presentation - SAP
Final Presentation - SAPvineet sharma
 
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...JK Tech
 
IBM Cognos Social Media Analytic Solution - G A InfoMart
IBM Cognos Social Media Analytic Solution - G A InfoMartIBM Cognos Social Media Analytic Solution - G A InfoMart
IBM Cognos Social Media Analytic Solution - G A InfoMartGA InfoMart Ltd
 
Narrative Mind Week 7 H4D Stanford 2016
Narrative Mind Week 7 H4D Stanford 2016Narrative Mind Week 7 H4D Stanford 2016
Narrative Mind Week 7 H4D Stanford 2016Stanford University
 
Social media analytics powered by data science
Social media analytics powered by data scienceSocial media analytics powered by data science
Social media analytics powered by data scienceNavin Manaswi
 
From an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startupsFrom an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startupsGeorge Krasadakis
 
Synthesio book signing marshall sponder - delivered
Synthesio book signing    marshall sponder - deliveredSynthesio book signing    marshall sponder - delivered
Synthesio book signing marshall sponder - deliveredMarshall Sponder
 

Similar to Bigdata and Social Media Analytics (20)

Social Insight into Action: Integrating social media intelligence into busine...
Social Insight into Action: Integrating social media intelligence into busine...Social Insight into Action: Integrating social media intelligence into busine...
Social Insight into Action: Integrating social media intelligence into busine...
 
Creating a Content Strategy Ecosystem
Creating a Content Strategy EcosystemCreating a Content Strategy Ecosystem
Creating a Content Strategy Ecosystem
 
XL PPTX
XL PPTXXL PPTX
XL PPTX
 
Social Intelligence 2014
Social Intelligence 2014Social Intelligence 2014
Social Intelligence 2014
 
BIG DATA AND RETAIL
BIG DATA AND RETAILBIG DATA AND RETAIL
BIG DATA AND RETAIL
 
Strategic thinking for a digital age
Strategic thinking for a digital ageStrategic thinking for a digital age
Strategic thinking for a digital age
 
New product launch solution
New product launch solutionNew product launch solution
New product launch solution
 
Unlocking Social CRM for your Organisation (Keynote)
Unlocking Social CRM for your Organisation (Keynote)Unlocking Social CRM for your Organisation (Keynote)
Unlocking Social CRM for your Organisation (Keynote)
 
Proposal
ProposalProposal
Proposal
 
How to Identify Relevant Product KPIs by Roomgo Head of Product
How to Identify Relevant Product KPIs by Roomgo Head of ProductHow to Identify Relevant Product KPIs by Roomgo Head of Product
How to Identify Relevant Product KPIs by Roomgo Head of Product
 
Mastering Social Media: Workshop 1 Exercises
Mastering Social Media: Workshop 1 ExercisesMastering Social Media: Workshop 1 Exercises
Mastering Social Media: Workshop 1 Exercises
 
Final Presentation - SAP
Final Presentation - SAPFinal Presentation - SAP
Final Presentation - SAP
 
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
[AI Webinar Series P1] - How Advanced Text Analytics Can Increase the Operati...
 
IBM Cognos Social Media Analytic Solution - G A InfoMart
IBM Cognos Social Media Analytic Solution - G A InfoMartIBM Cognos Social Media Analytic Solution - G A InfoMart
IBM Cognos Social Media Analytic Solution - G A InfoMart
 
Social intelligence
Social intelligenceSocial intelligence
Social intelligence
 
Narrative Mind Week 7 H4D Stanford 2016
Narrative Mind Week 7 H4D Stanford 2016Narrative Mind Week 7 H4D Stanford 2016
Narrative Mind Week 7 H4D Stanford 2016
 
Social media analytics powered by data science
Social media analytics powered by data scienceSocial media analytics powered by data science
Social media analytics powered by data science
 
dabblr_report_final
dabblr_report_finaldabblr_report_final
dabblr_report_final
 
From an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startupsFrom an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startups
 
Synthesio book signing marshall sponder - delivered
Synthesio book signing    marshall sponder - deliveredSynthesio book signing    marshall sponder - delivered
Synthesio book signing marshall sponder - delivered
 

Bigdata and Social Media Analytics

  • 1. IBM Social Media Analytics 1.2 A Big Data Application Presenter Dillip Kumar Majhi –Bigdata And Social Analytics Solution Architect
  • 2. Agenda  The scope of social media analytics  Demo  IBM Social Media Analytics: Architecture and Framework  Filtering the noise: configuring relevant social media analytics  A deeper look at some of SMA‘s built-in analytics capabilities 2  A deeper look at some of SMA‘s built-in analytics capabilities  No silos: Integrating Social into a 360 degree customer view  Our successful journey to „Application as a Service“
  • 3. “Social Business” – more than just a facebook page Uses for social business1 Respond to customer questions Capture customer data 78% 60% 79% 55% 3 33 3 Source: Institute for Business Value; Business of Social Business Study, 1 Based on responses from individuals having personal experience with customer-related social business activities (n = 599) Solicit customer reviews and opinions customer data Identify and manage key influencers Today Next two years 79% 71% 44% 69% 37% Cognos Consumer Insight 1.1 IBM Social Media Analytics 1.2 Cognos Consumer Insight 1.1 IBM Social Media Analytics 1.2
  • 4. Organizations are moving beyond promotion towards driving sales and support Promote events/ marketing campaigns Generate sales leads and revenue 83% 71% 74% 51% 4 4 Provide product and services support Sell products directly to customers Today Next two years 69% 46% 61% 35% Source: Institute for Business Value; Business of Social Business Study, 1 Based on responses from individuals having personal experience with customer-related social business activities (n = 599) Cognos Consumer Insight 1.1 IBM Social Media Analytics 1.2
  • 5. IBM Social Media Analytics (SMA) targets many Business Issues - driving actions, not just listening What are your How can I identify sales leads ? Marketing SalesAre my suppliers getting a bad reputation? Supply ChainSupply Chain 5 What are your questions? How do consumers feel about our new messages / ads? What are emerging customer questions to prime our call center agents with? Customer Service 5 What features are our customers asking for? Product Development
  • 6. A Social Media Analytics application requires more than Analytics Deliver results to more than one employee Provide meaningful Social Media Metrics Take IT out of the picture for daily operation 6 Text Analytics - Detect Brands, Products - Sentiment - Author Geo, Demographics, Behavior Collection Analysis - Detect emerging topics in Social Media Statistics - Automatically discover relationships& affinities Influencer Identification
  • 7. Agenda  The scope of social media analytics  Demo  IBM Social Media Analytics: Architecture and Framework  Filtering the noise: configuring relevant social media analytics  A deeper look at some of SMA‘s built-in analytics capabilities 7  A deeper look at some of SMA‘s built-in analytics capabilities  No silos: Integrating Social into a 360 degree customer view  Our successful journey to „Application as a Service“
  • 8. Demo Scenario: Addressing new customer segments for a grocery store  Business problem: Imagine you‘re Wegmans...  ...and you want to enhance your market positioning around „healthy foods“  Approach: Analyze competitors, as well as some key aspects of shopping experience in 8  Approach: Analyze competitors, as well as some key aspects of shopping experience in social media
  • 9. Start: SMA Welcome Page All your analysis projects in one place 9 Save and share configurations across projectsLaunch the relevant UI
  • 10. SMA Reporting Application Dynamically select analysis criteria 1 Guided Navigation according to Social Media Framework Individual KPIs
  • 11. Share of Voice – Check the overall „Brand Health“ I (Wegmans) „lag“ behind my peers in this space 1 Less positive sentiment, compared to peers Certainly room for improvement
  • 12. Reach – what are the Top 10 sites where people talk? Twitter? No surprise – What‘s tripadvisor doing here – and why am I missing? 1 Twitter? No surprise – let‘s focus on other sources....
  • 13. Proximity to a „Healthy Food“ store is seen as a plus: The underlying data is always only one click away 1 Start co-marketing activities with certain hotels to pull „healthy food“ shoppers to nearby Wegmans locationsAction
  • 14. Sanity check – are there certain aspects of the shopping experience we should improve? Narrow down to a certain aspect Positive/Negative 1 Positive/Negative sentiment ratio significantly worse Product recall Store Layout
  • 15. Shaping my message: who‘s talking – and about what ? 1 More females talking around „healthy food“ stores, but sizeable number of men as well Overall themes the same, but with different priority
  • 16. Understanding what aspects actual shoppers talk about Trader Joe‘s shoppers significantly different See „actual shoppers“ for further engagement 1
  • 17. Evolving Topics – identify & react to the unexpected 1 Topics in social media over time, automatically identified by SMA Action Check supply chain to pro-actively avoid this problem
  • 18. Agenda  The scope of social media analytics  Demo  IBM Social Media Analytics: Architecture and Framework  Filtering the noise: configuring relevant social media analytics  A deeper look at some of SMA‘s built-in analytics capabilities 1  A deeper look at some of SMA‘s built-in analytics capabilities  No silos: Integrating Social into a 360 degree customer view  Our successful journey to „Application as a Service“
  • 19. ReportingAdministration Analysis Welcome Page Project Project Project Project Security Multi- tenancy SSO 1 19 Analytics Platform Message boards Blogs News Cognos 10.1.1Text Analytics IBM BigInsights 1.3 Search Index RDBMS g DB Twitter Evolving Topics Facebook Reviews Video Project Project Security E2E Orchestration Influencer Identification
  • 20. SMA Analytics Pipeline – deeper dive Fetched Data (Json) Document Analysis  Identify Concept mentions  Detect Sentiment  Extract Author Location, Demographics, Behavior Evolving Topics  Topic detection  Assignment of Mentions to Topics Analysis Results (CSV + Json) BigInsights Orchestrator Job definition SMA Flowmanager Job definition 2  Document Analysis & Evolving Topics are running in BigInsights  Document Analysis: Jaql scripts for document preprocessing + BigInsights text analysis rule engine (actual text analysis rules are part of SMA)  Evolving Topics: Jaql scripts for document pre/postprocessing + Java algorithm for topic detection  Processing phases triggered through a 2-level workflow: BigInsights Orchestrator for steps within Hadoop, SMA „FlowManager“ for E2E orchestration (e.g., including „data in + data out“ steps) SMA Flowmanager Job definition
  • 21. Whatever we do – our users must not need to care 2 Hadoop, DB2, Cognos,... totally transparent to analysts - they just work with SMA Administration
  • 22. Results delivered at the right time  CCI 1.1 provided the capability to update social media content once per day  Some use cases call for a higher update frequency: – Identifying sales leads – Monitoring of an ongoing campaign or event – Identifying 1:1 customer engagement opportunities  SMA 1.2 provides additional update frequencies – every 20 minutes – every 2 hours 2 – every 2 hours  All trend reports support a breakdown on „hour“ level  Create Cognos alerts for „author with Klout score > 80 expresses negative sentiment about us“
  • 23. Agenda  The scope of social media analytics  Demo  IBM Social Media Analytics: Architecture and Framework  Filtering the noise: configuring relevant social media analytics  A deeper look at some of SMA‘s built-in analytics capabilities 2  A deeper look at some of SMA‘s built-in analytics capabilities  No silos: Integrating Social into a 360 degree customer view  Our successful journey to „Application as a Service“
  • 24. The challenge in Social Media.... OBI in the German DIY world OBI in the rest of the world 2 OBI in the German DIY world OBI in the rest of the world Persil for Germans Persil for the French
  • 25. All Social Media Data fetcher Keyword QueriesConfigure 1 Our approach: a multi-level „relevance funnel“ Relevant Blog , Board , Video 2 Analysis  Flexible Type/Concept hierarchy  Text Analysis Patterns Analyze 2 Board , Video entries… Product X Product y Product Z
  • 26. Configuration Experience Word lists and regular expressions define a particular concept 2 „Types“ and „Concepts“ define the scope of the analysis – anything from brands to products to services to events to customer touchpoints to... Include terms „make up“ the concept Exclude terms „rule out “ irrelevant meanings Context terms describe relevant contexts
  • 27. Agenda  The scope of social media analytics  Demo  IBM Social Media Analytics: Architecture and Framework  Filtering the noise: configuring relevant social media analytics  A deeper look at some of SMA‘s built-in analytics capabilities 2  A deeper look at some of SMA‘s built-in analytics capabilities  No silos: Integrating Social into a 360 degree customer view  Our successful journey to „Application as a Service“
  • 28. Approach: Multi-lingual, rule-based, deep natural language processing  All our analysis capabilities are provided for multiple languages and multiple data sources – There‘s value beyond English tweets  SMA uses the BigInsights text analysis engine for base text processing, and runs SMA‘s text analysis rule resources in this engine for „our“ capabilities My Nikon D5000 doesn‘t work well in fuzzy light conditions. Text [My] [Nikon] [D5000] [does] [n‘t] [work] [well] [in] [fuzzy] [light] [conditions] Tokens Part-of-SpeechPP NP NP VAUX NEG VB ADV PREP ADJ NN NN [My Nikon D5000] [doesn‘t work well] [in fuzzy light conditions]. Syntax Analysis [My Nikon D5000] doesn‘t work well in fuzzy light conditions. Behavior [My Nikon D5000 doesn‘t work well] in fuzzy light conditions. Sentiment BigInsights SMA
  • 29. Identifying author behavior in English, German, Spanish, French  Users of a certain product or service – What product features are relevant for them?  Recommenders – E.g., authors mentioning „you should use X“  Detractors – e.g. authors mentioning „stay away from X“ 2 e.g. authors mentioning „stay away from X“  Prospective users – Potential sales leads for 1:1 engagement – Identify sites where prospective users congregate
  • 30. SMA as a service  Hosted on SmartCloud Enterprise+  Every customer has their own SMA deployment  SLA: maximum of 2 days between „custom places order“ and „customer receives URL to their SMA welcome page“  Pricing according to the number of social media documents a customer 3 Pricing according to the number of social media documents a customer retrieves per month  Besides the user interfaces, customers can also access the SMA Social Warehouse to integrate SMA data into their local business processes – Through ODBC over SSL
  • 31. Summary  IBM Social Media Analytics targets multiple use cases in marketing, sales, PR, customer service and product development – Our Social Media Framework helps to map the right KPIs to a particular use case  IBM Social Media Analytics is an integrated analytic application, harnessing „best of breed“ IBM products – Using the IBM Big Data platform for content processing – Easy access to insights through Social Media Warehouse and Cognos BI – Optimized data access for predictive analytics 3 – Optimized data access for predictive analytics – Sentiment detection in English, French, German, Spanish, Dutch and Chinese (Simplified and Traditional) – Extracting Geographic, Demographic and Behavioral data for Social Media Authors in English, French, German and Spanish  „Becoming SaaS“ did not only change the way we do installation: it changed our mindset on things like „performance“, „ease of maintenance“, „migration to new versions“,... (and will continue to do so)
  • 32. To find out more...  External: http://www-01.ibm.com/software/analytics/solutions/customer-analytics/social-media-analytics/  Product videos (tech, not marketing) – also external http://ibmtvdemo.edgesuite.net/software/analytics/cognos/videos/HTVs/sma-1-2/index.html  „Sales Kit“ with Demos, Resources,... 3  „Sales Kit“ with Demos, Resources,... https://w3-03.sso.ibm.com/software/xl/portal/content?synKey=Q420240R36382M68#overview  Integrating SMA data with BI and Predictive Analytics http://www-01.ibm.com/support/docview.wss?uid=swg27038638
  • 33. 3 33