SlideShare a Scribd company logo
Mining Social Media for Product 
Development & Marketing Insights 
DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole
PROJECT BACKGROUND 
• Challenges 
– YMCA enjoys strong brand recognition among consumers – although many 
individuals do not know that the YMCA is a not-for-profit organization 
• Often cited as “..where I learned to swim” or “..where I went for summer camp” 
• No individual is turned away due to the inability to pay for services 
– Increased competition, changing lifestyles, and changing community 
demographics 
– Understanding the wants and needs of consumers via traditional market 
research techniques is costly 
• Opportunities 
– Social media helps organizations understand topics that are important to 
consumers 
– Big data tools and techniques offer the promise of timely, cost-effective 
insights across a wide range of consumers – current and prospective 
DePaul Big Data & NoSQL Programming - IPD 451 - Final 
Project Highlights | 11/12/14 | J. Cole 
2
Big Data Source – Twitter Hashtags 
• What is a hashtag? 
– Short link(s) preceded by the pound sign (#) 
– Organize and categorize discussions 
– Created/promoted by end-users and marketers 
– Started as a Twitter experiment and has evolved 
into a primary social media mechanism 
– Adopted by other social media outlets - 
Facebook, Pinterest, etc. 
• Accessing Twitter hashtags 
– Custom PHP script 
– Twitter’s Rest APIs  Twitter search API 
• Read and write Twitter data 
• Responses are available in JSON 
https://dev.twitter.com/rest/public/search 
Twitter Hashtags 
#learntoswim 
#swimming 
#swimminglessons 
#swimmingtips 
#kidsswimming 
#babyswim 
#swimtime 
#childdrensswimgames 
#swimmingworld 
#watersafety 
#waterconfidence 
#watergames 
#drowningprevention 
#learncpr 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
3
Data Details - Summary 
• Search across 14 hashtags 
– 11/4/14 – 11/9/14 
– Initial search results limited due to API 
rate limits 
• Reduced by ~10% after data cleanup 
• Foreign language characters 
• Inappropriate content 
• Obvious promotional content 
Twitter Hashtags 
#learntoswim 
#swimming 
#swimminglessons 
#swimmingtips 
#kidsswimming 
#babyswim 
#swimtime 
#childdrensswimgames 
#swimmingworld 
#watersafety 
#waterconfidence 
#watergames 
#drowningprevention 
#learncpr 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
4
Data Details – Search Results 
Query 
https://api.twitter.com/1.1/search/tweets.json?q=%23learntoswim+%20OR%23watersafety&count=100 
Results 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
5
Technology Stack 
• Twitter REST API v1.1 
• PHP 5.2 (custom script) 
• CSV files (for import/export into Mongodb, and import 
into Wordcloud generator) 
• Mongodb, mongoimport, mongoexport 
• Wordcloud generator (jason davies) 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
6
Analyzing the Data 
What are the trending topics for swimming within the selected hashtags? 
• By geography 
– Chicagoland 
– Illinois 
– USA 
• With YMCA references? 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
7
Trending Topics – Expressed via Wordcloud 
USA Illinois 
YMCA DePaul Big Data & NoSQL Programming - IPD 451 - Chicago 
Final Project Highlights | 11/12/14 | J. Cole 
8
Insights & Recommendations 
1. Maintain emphasis of water safety in YMCA aquatics social media 
activities 
– Water safety 
– Drowning prevention 
2. Conduct internal research regarding opportunities to promote 
aquatics offerings 
– “onemileswim” cited as “gateway” to triathlon preparation 
– Expanded parent/child swimming offerings 
3. Associate active hashtags into routine social media activities to 
further leverage social media momentum 
• #learntoswim 
• #swimming 
• #swimminglessons 
• #swimmingtips 
4. Integrate IBM’s BlueMix engine and custom apps for enhanced 
analysis of twitter stream sentiment 
DePaul Big Data & NoSQL Programming - IPD 451 - 
Final Project Highlights | 11/12/14 | J. Cole 
9
Q & A 
DePaul Big Data & NoSQL Programming - IPD 451 - Final 
Project Highlights | 11/12/14 | J. Cole 
10

More Related Content

Similar to Mining Social media for Product Development & Marketing Insights

Socialmedia driving Quality Improvement!
Socialmedia driving Quality Improvement!Socialmedia driving Quality Improvement!
Socialmedia driving Quality Improvement!
Maria de Lourdes
 
When technology hits the sidewalk empowering community residents through 21s...
When technology hits the sidewalk  empowering community residents through 21s...When technology hits the sidewalk  empowering community residents through 21s...
When technology hits the sidewalk empowering community residents through 21s...
Isaac Castillo
 
Prospect Research Using Social Data - Foundation Center, July 24, 2013
Prospect Research Using Social Data - Foundation Center, July 24, 2013Prospect Research Using Social Data - Foundation Center, July 24, 2013
Prospect Research Using Social Data - Foundation Center, July 24, 2013
Annie Lynsen
 
10ictprojectforsocialchange
10ictprojectforsocialchange10ictprojectforsocialchange
10ictprojectforsocialchange
YoonaIm6
 
Assessment of social media skills among vocational teachers in finland
Assessment of social media skills among vocational teachers in finlandAssessment of social media skills among vocational teachers in finland
Assessment of social media skills among vocational teachers in finland
Petri Linna
 
ePortfolios in 2012 (according to Don) - CAPLA version
ePortfolios in 2012 (according to Don) - CAPLA versionePortfolios in 2012 (according to Don) - CAPLA version
ePortfolios in 2012 (according to Don) - CAPLA version
Don Presant
 
Understanding and Building Social Capital
Understanding and Building Social CapitalUnderstanding and Building Social Capital
Understanding and Building Social Capital
Dean Shareski
 
How Oracle Uses CrowdFlower For Sentiment Analysis
How Oracle Uses CrowdFlower For Sentiment AnalysisHow Oracle Uses CrowdFlower For Sentiment Analysis
How Oracle Uses CrowdFlower For Sentiment Analysis
CrowdFlower
 
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGYEMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
giselleruiz29
 
DMP & DMPonline
DMP & DMPonlineDMP & DMPonline
DMP & DMPonline
Sarah Jones
 
Use Big Data to Improve Content Marketing
Use Big Data to Improve Content MarketingUse Big Data to Improve Content Marketing
Use Big Data to Improve Content Marketing
Pam Didner
 
Crisis Communications Online: Web and Social Media
Crisis Communications Online: Web and Social MediaCrisis Communications Online: Web and Social Media
Crisis Communications Online: Web and Social Media
Jeffrey Levy
 
Blended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup WeekBlended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup Week
StartupWeekDallas
 
Measurement Peer Group #4
Measurement Peer Group #4Measurement Peer Group #4
Measurement Peer Group #4
Beth Kanter
 
Data visualization and school finance
Data visualization and school financeData visualization and school finance
Data visualization and school finance
Lisa Marie Gonzales, Ed.D.
 
10 things every online business owner must know - EBriks Infotech
10 things every online business owner must know  - EBriks Infotech10 things every online business owner must know  - EBriks Infotech
10 things every online business owner must know - EBriks Infotech
EBriks Infotech Pvt. Ltd.
 
DMPTool / DLF Forum, Nov 1, 2011
DMPTool / DLF Forum, Nov 1, 2011DMPTool / DLF Forum, Nov 1, 2011
DMPTool / DLF Forum, Nov 1, 2011
University of California Curation Center
 
ICT Project for Social Change - Empowerment Technologies
ICT Project for Social Change - Empowerment TechnologiesICT Project for Social Change - Empowerment Technologies
ICT Project for Social Change - Empowerment Technologies
Mark Jhon Oxillo
 
PA Digital and the DPLA
PA Digital and the DPLAPA Digital and the DPLA
PA Digital and the DPLA
Keystone DH 2016
 
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
Jennifer Nini
 

Similar to Mining Social media for Product Development & Marketing Insights (20)

Socialmedia driving Quality Improvement!
Socialmedia driving Quality Improvement!Socialmedia driving Quality Improvement!
Socialmedia driving Quality Improvement!
 
When technology hits the sidewalk empowering community residents through 21s...
When technology hits the sidewalk  empowering community residents through 21s...When technology hits the sidewalk  empowering community residents through 21s...
When technology hits the sidewalk empowering community residents through 21s...
 
Prospect Research Using Social Data - Foundation Center, July 24, 2013
Prospect Research Using Social Data - Foundation Center, July 24, 2013Prospect Research Using Social Data - Foundation Center, July 24, 2013
Prospect Research Using Social Data - Foundation Center, July 24, 2013
 
10ictprojectforsocialchange
10ictprojectforsocialchange10ictprojectforsocialchange
10ictprojectforsocialchange
 
Assessment of social media skills among vocational teachers in finland
Assessment of social media skills among vocational teachers in finlandAssessment of social media skills among vocational teachers in finland
Assessment of social media skills among vocational teachers in finland
 
ePortfolios in 2012 (according to Don) - CAPLA version
ePortfolios in 2012 (according to Don) - CAPLA versionePortfolios in 2012 (according to Don) - CAPLA version
ePortfolios in 2012 (according to Don) - CAPLA version
 
Understanding and Building Social Capital
Understanding and Building Social CapitalUnderstanding and Building Social Capital
Understanding and Building Social Capital
 
How Oracle Uses CrowdFlower For Sentiment Analysis
How Oracle Uses CrowdFlower For Sentiment AnalysisHow Oracle Uses CrowdFlower For Sentiment Analysis
How Oracle Uses CrowdFlower For Sentiment Analysis
 
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGYEMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
EMETECH3 PRESENTATION EMPOWERMEN TECHNOLOGY
 
DMP & DMPonline
DMP & DMPonlineDMP & DMPonline
DMP & DMPonline
 
Use Big Data to Improve Content Marketing
Use Big Data to Improve Content MarketingUse Big Data to Improve Content Marketing
Use Big Data to Improve Content Marketing
 
Crisis Communications Online: Web and Social Media
Crisis Communications Online: Web and Social MediaCrisis Communications Online: Web and Social Media
Crisis Communications Online: Web and Social Media
 
Blended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup WeekBlended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup Week
 
Measurement Peer Group #4
Measurement Peer Group #4Measurement Peer Group #4
Measurement Peer Group #4
 
Data visualization and school finance
Data visualization and school financeData visualization and school finance
Data visualization and school finance
 
10 things every online business owner must know - EBriks Infotech
10 things every online business owner must know  - EBriks Infotech10 things every online business owner must know  - EBriks Infotech
10 things every online business owner must know - EBriks Infotech
 
DMPTool / DLF Forum, Nov 1, 2011
DMPTool / DLF Forum, Nov 1, 2011DMPTool / DLF Forum, Nov 1, 2011
DMPTool / DLF Forum, Nov 1, 2011
 
ICT Project for Social Change - Empowerment Technologies
ICT Project for Social Change - Empowerment TechnologiesICT Project for Social Change - Empowerment Technologies
ICT Project for Social Change - Empowerment Technologies
 
PA Digital and the DPLA
PA Digital and the DPLAPA Digital and the DPLA
PA Digital and the DPLA
 
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
January 16, 2014 -MICRO LESSON PROJECT(EDUC.TECH2)
 

Recently uploaded

Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Kiwi Creative
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
roli9797
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
Timothy Spann
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
Bill641377
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
manishkhaire30
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdfUdemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Fernanda Palhano
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
AlessioFois2
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
Social Samosa
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Walaa Eldin Moustafa
 
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Aggregage
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
bopyb
 
The Ipsos - AI - Monitor 2024 Report.pdf
The  Ipsos - AI - Monitor 2024 Report.pdfThe  Ipsos - AI - Monitor 2024 Report.pdf
The Ipsos - AI - Monitor 2024 Report.pdf
Social Samosa
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
javier ramirez
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 

Recently uploaded (20)

Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdfUdemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
 
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
 
The Ipsos - AI - Monitor 2024 Report.pdf
The  Ipsos - AI - Monitor 2024 Report.pdfThe  Ipsos - AI - Monitor 2024 Report.pdf
The Ipsos - AI - Monitor 2024 Report.pdf
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 

Mining Social media for Product Development & Marketing Insights

  • 1. Mining Social Media for Product Development & Marketing Insights DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole
  • 2. PROJECT BACKGROUND • Challenges – YMCA enjoys strong brand recognition among consumers – although many individuals do not know that the YMCA is a not-for-profit organization • Often cited as “..where I learned to swim” or “..where I went for summer camp” • No individual is turned away due to the inability to pay for services – Increased competition, changing lifestyles, and changing community demographics – Understanding the wants and needs of consumers via traditional market research techniques is costly • Opportunities – Social media helps organizations understand topics that are important to consumers – Big data tools and techniques offer the promise of timely, cost-effective insights across a wide range of consumers – current and prospective DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 2
  • 3. Big Data Source – Twitter Hashtags • What is a hashtag? – Short link(s) preceded by the pound sign (#) – Organize and categorize discussions – Created/promoted by end-users and marketers – Started as a Twitter experiment and has evolved into a primary social media mechanism – Adopted by other social media outlets - Facebook, Pinterest, etc. • Accessing Twitter hashtags – Custom PHP script – Twitter’s Rest APIs  Twitter search API • Read and write Twitter data • Responses are available in JSON https://dev.twitter.com/rest/public/search Twitter Hashtags #learntoswim #swimming #swimminglessons #swimmingtips #kidsswimming #babyswim #swimtime #childdrensswimgames #swimmingworld #watersafety #waterconfidence #watergames #drowningprevention #learncpr DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 3
  • 4. Data Details - Summary • Search across 14 hashtags – 11/4/14 – 11/9/14 – Initial search results limited due to API rate limits • Reduced by ~10% after data cleanup • Foreign language characters • Inappropriate content • Obvious promotional content Twitter Hashtags #learntoswim #swimming #swimminglessons #swimmingtips #kidsswimming #babyswim #swimtime #childdrensswimgames #swimmingworld #watersafety #waterconfidence #watergames #drowningprevention #learncpr DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 4
  • 5. Data Details – Search Results Query https://api.twitter.com/1.1/search/tweets.json?q=%23learntoswim+%20OR%23watersafety&count=100 Results DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 5
  • 6. Technology Stack • Twitter REST API v1.1 • PHP 5.2 (custom script) • CSV files (for import/export into Mongodb, and import into Wordcloud generator) • Mongodb, mongoimport, mongoexport • Wordcloud generator (jason davies) DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 6
  • 7. Analyzing the Data What are the trending topics for swimming within the selected hashtags? • By geography – Chicagoland – Illinois – USA • With YMCA references? DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 7
  • 8. Trending Topics – Expressed via Wordcloud USA Illinois YMCA DePaul Big Data & NoSQL Programming - IPD 451 - Chicago Final Project Highlights | 11/12/14 | J. Cole 8
  • 9. Insights & Recommendations 1. Maintain emphasis of water safety in YMCA aquatics social media activities – Water safety – Drowning prevention 2. Conduct internal research regarding opportunities to promote aquatics offerings – “onemileswim” cited as “gateway” to triathlon preparation – Expanded parent/child swimming offerings 3. Associate active hashtags into routine social media activities to further leverage social media momentum • #learntoswim • #swimming • #swimminglessons • #swimmingtips 4. Integrate IBM’s BlueMix engine and custom apps for enhanced analysis of twitter stream sentiment DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 9
  • 10. Q & A DePaul Big Data & NoSQL Programming - IPD 451 - Final Project Highlights | 11/12/14 | J. Cole 10