SlideShare a Scribd company logo
1 of 45
Beyond Wordclouds Chris Busse Partner, Fahrenheit Technology Emerging Media Group Richmond, VA 			#RVA Work:		FahrenheitTechnology.com Blog:		ChrisBusse.com Twitter:	@busse Analyzing Trends with Social Media APIs SXSW 2011 #beyondwc SXSW 2011 #beyondwc
This talk will cover: Some things I’ve learned from building systems to monitor online communications for brands An analysis of 100K Tweets from 48 hours of monitoring “coffee” on Twitter on Thursday and Friday of SXSW Q & A SXSW 2011 #beyondwc
API: Application Programming Interface An application programming interface (API) is a particular set of rules and specifications that a software program can follow to access and make use of the services and resources provided by another particular software program that implements that API. It serves as an interface between different software programs and facilitates their interaction, similar to the way the user interface facilitates interaction between humans and computers. http://en.wikipedia.org/wiki/Application_programming_interface SXSW 2011 #beyondwc
SXSW 2011 #beyondwc
<entry>  <id>tag:search.twitter.com,2005:47520097484550144</id> <published>2011-03-15T04:50:48Z</published> <link type="text/html" href="http://twitter.com/wingztw33t/statuses/47520097484550144" rel="alternate"/>  <title>I'm at Sin Hoi How Coffee Shop (JalanTun H S Lee, Kuala Lumpur) http://4sq.com/ebaDo2</title>  <content type="html">I&amp;apos;m at Sin Hoi How &lt;b&gt;Coffee&lt;/b&gt; Shop (JalanTun H S Lee, Kuala Lumpur) &lt;ahref=&quot;http://4sq.com/ebaDo2&quot;&gt;http://4sq.com/ebaDo2&lt;/a&gt;</content>  <updated>2011-03-15T04:50:48Z</updated>  <link type="image/png" href="http://a1.twimg.com/profile_images/658397775/zoom_resize_normal.jpg" rel="image"/>  <twitter:geo> </twitter:geo>  <twitter:metadata>  		<twitter:result_type>recent</twitter:result_type> </twitter:metadata>  <twitter:source>&lt;ahref=&quot;http://foursquare.com&quot; rel=&quot;nofollow&quot;&gt;foursquare&lt;/a&gt;</twitter:source> <twitter:lang>id</twitter:lang> <author> <name>wingztw33t (TeikWingChoo)</name> <uri>http://twitter.com/wingztw33t</uri>  </author> </entry> SXSW 2011 #beyondwc
APIs are the Bridge Between Systems API Customer Service API SXSW 2011 #beyondwc
APIs are the Bridge Between Systems API SXSW 2011 #beyondwc
A Problem I Faced Need to monitor a large volume of SM data around a brand, its products, and competitors Need to identifytrends in that data that might not be readily apparent Need to manage the communications activities of a team of online “Digital Advocates” Need to link this data to other internal software/ database systems (order processing, support center) SXSW 2011 #beyondwc
The Starting Point Wanted custom reporting, but commercially available tools didn’t seem like a good fit UI/UX frustrations Cost for large volume of data Extensibility / deep customization Felt there were limitations in the Twitter Search API Historical depth Query flexibility Needed to mix in more data (corporate mashups) I wanted control (choosing the wrong vendor partner jeopardizes my client relationships) I wanted to work with the development tools I’m familiar with SXSW 2011 #beyondwc
Buy vs Build?: Reasons to Build Standard question for “the Enterprise” Get data in to other sources, no silos Custom workflows Social CRM Start an archive now, you never know when you’ll need it Business Intelligence (BI) staff have a favored toolset Enterprise data security: SaaS might be a NoNo Enterprise platform standards: .NET, Java, LAMP, PowerPoint SXSW 2011 #beyondwc
Build to be minimally relianton platform APIs Get the data out and move on
<entry>  <id>tag:search.twitter.com,2005:47520097484550144</id> <published>2011-03-15T04:50:48Z</published> <link type="text/html" href="http://twitter.com/wingztw33t/statuses/47520097484550144" rel="alternate"/>  <title>I'm at Sin Hoi How Coffee Shop (JalanTun H S Lee, Kuala Lumpur) http://4sq.com/ebaDo2</title>  <content type="html">I&amp;apos;m at Sin Hoi How &lt;b&gt;Coffee&lt;/b&gt; Shop (JalanTun H S Lee, Kuala Lumpur) &lt;ahref=&quot;http://4sq.com/ebaDo2&quot;&gt;http://4sq.com/ebaDo2&lt;/a&gt;</content>  <updated>2011-03-15T04:50:48Z</updated>  <link type="image/png" href="http://a1.twimg.com/profile_images/658397775/zoom_resize_normal.jpg" rel="image"/>  <twitter:geo> </twitter:geo>  <twitter:metadata>  		<twitter:result_type>recent</twitter:result_type> </twitter:metadata>  <twitter:source>&lt;ahref=&quot;http://foursquare.com&quot; rel=&quot;nofollow&quot;&gt;foursquare&lt;/a&gt;</twitter:source> <twitter:lang>id</twitter:lang> <author> <name>wingztw33t (TeikWingChoo)</name> <uri>http://twitter.com/wingztw33t</uri>  </author> </entry> SXSW 2011 #beyondwc
Data Fields Id Published Link (to Tweet) Title Content Updated Link (to Profile Image) Twitter:Geo Twitter:Metadata Twitter:Result Type Twitter:Source Twitter:Lang Author Name URI SXSW 2011 #beyondwc
Automate SXSW 2011 #beyondwc
Tweets + Your CRM Data = Social CRM SXSW 2011 #beyondwc
Tweets + Your CRM Data = Social CRM SXSW 2011 #beyondwc
Automate More! SXSW 2011 #beyondwc
Customer support issues? I thought this was about “analyzing trends” ?
Measuring ROI in Social Media That’s like, the Holy Grail, right?
Measuring ROI SXSW 2011 #beyondwc
Always Go Back to Your Goals and Objectives … as quickly as possible SXSW 2011 #beyondwc
Coffee 100K Tweets on SXSW 2011 #beyondwc
Collecting Tweets with “coffee” Start: 			3/11/11 17:24:01 GMT End: 			3/13/11 15:14:53 GMT # Tweets: 	101,487 SXSW 2011 #beyondwc
“coffee” + _______ SXSW 2011 #beyondwc
“coffee” + _______ 1,377 SXSW 2011 #beyondwc
“coffee” + (“4sq” | “gowal”) SXSW 2011 #beyondwc
“coffee” + (“4sq” | “gowal”) SXSW 2011 #beyondwc
Most Popular Coffee in Austin? SXSW 2011 #beyondwc
Most Popular Coffee in the World? . . . . . . . . . . . . . . . . .  SXSW 2011 #beyondwc
Worldwide Long Tail % of Check-in SXSW 2011 #beyondwc
When does Austin get coffee? | Thursday                     | Friday                                                                | Saturday                           SXSW 2011 #beyondwc
SXSW 2011 #beyondwc
Did everyone leave New York? SXSW 2011 #beyondwc
What’s in a word? 140,295 words in 100K tweets
How to Turn Tweets in to Words Loop through all your collected Tweets Split() them on “ ‘ Strip out , . ! ? ( ) … and also “: “ Escape the single quotes Strip out/exclude common words like “the”, “for”, “you”, … Record the Word back to a database table Perhaps add counts to that word, and segment by a time span such as day or hour SXSW 2011 #beyondwc
General Word Clouds Lack Relevance Source:http://tweetcloud.com/search/term/coffee Source: custom script/db via Twitter Search API SXSW 2011 #beyondwc
SXSW 2011 #beyondwc
Decaf is more popular?! SXSW 2011 #beyondwc
…or maybe just linkbait SXSW 2011 #beyondwc
Speaking of Links SXSW 2011 #beyondwc
SXSW 2011 #beyondwc
Look at More Data(there’s an API for this too) SXSW 2011 #beyondwc
Other things to explore Better location-based analysis Words over time span, compared to previous time span Add the people who tweeted about this back in to the search strings, capture their tweets for analysis Find even more data to add in to the mix Begin to identify real influencers in the context of your strategic goals and objectives – this might not be as simple as a “score” SXSW 2011 #beyondwc
The Future Open APIs vs. Closed APIs ,[object Object]
Platform commitmentTraditional software package vendors working with platform/service APIs intelligently Smart people solving this problem for the Enterprise (and smaller orgs) in a way that fits strategy, not forcing strategy to fit a tool SXSW 2011 #beyondwc

More Related Content

Similar to SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs

Big Data Week 2013 Flow
Big Data Week 2013 FlowBig Data Week 2013 Flow
Big Data Week 2013 FlowVictor Anjos
 
Assessment In Spreadsheets
Assessment In SpreadsheetsAssessment In Spreadsheets
Assessment In Spreadsheetsguest46de76
 
Understanding What’s Possible: Getting Business Value from Big Data Quickly
Understanding What’s Possible: Getting Business Value from Big Data QuicklyUnderstanding What’s Possible: Getting Business Value from Big Data Quickly
Understanding What’s Possible: Getting Business Value from Big Data QuicklyInside Analysis
 
Microservices, Events, and Breaking the Data Monolith with Kafka
Microservices, Events, and Breaking the Data Monolith with KafkaMicroservices, Events, and Breaking the Data Monolith with Kafka
Microservices, Events, and Breaking the Data Monolith with KafkaVMware Tanzu
 
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean Campbell
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean CampbellSourcing with Social Media: Tips from a Corporate Sleuth by Sean Campbell
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean CampbellReynolds Center for Business Journalism
 
Designers @ Hackathons
Designers @ HackathonsDesigners @ Hackathons
Designers @ HackathonsEric Bell
 
Business in the Driver’s Seat – An Improved Model for Integration
Business in the Driver’s Seat – An Improved Model for IntegrationBusiness in the Driver’s Seat – An Improved Model for Integration
Business in the Driver’s Seat – An Improved Model for IntegrationInside Analysis
 
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...Amazon Web Services
 
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...Preetha Chatterjee
 
How APIs are Changing Software Development
How APIs are Changing Software DevelopmentHow APIs are Changing Software Development
How APIs are Changing Software Development3scale
 
Data Informed Product Management by Eventbrite Sr PM
Data Informed Product Management by Eventbrite Sr PMData Informed Product Management by Eventbrite Sr PM
Data Informed Product Management by Eventbrite Sr PMProduct School
 
Event Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsEvent Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsDavide Mauri
 
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...Amsive
 
Data Visualization and the Art of Self-Reliance
Data Visualization and the Art of Self-RelianceData Visualization and the Art of Self-Reliance
Data Visualization and the Art of Self-RelianceInside Analysis
 
Building Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterBuilding Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterTechWell
 
What’s the Impact of Open Source on the Future of Supply Chain? slide deck
What’s the Impact of Open Source on the Future of Supply Chain? slide deckWhat’s the Impact of Open Source on the Future of Supply Chain? slide deck
What’s the Impact of Open Source on the Future of Supply Chain? slide deckLora Cecere
 
Deeper Questions: How Interactive Visualization Empowers Analysts
Deeper Questions: How Interactive Visualization Empowers AnalystsDeeper Questions: How Interactive Visualization Empowers Analysts
Deeper Questions: How Interactive Visualization Empowers AnalystsInside Analysis
 
Microsoft Flow - SharePoint Saturday Paris 2017
Microsoft Flow - SharePoint Saturday Paris 2017Microsoft Flow - SharePoint Saturday Paris 2017
Microsoft Flow - SharePoint Saturday Paris 2017serge luca
 
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...SPS Paris
 
How to create custom Connector for Microsoft Flow
How to create custom Connector for Microsoft FlowHow to create custom Connector for Microsoft Flow
How to create custom Connector for Microsoft FlowDragan Panjkov
 

Similar to SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs (20)

Big Data Week 2013 Flow
Big Data Week 2013 FlowBig Data Week 2013 Flow
Big Data Week 2013 Flow
 
Assessment In Spreadsheets
Assessment In SpreadsheetsAssessment In Spreadsheets
Assessment In Spreadsheets
 
Understanding What’s Possible: Getting Business Value from Big Data Quickly
Understanding What’s Possible: Getting Business Value from Big Data QuicklyUnderstanding What’s Possible: Getting Business Value from Big Data Quickly
Understanding What’s Possible: Getting Business Value from Big Data Quickly
 
Microservices, Events, and Breaking the Data Monolith with Kafka
Microservices, Events, and Breaking the Data Monolith with KafkaMicroservices, Events, and Breaking the Data Monolith with Kafka
Microservices, Events, and Breaking the Data Monolith with Kafka
 
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean Campbell
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean CampbellSourcing with Social Media: Tips from a Corporate Sleuth by Sean Campbell
Sourcing with Social Media: Tips from a Corporate Sleuth by Sean Campbell
 
Designers @ Hackathons
Designers @ HackathonsDesigners @ Hackathons
Designers @ Hackathons
 
Business in the Driver’s Seat – An Improved Model for Integration
Business in the Driver’s Seat – An Improved Model for IntegrationBusiness in the Driver’s Seat – An Improved Model for Integration
Business in the Driver’s Seat – An Improved Model for Integration
 
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...
AWS re:Invent 2016: Building the Future of DevOps with Amazon Web Services (D...
 
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...
Exploratory Study of Slack Q&A Chats as a Mining Source for Software Engineer...
 
How APIs are Changing Software Development
How APIs are Changing Software DevelopmentHow APIs are Changing Software Development
How APIs are Changing Software Development
 
Data Informed Product Management by Eventbrite Sr PM
Data Informed Product Management by Eventbrite Sr PMData Informed Product Management by Eventbrite Sr PM
Data Informed Product Management by Eventbrite Sr PM
 
Event Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsEvent Hub & Azure Stream Analytics
Event Hub & Azure Stream Analytics
 
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...
SEOktoberfest 2022 - Blending SEO, Discover, & Entity Extraction to Analyze D...
 
Data Visualization and the Art of Self-Reliance
Data Visualization and the Art of Self-RelianceData Visualization and the Art of Self-Reliance
Data Visualization and the Art of Self-Reliance
 
Building Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterBuilding Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design Smarter
 
What’s the Impact of Open Source on the Future of Supply Chain? slide deck
What’s the Impact of Open Source on the Future of Supply Chain? slide deckWhat’s the Impact of Open Source on the Future of Supply Chain? slide deck
What’s the Impact of Open Source on the Future of Supply Chain? slide deck
 
Deeper Questions: How Interactive Visualization Empowers Analysts
Deeper Questions: How Interactive Visualization Empowers AnalystsDeeper Questions: How Interactive Visualization Empowers Analysts
Deeper Questions: How Interactive Visualization Empowers Analysts
 
Microsoft Flow - SharePoint Saturday Paris 2017
Microsoft Flow - SharePoint Saturday Paris 2017Microsoft Flow - SharePoint Saturday Paris 2017
Microsoft Flow - SharePoint Saturday Paris 2017
 
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...
B5 - Introduction à Microsoft Flow - Isabelle Van Campenhoudt, Sabrine chouk,...
 
How to create custom Connector for Microsoft Flow
How to create custom Connector for Microsoft FlowHow to create custom Connector for Microsoft Flow
How to create custom Connector for Microsoft Flow
 

Recently uploaded

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 

Recently uploaded (20)

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs

  • 1. Beyond Wordclouds Chris Busse Partner, Fahrenheit Technology Emerging Media Group Richmond, VA #RVA Work: FahrenheitTechnology.com Blog: ChrisBusse.com Twitter: @busse Analyzing Trends with Social Media APIs SXSW 2011 #beyondwc SXSW 2011 #beyondwc
  • 2. This talk will cover: Some things I’ve learned from building systems to monitor online communications for brands An analysis of 100K Tweets from 48 hours of monitoring “coffee” on Twitter on Thursday and Friday of SXSW Q & A SXSW 2011 #beyondwc
  • 3. API: Application Programming Interface An application programming interface (API) is a particular set of rules and specifications that a software program can follow to access and make use of the services and resources provided by another particular software program that implements that API. It serves as an interface between different software programs and facilitates their interaction, similar to the way the user interface facilitates interaction between humans and computers. http://en.wikipedia.org/wiki/Application_programming_interface SXSW 2011 #beyondwc
  • 5. <entry> <id>tag:search.twitter.com,2005:47520097484550144</id> <published>2011-03-15T04:50:48Z</published> <link type="text/html" href="http://twitter.com/wingztw33t/statuses/47520097484550144" rel="alternate"/> <title>I'm at Sin Hoi How Coffee Shop (JalanTun H S Lee, Kuala Lumpur) http://4sq.com/ebaDo2</title> <content type="html">I&amp;apos;m at Sin Hoi How &lt;b&gt;Coffee&lt;/b&gt; Shop (JalanTun H S Lee, Kuala Lumpur) &lt;ahref=&quot;http://4sq.com/ebaDo2&quot;&gt;http://4sq.com/ebaDo2&lt;/a&gt;</content> <updated>2011-03-15T04:50:48Z</updated> <link type="image/png" href="http://a1.twimg.com/profile_images/658397775/zoom_resize_normal.jpg" rel="image"/> <twitter:geo> </twitter:geo> <twitter:metadata> <twitter:result_type>recent</twitter:result_type> </twitter:metadata> <twitter:source>&lt;ahref=&quot;http://foursquare.com&quot; rel=&quot;nofollow&quot;&gt;foursquare&lt;/a&gt;</twitter:source> <twitter:lang>id</twitter:lang> <author> <name>wingztw33t (TeikWingChoo)</name> <uri>http://twitter.com/wingztw33t</uri> </author> </entry> SXSW 2011 #beyondwc
  • 6. APIs are the Bridge Between Systems API Customer Service API SXSW 2011 #beyondwc
  • 7. APIs are the Bridge Between Systems API SXSW 2011 #beyondwc
  • 8. A Problem I Faced Need to monitor a large volume of SM data around a brand, its products, and competitors Need to identifytrends in that data that might not be readily apparent Need to manage the communications activities of a team of online “Digital Advocates” Need to link this data to other internal software/ database systems (order processing, support center) SXSW 2011 #beyondwc
  • 9. The Starting Point Wanted custom reporting, but commercially available tools didn’t seem like a good fit UI/UX frustrations Cost for large volume of data Extensibility / deep customization Felt there were limitations in the Twitter Search API Historical depth Query flexibility Needed to mix in more data (corporate mashups) I wanted control (choosing the wrong vendor partner jeopardizes my client relationships) I wanted to work with the development tools I’m familiar with SXSW 2011 #beyondwc
  • 10. Buy vs Build?: Reasons to Build Standard question for “the Enterprise” Get data in to other sources, no silos Custom workflows Social CRM Start an archive now, you never know when you’ll need it Business Intelligence (BI) staff have a favored toolset Enterprise data security: SaaS might be a NoNo Enterprise platform standards: .NET, Java, LAMP, PowerPoint SXSW 2011 #beyondwc
  • 11. Build to be minimally relianton platform APIs Get the data out and move on
  • 12. <entry> <id>tag:search.twitter.com,2005:47520097484550144</id> <published>2011-03-15T04:50:48Z</published> <link type="text/html" href="http://twitter.com/wingztw33t/statuses/47520097484550144" rel="alternate"/> <title>I'm at Sin Hoi How Coffee Shop (JalanTun H S Lee, Kuala Lumpur) http://4sq.com/ebaDo2</title> <content type="html">I&amp;apos;m at Sin Hoi How &lt;b&gt;Coffee&lt;/b&gt; Shop (JalanTun H S Lee, Kuala Lumpur) &lt;ahref=&quot;http://4sq.com/ebaDo2&quot;&gt;http://4sq.com/ebaDo2&lt;/a&gt;</content> <updated>2011-03-15T04:50:48Z</updated> <link type="image/png" href="http://a1.twimg.com/profile_images/658397775/zoom_resize_normal.jpg" rel="image"/> <twitter:geo> </twitter:geo> <twitter:metadata> <twitter:result_type>recent</twitter:result_type> </twitter:metadata> <twitter:source>&lt;ahref=&quot;http://foursquare.com&quot; rel=&quot;nofollow&quot;&gt;foursquare&lt;/a&gt;</twitter:source> <twitter:lang>id</twitter:lang> <author> <name>wingztw33t (TeikWingChoo)</name> <uri>http://twitter.com/wingztw33t</uri> </author> </entry> SXSW 2011 #beyondwc
  • 13. Data Fields Id Published Link (to Tweet) Title Content Updated Link (to Profile Image) Twitter:Geo Twitter:Metadata Twitter:Result Type Twitter:Source Twitter:Lang Author Name URI SXSW 2011 #beyondwc
  • 14. Automate SXSW 2011 #beyondwc
  • 15. Tweets + Your CRM Data = Social CRM SXSW 2011 #beyondwc
  • 16. Tweets + Your CRM Data = Social CRM SXSW 2011 #beyondwc
  • 17. Automate More! SXSW 2011 #beyondwc
  • 18. Customer support issues? I thought this was about “analyzing trends” ?
  • 19. Measuring ROI in Social Media That’s like, the Holy Grail, right?
  • 20. Measuring ROI SXSW 2011 #beyondwc
  • 21. Always Go Back to Your Goals and Objectives … as quickly as possible SXSW 2011 #beyondwc
  • 22. Coffee 100K Tweets on SXSW 2011 #beyondwc
  • 23. Collecting Tweets with “coffee” Start: 3/11/11 17:24:01 GMT End: 3/13/11 15:14:53 GMT # Tweets: 101,487 SXSW 2011 #beyondwc
  • 24. “coffee” + _______ SXSW 2011 #beyondwc
  • 25. “coffee” + _______ 1,377 SXSW 2011 #beyondwc
  • 26. “coffee” + (“4sq” | “gowal”) SXSW 2011 #beyondwc
  • 27. “coffee” + (“4sq” | “gowal”) SXSW 2011 #beyondwc
  • 28. Most Popular Coffee in Austin? SXSW 2011 #beyondwc
  • 29. Most Popular Coffee in the World? . . . . . . . . . . . . . . . . . SXSW 2011 #beyondwc
  • 30. Worldwide Long Tail % of Check-in SXSW 2011 #beyondwc
  • 31. When does Austin get coffee? | Thursday | Friday | Saturday SXSW 2011 #beyondwc
  • 33. Did everyone leave New York? SXSW 2011 #beyondwc
  • 34. What’s in a word? 140,295 words in 100K tweets
  • 35. How to Turn Tweets in to Words Loop through all your collected Tweets Split() them on “ ‘ Strip out , . ! ? ( ) … and also “: “ Escape the single quotes Strip out/exclude common words like “the”, “for”, “you”, … Record the Word back to a database table Perhaps add counts to that word, and segment by a time span such as day or hour SXSW 2011 #beyondwc
  • 36. General Word Clouds Lack Relevance Source:http://tweetcloud.com/search/term/coffee Source: custom script/db via Twitter Search API SXSW 2011 #beyondwc
  • 38. Decaf is more popular?! SXSW 2011 #beyondwc
  • 39. …or maybe just linkbait SXSW 2011 #beyondwc
  • 40. Speaking of Links SXSW 2011 #beyondwc
  • 42. Look at More Data(there’s an API for this too) SXSW 2011 #beyondwc
  • 43. Other things to explore Better location-based analysis Words over time span, compared to previous time span Add the people who tweeted about this back in to the search strings, capture their tweets for analysis Find even more data to add in to the mix Begin to identify real influencers in the context of your strategic goals and objectives – this might not be as simple as a “score” SXSW 2011 #beyondwc
  • 44.
  • 45. Platform commitmentTraditional software package vendors working with platform/service APIs intelligently Smart people solving this problem for the Enterprise (and smaller orgs) in a way that fits strategy, not forcing strategy to fit a tool SXSW 2011 #beyondwc
  • 46. Q & A Contact Info: Chris Busse @busse cbusse@fahrenheittechnology.com http://FahrenheitTechnology.com http://ChrisBusse.com Thank You: @jboogie& @mr_sterling @mavnet & @VCU_Brandcenter @cdharrison & @krusk & @akuzemchak @willowtree84 @IconBuffet The entire @FahrenheitTech / @FahrenheitEM Team All who helped promote this talk & all the SXSW staff & volunteers! SXSW 2011 #beyondwc