SlideShare a Scribd company logo
NICK HALSTEAD

@NIK
RYAN SARVER


@RSARVER
REALTIME TWITTER DATA MINING


                               @DATASIFT
WHAT IS IN A TWEET?
WHAT IS IN A TWEET?
MINING THE TWEET




170 MILLION (daily)
MINING THE TWEET




170 MILLION (daily)
MINING THE TWEET




                                         REAL-TIME OUTPUT


170 MILLION (daily)
DATA FILTERING
CSDL - Curation Stream Definition Language
AUGMENTATIONS



KLOUT                PEERINDEX            QWERLY




        LEXALYTICS               TRENDS
BIGSTORE
BIGSTORE



                                 REAL-TIME OUTPUT




170 MILLION (daily)
BIGSTORE



                                 REAL-TIME OUTPUT




170 MILLION (daily)                  BIGSTORE
BIGSTORE




HBASE
BIGSTORE




HBASE   POST-PROCESSING
BIGSTORE




HBASE   POST-PROCESSING   MAP-REDUCE
BIGSTORE




HBASE   POST-PROCESSING   MAP-REDUCE   EXPORTING
BIGSTORE




HBASE   POST-PROCESSING     MAP-REDUCE   EXPORTING




                      API
BIGSTORE
WHAT CAN YOU BUILD?
@STOCKSIFT
@STOCKSIFT
@STOCKSIFT
@CLUSTERAPP
@CLUSTERAPP
@CLUSTERAPP
USE CASES / VERTICALS
• Below
are
some
of
the
use
cases
from
the
Alpha
programme.

  This
is
a
con7nuously
evolving
set
of
applica7ons,
based
upon
market
feedback.                     Mining
                                                                                                     Oil & Gas
                                                                                                     Exploration
                                                                                Sports               Utilities

                                                                                Energy               Automobiles
                                                        Crisis Management
                                                                                Industrials          Aerospace / Defence
                                                                                                     Basic Resources
                              Events / Trigger          Reputation Management   Banking
                                                                                                     Chemicals
                                                                                Financial Services   Construction
                Monitoring                              Risk Analysis
                             Data Analysis                                      Insurance            Industrial Goods
                                                         Research
                                                                                Property
                             Brand Marketing              Viral Campaigns                            Airlines
               Influencing
                                                                                Media                Shipping
                                              Qualitative Feedback              Transportation       Rail
                             CRM
                                                                                Health               Pharmaceuticals
                                             Augmented Research
                                                                                                     Healthcare
                                                                                Technology

                                                                                Government           Telecommunications

                                                                                Retail / Consumer    F&B
                                                                                                     Personal Goods
                                                                                                     Travel & Leisure
DATASIFT.COM
 @DATASIFT

More Related Content

Similar to Twitter and Mediasift Partnership

2012 09 Oracle bigdata_architecture
2012 09 Oracle bigdata_architecture2012 09 Oracle bigdata_architecture
2012 09 Oracle bigdata_architecture
jdijcks
 
Ict’s in value chains v1
Ict’s in value chains v1Ict’s in value chains v1
Business: Security & Privacy
Business: Security & PrivacyBusiness: Security & Privacy
Business: Security & Privacy
Jeremy Hilton
 
SOA and Cloud in Life Sciences
SOA and Cloud in Life SciencesSOA and Cloud in Life Sciences
SOA and Cloud in Life Sciences
Sandeep Bhat
 
BPC Overview
BPC OverviewBPC Overview
BPC Overview
evolfi
 
Global Services Jan 2012
Global Services Jan 2012Global Services Jan 2012
Global Services Jan 2012ajfitzer
 
MphasiS - insurance and technology
MphasiS -  insurance and technologyMphasiS -  insurance and technology
MphasiS - insurance and technology
Mphasis
 
America's Most Productive: Large Sales Force Analysis
America's Most Productive: Large Sales Force AnalysisAmerica's Most Productive: Large Sales Force Analysis
America's Most Productive: Large Sales Force Analysisassessmentedge
 
Global Pharmaceuticals & Biotechnology Industry
Global Pharmaceuticals & Biotechnology IndustryGlobal Pharmaceuticals & Biotechnology Industry
Global Pharmaceuticals & Biotechnology Industry
Gavin Pathross
 
BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyOKsystem
 
George W. Buckley Chairman, President and Chief Executive Officer
George W. Buckley Chairman, President and Chief Executive OfficerGeorge W. Buckley Chairman, President and Chief Executive Officer
George W. Buckley Chairman, President and Chief Executive Officerfinance10
 
M Life 2009 Modern Government And Mobility Eduardo Fernandez Rojo
M Life 2009 Modern Government And Mobility   Eduardo Fernandez RojoM Life 2009 Modern Government And Mobility   Eduardo Fernandez Rojo
M Life 2009 Modern Government And Mobility Eduardo Fernandez Rojo
Ed Fernandez
 
Profile Craig L Nov 27 2012
Profile Craig L Nov 27 2012Profile Craig L Nov 27 2012
Profile Craig L Nov 27 2012
craiglazinsky
 
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
Changellenge >> Capital
 
Ad ecosystem-slides
Ad ecosystem-slidesAd ecosystem-slides
Ad ecosystem-slidesEric Picard
 
ESRI - Metrics Based Study
ESRI - Metrics Based StudyESRI - Metrics Based Study
ESRI - Metrics Based Study
Aravind Sesagiri Raamkumar
 

Similar to Twitter and Mediasift Partnership (20)

2012 09 Oracle bigdata_architecture
2012 09 Oracle bigdata_architecture2012 09 Oracle bigdata_architecture
2012 09 Oracle bigdata_architecture
 
Ict’s in value chains v1
Ict’s in value chains v1Ict’s in value chains v1
Ict’s in value chains v1
 
Business: Security & Privacy
Business: Security & PrivacyBusiness: Security & Privacy
Business: Security & Privacy
 
SOA and Cloud in Life Sciences
SOA and Cloud in Life SciencesSOA and Cloud in Life Sciences
SOA and Cloud in Life Sciences
 
Noronesc
NoronescNoronesc
Noronesc
 
BPC Overview
BPC OverviewBPC Overview
BPC Overview
 
Global Services Jan 2012
Global Services Jan 2012Global Services Jan 2012
Global Services Jan 2012
 
MphasiS - insurance and technology
MphasiS -  insurance and technologyMphasiS -  insurance and technology
MphasiS - insurance and technology
 
America's Most Productive: Large Sales Force Analysis
America's Most Productive: Large Sales Force AnalysisAmerica's Most Productive: Large Sales Force Analysis
America's Most Productive: Large Sales Force Analysis
 
Global Pharmaceuticals & Biotechnology Industry
Global Pharmaceuticals & Biotechnology IndustryGlobal Pharmaceuticals & Biotechnology Industry
Global Pharmaceuticals & Biotechnology Industry
 
BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémy
 
George W. Buckley Chairman, President and Chief Executive Officer
George W. Buckley Chairman, President and Chief Executive OfficerGeorge W. Buckley Chairman, President and Chief Executive Officer
George W. Buckley Chairman, President and Chief Executive Officer
 
M Life 2009 Modern Government And Mobility Eduardo Fernandez Rojo
M Life 2009 Modern Government And Mobility   Eduardo Fernandez RojoM Life 2009 Modern Government And Mobility   Eduardo Fernandez Rojo
M Life 2009 Modern Government And Mobility Eduardo Fernandez Rojo
 
Profile Craig L Nov 27 2012
Profile Craig L Nov 27 2012Profile Craig L Nov 27 2012
Profile Craig L Nov 27 2012
 
Fast Pitch Forum (VANTOS)
Fast Pitch Forum (VANTOS)Fast Pitch Forum (VANTOS)
Fast Pitch Forum (VANTOS)
 
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
Cup Moscow >> Eng >> 1st Place >> Sorrento (1st Round Case)
 
Commercial partners presentation 20.04.12
Commercial partners presentation 20.04.12Commercial partners presentation 20.04.12
Commercial partners presentation 20.04.12
 
Hacking Trust
Hacking TrustHacking Trust
Hacking Trust
 
Ad ecosystem-slides
Ad ecosystem-slidesAd ecosystem-slides
Ad ecosystem-slides
 
ESRI - Metrics Based Study
ESRI - Metrics Based StudyESRI - Metrics Based Study
ESRI - Metrics Based Study
 

More from Nick Halstead

Big Data Week - Myths and Legends
Big Data Week - Myths and LegendsBig Data Week - Myths and Legends
Big Data Week - Myths and Legends
Nick Halstead
 
DataSift Historics in 5 Steps
DataSift Historics in 5 StepsDataSift Historics in 5 Steps
DataSift Historics in 5 Steps
Nick Halstead
 
Have I Got The Future Of News For You
Have I Got The Future Of News For YouHave I Got The Future Of News For You
Have I Got The Future Of News For You
Nick Halstead
 
A guide to Twitter Tools & Jargon
A guide to Twitter Tools & JargonA guide to Twitter Tools & Jargon
A guide to Twitter Tools & Jargon
Nick Halstead
 
Building on Twitter
Building on TwitterBuilding on Twitter
Building on Twitter
Nick Halstead
 

More from Nick Halstead (6)

Big Data Week - Myths and Legends
Big Data Week - Myths and LegendsBig Data Week - Myths and Legends
Big Data Week - Myths and Legends
 
DataSift Historics in 5 Steps
DataSift Historics in 5 StepsDataSift Historics in 5 Steps
DataSift Historics in 5 Steps
 
DataSift API
DataSift APIDataSift API
DataSift API
 
Have I Got The Future Of News For You
Have I Got The Future Of News For YouHave I Got The Future Of News For You
Have I Got The Future Of News For You
 
A guide to Twitter Tools & Jargon
A guide to Twitter Tools & JargonA guide to Twitter Tools & Jargon
A guide to Twitter Tools & Jargon
 
Building on Twitter
Building on TwitterBuilding on Twitter
Building on Twitter
 

Recently uploaded

PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 

Recently uploaded (20)

PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 

Twitter and Mediasift Partnership

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n