SlideShare a Scribd company logo
1 of 21
Download to read offline
© 2014 Quid, Inc.1
Big Data Visualization Meetup @ CA Technologies
Ruggero Altair Tacchi, PhD
Data Scientist at Quid
March 27, 2014
BIG DATA INTELLIGENCE
ruggero@quid.com
© 2014 Quid, Inc.22
Quid is a Business Intelligence platform. Quid has created a full-stack
platform that brings together the world’s business data streams
ü  Company data
ü  News data
ü  Patent data
ü  Organizational data
ü  Scientific papers
…
…
…
© 2014 Quid, Inc.33
Q: Who owns the discussion about the future of the car?
© 2014 Quid, Inc.44 ruggero@quid.com
Q: Who owns the discussion about the future of the car?
© 2014 Quid, Inc.55 Source: xkcd 1334
© 2014 Quid, Inc.66 Source: xkcd 1334
Search is hard
© 2014 Quid, Inc.77
224
239
248
262
286
311
346
346
396
520
550
571
659
735
1,065
Chrysler
Chevrolet
Hyundai
Honda
Volkswagen
Nissan
Volvo
Apple
Mercedes
General
Motors
BMW
Audi
Toyota
Ford
Google
Top entities within future car news
network, by number of articles
23%
16%
14%
12%
12%
11%
9%
8%
8%
7%
6%
6%
5%
5%
5%
Share of voiceProportion of articles by theme
New car
features
Autonomous
driving
A: Google has 23% share of voice in the discussion on the
future of the car; traditional players focused on new features,
not capitalizing on interest in future / autonomous driving
© 2014 Quid, Inc.88
Q: Which media sources are most closely broadcasting
NASA’s press releases?
© 2014 Quid, Inc.99
-100 -80 -60 -40 -20 0 20 40 60 80 100
The New York Times
The Business Insider
CBC News
Aero-News.net
Popular Mechanics
CBS News
International Business Times
Everything Alabama
CNET
PerthNow
Business Wire
The Register
RedOrbit
Boston.com
Space Ref
Freshnews.com
EurekAlert
Softpedia
HeraldOnline.com
Reuters
Engadget
CNN
BBC News
Geekosystem.com
Slashgear
Gizmag
The Inquisitr
Big Pond News
Kurzweilai
Planetary Society Blog
ITWorld.com
The Verge
Ecoustics
More representative
Alignment Score
Less representative
A: The New York Times’ articles most closely reflect
narratives that NASA originates
© 2014 Quid, Inc.1010 Source: xkcd 173
© 2014 Quid, Inc.1111 Source: xkcd 173
Networks, not lists
© 2014 Quid, Inc.1212
Analyzing ~1,500 long-form articles about space, thematic clusters form
around NASA’s past & present, as wells as the future of commercial space
Present: NASA-led Space
Exploration (49%)
Future: Commercial
Space (26%)
Past: Traditional
NASA (25%)
Long-form news network, colored by conversation themes, major themes labeled
© 2014 Quid, Inc.1313
Long-form news network, NASA publications highlighted and clusters containing them labeled
NASA’s press release strategy has focused on the peripheral; it is largely
absent from the core conversation debating the future vs. the past of space
Source
NASA
Other
Vesta Asteroid
Moon
SpaceX & Dragon Capsule
Mars Curiosity
Hubble Telescope & Exoplanets
Space Shuttle
© 2014 Quid, Inc.1414
Quid Technology
Company A
Company B
< >
< >
< >
< machine vision >
< gaze coordinates >
< eye tracking >
Analyst has a
big-picture view
+
Ability to zoom
down to details
KEYWORDS
EXTRACTED
FROM TEXT
REPLICATED AT A
VERY LARGE SCALE
LINKS ESTABLISHED
USING SHARED
LANGUAGE
< eye tracking >
< gestures >
< eye control >
< Neural Connectivity >
< Autism >
< Mathematical >
< Divergent thinking >
NATURAL LANGUAGE PROCESSING
Neural Connectivity
Autism
Mathematical
Divergent thinking
Concepts
DIGITAL SIGNATURE
Significance
Document #1
Document 2
Document 3
Document 4
DIGITAL SIGNATURE
Document #3
Document #1
(similar)
© 2014 Quid, Inc.1919
From lists to networks, from networks to lists
© 2014 Quid, Inc.2020
Demo
© 2014 Quid, Inc.2121
For information contact us at
http://quid.com/contact
… and we’re hiring!
http://quid.com/careers
Danielle Ben-Gera Kartik Sundar Joey Hobbs Ruggero Altair Tacchi

More Related Content

Similar to Extracting Intelligence from Big Data

Similar to Extracting Intelligence from Big Data (20)

Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!
 
Workshop - Build a Graph Solution
Workshop - Build a Graph SolutionWorkshop - Build a Graph Solution
Workshop - Build a Graph Solution
 
Os Boswell
Os BoswellOs Boswell
Os Boswell
 
Tucana HR Analytics Data Visualisation, April 2014 (London)
Tucana HR Analytics Data Visualisation, April 2014 (London)Tucana HR Analytics Data Visualisation, April 2014 (London)
Tucana HR Analytics Data Visualisation, April 2014 (London)
 
Real-Time AI Streaming - AI Max Princeton
Real-Time AI  Streaming - AI Max PrincetonReal-Time AI  Streaming - AI Max Princeton
Real-Time AI Streaming - AI Max Princeton
 
Open Source Software Development by TLV Partners
Open Source Software Development by TLV PartnersOpen Source Software Development by TLV Partners
Open Source Software Development by TLV Partners
 
Open source presentation
Open source presentationOpen source presentation
Open source presentation
 
Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...
Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...
Take the Fastest Path to Node.Js Application Development with Bitnami & AWS L...
 
Cloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersCloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for Developers
 
Case Study - Wikia Provides Federated Access To Data And Business Critical In...
Case Study - Wikia Provides Federated Access To Data And Business Critical In...Case Study - Wikia Provides Federated Access To Data And Business Critical In...
Case Study - Wikia Provides Federated Access To Data And Business Critical In...
 
Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...
Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...
Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...
 
Engineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudEngineering Simulation Meets the Cloud
Engineering Simulation Meets the Cloud
 
AstriCon 2014 keynote: Russell Bryant
AstriCon 2014 keynote: Russell BryantAstriCon 2014 keynote: Russell Bryant
AstriCon 2014 keynote: Russell Bryant
 
Introduction to developing modern web apps
Introduction to developing modern web appsIntroduction to developing modern web apps
Introduction to developing modern web apps
 
Cloud and Big Data Come Together in the Ocean Observatories Initiative to Giv...
Cloud and Big Data Come Together in the Ocean Observatories Initiative to Giv...Cloud and Big Data Come Together in the Ocean Observatories Initiative to Giv...
Cloud and Big Data Come Together in the Ocean Observatories Initiative to Giv...
 
Telecom Clouds crossing borders, Chet Golding, Zefflin Systems
Telecom Clouds crossing borders, Chet Golding, Zefflin SystemsTelecom Clouds crossing borders, Chet Golding, Zefflin Systems
Telecom Clouds crossing borders, Chet Golding, Zefflin Systems
 
[OpenStack Day in Korea 2015] Keynote 1 - OpenStack Mission Update
[OpenStack Day in Korea 2015] Keynote 1 - OpenStack Mission Update[OpenStack Day in Korea 2015] Keynote 1 - OpenStack Mission Update
[OpenStack Day in Korea 2015] Keynote 1 - OpenStack Mission Update
 
Where is Data Going? - RMDC Keynote
Where is Data Going? - RMDC KeynoteWhere is Data Going? - RMDC Keynote
Where is Data Going? - RMDC Keynote
 
2011 NASA Open Source Summit - Patrick Hogan
2011 NASA Open Source Summit - Patrick Hogan2011 NASA Open Source Summit - Patrick Hogan
2011 NASA Open Source Summit - Patrick Hogan
 
2014 Ceph NYLUG Talk
2014 Ceph NYLUG Talk2014 Ceph NYLUG Talk
2014 Ceph NYLUG Talk
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 

Extracting Intelligence from Big Data

  • 1. © 2014 Quid, Inc.1 Big Data Visualization Meetup @ CA Technologies Ruggero Altair Tacchi, PhD Data Scientist at Quid March 27, 2014 BIG DATA INTELLIGENCE ruggero@quid.com
  • 2. © 2014 Quid, Inc.22 Quid is a Business Intelligence platform. Quid has created a full-stack platform that brings together the world’s business data streams ü  Company data ü  News data ü  Patent data ü  Organizational data ü  Scientific papers … … …
  • 3. © 2014 Quid, Inc.33 Q: Who owns the discussion about the future of the car?
  • 4. © 2014 Quid, Inc.44 ruggero@quid.com Q: Who owns the discussion about the future of the car?
  • 5. © 2014 Quid, Inc.55 Source: xkcd 1334
  • 6. © 2014 Quid, Inc.66 Source: xkcd 1334 Search is hard
  • 7. © 2014 Quid, Inc.77 224 239 248 262 286 311 346 346 396 520 550 571 659 735 1,065 Chrysler Chevrolet Hyundai Honda Volkswagen Nissan Volvo Apple Mercedes General Motors BMW Audi Toyota Ford Google Top entities within future car news network, by number of articles 23% 16% 14% 12% 12% 11% 9% 8% 8% 7% 6% 6% 5% 5% 5% Share of voiceProportion of articles by theme New car features Autonomous driving A: Google has 23% share of voice in the discussion on the future of the car; traditional players focused on new features, not capitalizing on interest in future / autonomous driving
  • 8. © 2014 Quid, Inc.88 Q: Which media sources are most closely broadcasting NASA’s press releases?
  • 9. © 2014 Quid, Inc.99 -100 -80 -60 -40 -20 0 20 40 60 80 100 The New York Times The Business Insider CBC News Aero-News.net Popular Mechanics CBS News International Business Times Everything Alabama CNET PerthNow Business Wire The Register RedOrbit Boston.com Space Ref Freshnews.com EurekAlert Softpedia HeraldOnline.com Reuters Engadget CNN BBC News Geekosystem.com Slashgear Gizmag The Inquisitr Big Pond News Kurzweilai Planetary Society Blog ITWorld.com The Verge Ecoustics More representative Alignment Score Less representative A: The New York Times’ articles most closely reflect narratives that NASA originates
  • 10. © 2014 Quid, Inc.1010 Source: xkcd 173
  • 11. © 2014 Quid, Inc.1111 Source: xkcd 173 Networks, not lists
  • 12. © 2014 Quid, Inc.1212 Analyzing ~1,500 long-form articles about space, thematic clusters form around NASA’s past & present, as wells as the future of commercial space Present: NASA-led Space Exploration (49%) Future: Commercial Space (26%) Past: Traditional NASA (25%) Long-form news network, colored by conversation themes, major themes labeled
  • 13. © 2014 Quid, Inc.1313 Long-form news network, NASA publications highlighted and clusters containing them labeled NASA’s press release strategy has focused on the peripheral; it is largely absent from the core conversation debating the future vs. the past of space Source NASA Other Vesta Asteroid Moon SpaceX & Dragon Capsule Mars Curiosity Hubble Telescope & Exoplanets Space Shuttle
  • 14. © 2014 Quid, Inc.1414 Quid Technology Company A Company B < > < > < > < machine vision > < gaze coordinates > < eye tracking > Analyst has a big-picture view + Ability to zoom down to details KEYWORDS EXTRACTED FROM TEXT REPLICATED AT A VERY LARGE SCALE LINKS ESTABLISHED USING SHARED LANGUAGE < eye tracking > < gestures > < eye control >
  • 15. < Neural Connectivity > < Autism > < Mathematical > < Divergent thinking > NATURAL LANGUAGE PROCESSING
  • 17. Document #1 Document 2 Document 3 Document 4 DIGITAL SIGNATURE
  • 19. © 2014 Quid, Inc.1919 From lists to networks, from networks to lists
  • 20. © 2014 Quid, Inc.2020 Demo
  • 21. © 2014 Quid, Inc.2121 For information contact us at http://quid.com/contact … and we’re hiring! http://quid.com/careers Danielle Ben-Gera Kartik Sundar Joey Hobbs Ruggero Altair Tacchi