SlideShare a Scribd company logo
1 of 17
Download to read offline
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Your Name – Your Company
your@email
www.yourwebsite.com
Stuart E. Middleton
University of Southampton IT Innovation Centre
sem@it-innovation.soton.ac.uk
www.it-innovation.soton.ac.uk
REVEAL Project - Trust and Credibility Analysis
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
RDSM 2015 Invited Talk Overview
1
 REVEAL Project
 Modality Analysis of Social Media Streams
 Geosemantics and Spatio-Temporal Grounding of Rumours
 Knowledge-based Approach to Trust and Credibility Modelling
 Future Work
Overview
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Overview
2
 Objectives
 Enable users to reveal hidden ‘modalities’ such as reputation, influence or credibility of information
 Approach - Modality Extraction and Analysis
 Real-time modality extraction
 On-demand analytics capabilities
 Event-driven architecture using RabbitMQ to communicate
 Processing based on a scalable STORM cluster (real-time) & standalone HTTP services (on-demand)
 Journalism Use Case
 Newsgathering - Find newsworthy content and evidence to help verify this content
 Enterprise Use Case
 Forums - Identify and help newbies, track product feedback & sentiment & emerging trends
REVEAL Project
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Modality Extraction
3
 Social Media Streams
 Twitter, You Tube, Instagram, Facebook, Four Square
 Search (historical) and Stream (real-time)
 Social Network Analysis
 Community Detection, Community Graph Extraction, Community Classification (e.g. topics), Role
Analysis (e.g. popular participant), Influence Models ...
 Content Analysis
 Image Feature Extraction (e.g. sky, city), Image Similarity Clustering, Multimedia Indexing, Image
Manipulation Detection, Topic Models, Original Content Detection, Text Stylometry ...
 Geospatial Analysis
 Geoparsing, Geosemantic Classification, Image-based Geolocation, Geospatial Topic Model ...
 Semantic Analysis
 Directed Linked-Data Crawler, Semantic Context (e.g. context summaries based on linked data) ...
Modality Analysis of Social Media Streams
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Real-Time Annotation of Social Media
4
Modality Analysis of Social Media Streams
JSON Twitter @stuart_e_middle <tweet>
Author
Timestamp
URI's
Hashtags
...
Geoparsed
Location
Influence
Score
Topic
Model
JSON Facebook BBCNews <post>
JSON YouTube CNN <video>
JSON Instagram bbcnews <image>
11:30
11:35
11:40
11:45
11:50
Content Created
Text
Stylometry
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Incremental Aggregation of Annotated Social Media
5
Modality Analysis of Social Media Streams
JSON Facebook BBCNews <post>
JSON YouTube CNN <video>
JSON Instagram bbcnews <image>
JSON Twitter @stuart.e.middle <tweet>
JSON Facebook Profile @gadgetshow
JSON Instagram gadgetshow <image>
Cross Check
- Timestamps
- Locations
- Authors
...
Trust Analysis
- Trusted sources
- Reputations
- Correlation to known facts
...
Trustworthy
Evidence
Credible
Evidence
User Feedback
User Feedback
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Geosemantic Classification of Evidence
6
 What is ‘geosemantics’
 Study of context of spatial data - in our case contextual text relating to mentioned locations
 Our Approach – Geosemantic feature classification
 Geoparsing [Planet OpenStreetMap database] » LOC (high precision, native language)
 Text + POS + LOC + training set » classifier » context of how is location is talked about
 Classes » timeliness past | future | present, situatedness insitu | remote, confirmation confirm | deny
 Eyewitness reports » insitu
 Breaking content » present
 Denial of rumours » deny
 State of the art – Geosemantic text analysis
 Text + POS + training set » classifier » event type
 Location text » NLP Grammar » direction & distance
 e.g. trouble spotted 5 miles north of London
 Location text » sentiment analysis » good / bad opinion of text
 Resilience of approaches across event types and languages an issue
Geosemantics and Spatio-Temporal Grounding of Rumours
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium 7
Geosemantics and Spatio-Temporal Grounding of Rumours
Open Street Map
Planet Database
Twitter Search & Streaming API
You Tube Search API
Instagram Search API
locations &
geometry
Keywords
Focus
Area(s)
RabbitMQ
HTTP, SQL,
SPARQL
JSON tweets
JSON tweets
+ Locations
JSON tweets
+ Locations
+ Class labels
Social
Media
Crawler
Geoparse
Geoparse
Geoparse
Geoparse
Geoparse
Geoclassify
Situation
Assessment
Visualization
Storm
Topology
Service
Key
Geospatial
Pre-processing
SQL content +
loc + class
CITATION geosemantics
Middleton, S.E. Krivcovs, V.
"Geoparsing and Geosemantic Analysis of Social Media for
Spatio-temporal Grounding of Rumours during Breaking News"
submitted TOIS 2015
CITATION geoparsing
Middleton, S.E. Middleton, L. Modafferi, S.
"Real-time Crisis Mapping of Natural Disasters using Social Media"
Intelligent Systems, IEEE , vol.29, no.2, pp.9,17, Mar.-Apr. 2014
CITATION tech blog
Middleton, S.E.
"From Twitter-based Crisis Mapping to Large-scale Real-Time
Situation Assessment with Trust and Credibility Analysis", 2014
http://revealproject.eu/
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Case Study - NYSE flooding in 2012 (false rumour)
8
 Geosemantic filtering of evidence
 7000+ tweets in 5 minute analysis window
 114 ground truth tweets - WeatherChannel & CNN
 Geosemantic filter reduced content volume by 95%
 100% ground truth recall for CONFIRM class
 85% ground truth recall for DENY class
Geosemantics and Spatio-Temporal Grounding of Rumours
New York Stock Exchange
(building)
Battery Park
(park)
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Case Study - Donetsk Airport 2015 (conflicting claims)
9
 Spatio-temporal mapping of evidence
 300,000 Tweets, YouTube & Instagram posts over 24 hours of Ukraine Crisis for 20th Jan 2015
 4 ground truth YouTube videos used by LifeNews reports on 20th Jan 2015
 Focus: Dontesk Airport cluster
 Ground truth URI's ranked 10,14 & 28 out of 30
Geosemantics and Spatio-Temporal Grounding of Rumours
Веселе
(suburb)
Donetsk Airport
(building)
Київський проспект
(road)
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Definitions
10
 What is ‘credibility’ and ‘trust’ ?
 Trust and credibility are not well defined – below is our interpretation
 Credibility - consistency with other content (e.g. similar reports) and contextual information (e.g. local
geography)
 Trust - subjective assessment of likelihood of content being false
 A credible news report might still be false!
Knowledge-based Approach to Trust and Credibility Modelling
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Approach
11
 Our Approach – Knowledge-based Trust Modelling
 Journalist already have personal sets of trusted sources they have come to rely upon
 Knowledge-based approach
 Journalist assert a-priori known facts (e.g. trusted sources, known locations)
 Evidence from streams asserted incrementally into a triple store (i.e. useekm + owlim)
 Simple inference » classify evidence » interactive exploration of evidence with journalist
 OWL classes & individuals, owl:Restriction, owl:intersectionOf, SPARQL, GeoSPARQL ...
 Not a black box - End users explore the evidence and we help them make a verification decision
 Scalable approach able to represent different viewpoints of Journalists
 State of the Art – Trust and Credibility Modelling
 Unsupervised learning (e.g. Bayesian Network, Damper Shafer) » trust prediction without explanation
 Supervised reputation models » trust prediction with explanation
 Heuristics & activity metrics » trust prediction with explanation
Knowledge-based Approach to Trust and Credibility Modelling
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Early Results - Work in Progress
12
Knowledge-based Approach to Trust and Credibility Modelling
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Early Results - Work in Progress
13
Knowledge-based Approach to Trust and Credibility Modelling
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Early Results - Work in Progress
14
Knowledge-based Approach to Trust and Credibility Modelling
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium
Roadmap for REVEAL Trust and Credibility Analysis
15
 REVEAL project runs until Sept 2016
 Ethnographic studies with Journalists
 Crawl content in parallel to journalists searching User Generated Content (UGC)
 Record ground truth by observing Journalists verifying news for real & explaining decisions
 Empirical analysis - compare automated decisions with ground truth
 MediaEval 2015 verification challenge
 Competition verifying images using a common Twitter dataset (10 different news events)
 Users trials 2015 - 2016
Future Work
REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium 16
Any questions?
Stuart E. Middleton
University of Southampton IT Innovation Centre
email: sem@it-innovation.soton.ac.uk
web: www.it-innovation.soton.ac.uk
twitter:@stuart_e_middle, @IT_Innov, @RevealEU
Many thanks for your attention!

More Related Content

Similar to WWW2015 - RDSM2015 Workshop - Trust and Credibility Analysis

TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...
TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...
TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...REVEAL - Social Media Verification
 
Veracity & Velocity of Social Media Content during Breaking News
Veracity & Velocity of Social Media Content during Breaking NewsVeracity & Velocity of Social Media Content during Breaking News
Veracity & Velocity of Social Media Content during Breaking NewsREVEAL - Social Media Verification
 
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...REVEAL - Social Media Verification
 
Social media as a trustworthy news source: Exploring journalists’ working pra...
Social media as a trustworthy news source: Exploring journalists’ working pra...Social media as a trustworthy news source: Exploring journalists’ working pra...
Social media as a trustworthy news source: Exploring journalists’ working pra...Petter Bae Brandtzæg
 
LinkedTV results at the end of the 3rd year
LinkedTV results at the end of the 3rd yearLinkedTV results at the end of the 3rd year
LinkedTV results at the end of the 3rd yearLinkedTV
 
"Extracting Attributed Verification and Debunking Reports from Social Media: ...
"Extracting Attributed Verification and Debunking Reports from Social Media: ..."Extracting Attributed Verification and Debunking Reports from Social Media: ...
"Extracting Attributed Verification and Debunking Reports from Social Media: ...REVEAL - Social Media Verification
 
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...CloudTeams - Boosting Collaboration of Developers and End Users Together for ...
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...CloudTeams
 
Munir salman
Munir salmanMunir salman
Munir salmanmunirtest
 
TTO Keynote 08 10 2021
TTO Keynote 08 10 2021TTO Keynote 08 10 2021
TTO Keynote 08 10 2021Weverify
 
EMDS-FIWARE-Workshop-WP2_Inventory.pptx
EMDS-FIWARE-Workshop-WP2_Inventory.pptxEMDS-FIWARE-Workshop-WP2_Inventory.pptx
EMDS-FIWARE-Workshop-WP2_Inventory.pptxFIWARE
 
WeVerify at NILC - May 2019.pptx
WeVerify at NILC - May 2019.pptxWeVerify at NILC - May 2019.pptx
WeVerify at NILC - May 2019.pptxWeverify
 
Web Strategy: Magic Formula For Success?
Web Strategy: Magic Formula For Success? Web Strategy: Magic Formula For Success?
Web Strategy: Magic Formula For Success? Web2LLP
 
Linked Television: a HbbTV application for enhancing broadcast TV with relate...
Linked Television: a HbbTV application for enhancing broadcast TV with relate...Linked Television: a HbbTV application for enhancing broadcast TV with relate...
Linked Television: a HbbTV application for enhancing broadcast TV with relate...LinkedTV
 
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...FIWARE
 
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ Project
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ ProjectQuantum Mechanics meet Information Search and Retrieval – The QUARTZ Project
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ ProjectIngo Frommholz
 
Future enterprise towards 2030 internet business innovation_20-21march2014,at...
Future enterprise towards 2030 internet business innovation_20-21march2014,at...Future enterprise towards 2030 internet business innovation_20-21march2014,at...
Future enterprise towards 2030 internet business innovation_20-21march2014,at...FutureEnterprise
 
Geoparsing and Real-time Social Media Analytics - technical and social challe...
Geoparsing and Real-time Social Media Analytics - technical and social challe...Geoparsing and Real-time Social Media Analytics - technical and social challe...
Geoparsing and Real-time Social Media Analytics - technical and social challe...REVEAL - Social Media Verification
 
ADEQUATe and CommuniData
ADEQUATe and CommuniDataADEQUATe and CommuniData
ADEQUATe and CommuniDataStadt Wien
 

Similar to WWW2015 - RDSM2015 Workshop - Trust and Credibility Analysis (20)

TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...
TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...
TRIDEC and REVEAL projects: Geoparsing and Geosemantic knowledge model for tr...
 
Veracity & Velocity of Social Media Content during Breaking News
Veracity & Velocity of Social Media Content during Breaking NewsVeracity & Velocity of Social Media Content during Breaking News
Veracity & Velocity of Social Media Content during Breaking News
 
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...
News Impact Summit - Verification, Investigation and Digital Ethics – Hamburg...
 
Social media as a trustworthy news source: Exploring journalists’ working pra...
Social media as a trustworthy news source: Exploring journalists’ working pra...Social media as a trustworthy news source: Exploring journalists’ working pra...
Social media as a trustworthy news source: Exploring journalists’ working pra...
 
LinkedTV results at the end of the 3rd year
LinkedTV results at the end of the 3rd yearLinkedTV results at the end of the 3rd year
LinkedTV results at the end of the 3rd year
 
"Extracting Attributed Verification and Debunking Reports from Social Media: ...
"Extracting Attributed Verification and Debunking Reports from Social Media: ..."Extracting Attributed Verification and Debunking Reports from Social Media: ...
"Extracting Attributed Verification and Debunking Reports from Social Media: ...
 
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...CloudTeams - Boosting Collaboration of Developers and End Users Together for ...
CloudTeams - Boosting Collaboration of Developers and End Users Together for ...
 
Munir salman
Munir salmanMunir salman
Munir salman
 
TTO Keynote 08 10 2021
TTO Keynote 08 10 2021TTO Keynote 08 10 2021
TTO Keynote 08 10 2021
 
EMDS-FIWARE-Workshop-WP2_Inventory.pptx
EMDS-FIWARE-Workshop-WP2_Inventory.pptxEMDS-FIWARE-Workshop-WP2_Inventory.pptx
EMDS-FIWARE-Workshop-WP2_Inventory.pptx
 
WeVerify at NILC - May 2019.pptx
WeVerify at NILC - May 2019.pptxWeVerify at NILC - May 2019.pptx
WeVerify at NILC - May 2019.pptx
 
Web Strategy: Magic Formula For Success?
Web Strategy: Magic Formula For Success? Web Strategy: Magic Formula For Success?
Web Strategy: Magic Formula For Success?
 
Linked Television: a HbbTV application for enhancing broadcast TV with relate...
Linked Television: a HbbTV application for enhancing broadcast TV with relate...Linked Television: a HbbTV application for enhancing broadcast TV with relate...
Linked Television: a HbbTV application for enhancing broadcast TV with relate...
 
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...
PrepData4Mobilty Inventory of mobility and logistics data ecosystems Sebastia...
 
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ Project
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ ProjectQuantum Mechanics meet Information Search and Retrieval – The QUARTZ Project
Quantum Mechanics meet Information Search and Retrieval – The QUARTZ Project
 
Future enterprise towards 2030 internet business innovation_20-21march2014,at...
Future enterprise towards 2030 internet business innovation_20-21march2014,at...Future enterprise towards 2030 internet business innovation_20-21march2014,at...
Future enterprise towards 2030 internet business innovation_20-21march2014,at...
 
OCRE: Adoption Funding - 1st Cloud Call - Jan Meijer
OCRE: Adoption Funding - 1st Cloud Call - Jan MeijerOCRE: Adoption Funding - 1st Cloud Call - Jan Meijer
OCRE: Adoption Funding - 1st Cloud Call - Jan Meijer
 
Geoparsing and Real-time Social Media Analytics - technical and social challe...
Geoparsing and Real-time Social Media Analytics - technical and social challe...Geoparsing and Real-time Social Media Analytics - technical and social challe...
Geoparsing and Real-time Social Media Analytics - technical and social challe...
 
RAGE ECGBL
RAGE ECGBLRAGE ECGBL
RAGE ECGBL
 
ADEQUATe and CommuniData
ADEQUATe and CommuniDataADEQUATe and CommuniData
ADEQUATe and CommuniData
 

More from REVEAL - Social Media Verification

Verification of UGC/Eyewitness Media: Challenges and Approaches
Verification of UGC/Eyewitness Media: Challenges and Approaches Verification of UGC/Eyewitness Media: Challenges and Approaches
Verification of UGC/Eyewitness Media: Challenges and Approaches REVEAL - Social Media Verification
 
Web image size prediction for efficient focused image crawling
Web image size prediction for efficient focused image crawlingWeb image size prediction for efficient focused image crawling
Web image size prediction for efficient focused image crawlingREVEAL - Social Media Verification
 
Geotagging Social Media Content with a Refined Language Modelling Approach
Geotagging Social Media Content with a Refined Language Modelling ApproachGeotagging Social Media Content with a Refined Language Modelling Approach
Geotagging Social Media Content with a Refined Language Modelling ApproachREVEAL - Social Media Verification
 
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...Mediarevealr: A social multimedia monitoring and intelligence system for Web ...
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...REVEAL - Social Media Verification
 
Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany
 Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany
Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, GermanyREVEAL - Social Media Verification
 

More from REVEAL - Social Media Verification (11)

REVEAL Project - Trust and Credibility Analysis
REVEAL Project - Trust and Credibility AnalysisREVEAL Project - Trust and Credibility Analysis
REVEAL Project - Trust and Credibility Analysis
 
Prix Italia 2015 - Verification in Social Newsgathering
Prix Italia 2015 - Verification in Social NewsgatheringPrix Italia 2015 - Verification in Social Newsgathering
Prix Italia 2015 - Verification in Social Newsgathering
 
Verification of UGC/Eyewitness Media: Challenges and Approaches
Verification of UGC/Eyewitness Media: Challenges and Approaches Verification of UGC/Eyewitness Media: Challenges and Approaches
Verification of UGC/Eyewitness Media: Challenges and Approaches
 
Web image size prediction for efficient focused image crawling
Web image size prediction for efficient focused image crawlingWeb image size prediction for efficient focused image crawling
Web image size prediction for efficient focused image crawling
 
News-oriented multimedia search over multiple social networks
News-oriented multimedia search over multiple social networksNews-oriented multimedia search over multiple social networks
News-oriented multimedia search over multiple social networks
 
Geotagging Social Media Content with a Refined Language Modelling Approach
Geotagging Social Media Content with a Refined Language Modelling ApproachGeotagging Social Media Content with a Refined Language Modelling Approach
Geotagging Social Media Content with a Refined Language Modelling Approach
 
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...Mediarevealr: A social multimedia monitoring and intelligence system for Web ...
Mediarevealr: A social multimedia monitoring and intelligence system for Web ...
 
Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany
 Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany
Cross-Media Konferenz "Think Cross - Change Media" in Magdeburg, Germany
 
Reveal - Social Media Verification - poster
Reveal - Social Media Verification - posterReveal - Social Media Verification - poster
Reveal - Social Media Verification - poster
 
Focused Exploration of Geospatial Context on Linked Open Data
Focused Exploration of Geospatial Context on Linked Open DataFocused Exploration of Geospatial Context on Linked Open Data
Focused Exploration of Geospatial Context on Linked Open Data
 
REVEAL - Social Media Verification - brochure
REVEAL - Social Media Verification - brochureREVEAL - Social Media Verification - brochure
REVEAL - Social Media Verification - brochure
 

Recently uploaded

2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 

Recently uploaded (20)

2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 

WWW2015 - RDSM2015 Workshop - Trust and Credibility Analysis

  • 1. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Your Name – Your Company your@email www.yourwebsite.com Stuart E. Middleton University of Southampton IT Innovation Centre sem@it-innovation.soton.ac.uk www.it-innovation.soton.ac.uk REVEAL Project - Trust and Credibility Analysis
  • 2. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium RDSM 2015 Invited Talk Overview 1  REVEAL Project  Modality Analysis of Social Media Streams  Geosemantics and Spatio-Temporal Grounding of Rumours  Knowledge-based Approach to Trust and Credibility Modelling  Future Work Overview
  • 3. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Overview 2  Objectives  Enable users to reveal hidden ‘modalities’ such as reputation, influence or credibility of information  Approach - Modality Extraction and Analysis  Real-time modality extraction  On-demand analytics capabilities  Event-driven architecture using RabbitMQ to communicate  Processing based on a scalable STORM cluster (real-time) & standalone HTTP services (on-demand)  Journalism Use Case  Newsgathering - Find newsworthy content and evidence to help verify this content  Enterprise Use Case  Forums - Identify and help newbies, track product feedback & sentiment & emerging trends REVEAL Project
  • 4. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Modality Extraction 3  Social Media Streams  Twitter, You Tube, Instagram, Facebook, Four Square  Search (historical) and Stream (real-time)  Social Network Analysis  Community Detection, Community Graph Extraction, Community Classification (e.g. topics), Role Analysis (e.g. popular participant), Influence Models ...  Content Analysis  Image Feature Extraction (e.g. sky, city), Image Similarity Clustering, Multimedia Indexing, Image Manipulation Detection, Topic Models, Original Content Detection, Text Stylometry ...  Geospatial Analysis  Geoparsing, Geosemantic Classification, Image-based Geolocation, Geospatial Topic Model ...  Semantic Analysis  Directed Linked-Data Crawler, Semantic Context (e.g. context summaries based on linked data) ... Modality Analysis of Social Media Streams
  • 5. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Real-Time Annotation of Social Media 4 Modality Analysis of Social Media Streams JSON Twitter @stuart_e_middle <tweet> Author Timestamp URI's Hashtags ... Geoparsed Location Influence Score Topic Model JSON Facebook BBCNews <post> JSON YouTube CNN <video> JSON Instagram bbcnews <image> 11:30 11:35 11:40 11:45 11:50 Content Created Text Stylometry
  • 6. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Incremental Aggregation of Annotated Social Media 5 Modality Analysis of Social Media Streams JSON Facebook BBCNews <post> JSON YouTube CNN <video> JSON Instagram bbcnews <image> JSON Twitter @stuart.e.middle <tweet> JSON Facebook Profile @gadgetshow JSON Instagram gadgetshow <image> Cross Check - Timestamps - Locations - Authors ... Trust Analysis - Trusted sources - Reputations - Correlation to known facts ... Trustworthy Evidence Credible Evidence User Feedback User Feedback
  • 7. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Geosemantic Classification of Evidence 6  What is ‘geosemantics’  Study of context of spatial data - in our case contextual text relating to mentioned locations  Our Approach – Geosemantic feature classification  Geoparsing [Planet OpenStreetMap database] » LOC (high precision, native language)  Text + POS + LOC + training set » classifier » context of how is location is talked about  Classes » timeliness past | future | present, situatedness insitu | remote, confirmation confirm | deny  Eyewitness reports » insitu  Breaking content » present  Denial of rumours » deny  State of the art – Geosemantic text analysis  Text + POS + training set » classifier » event type  Location text » NLP Grammar » direction & distance  e.g. trouble spotted 5 miles north of London  Location text » sentiment analysis » good / bad opinion of text  Resilience of approaches across event types and languages an issue Geosemantics and Spatio-Temporal Grounding of Rumours
  • 8. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium 7 Geosemantics and Spatio-Temporal Grounding of Rumours Open Street Map Planet Database Twitter Search & Streaming API You Tube Search API Instagram Search API locations & geometry Keywords Focus Area(s) RabbitMQ HTTP, SQL, SPARQL JSON tweets JSON tweets + Locations JSON tweets + Locations + Class labels Social Media Crawler Geoparse Geoparse Geoparse Geoparse Geoparse Geoclassify Situation Assessment Visualization Storm Topology Service Key Geospatial Pre-processing SQL content + loc + class CITATION geosemantics Middleton, S.E. Krivcovs, V. "Geoparsing and Geosemantic Analysis of Social Media for Spatio-temporal Grounding of Rumours during Breaking News" submitted TOIS 2015 CITATION geoparsing Middleton, S.E. Middleton, L. Modafferi, S. "Real-time Crisis Mapping of Natural Disasters using Social Media" Intelligent Systems, IEEE , vol.29, no.2, pp.9,17, Mar.-Apr. 2014 CITATION tech blog Middleton, S.E. "From Twitter-based Crisis Mapping to Large-scale Real-Time Situation Assessment with Trust and Credibility Analysis", 2014 http://revealproject.eu/
  • 9. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Case Study - NYSE flooding in 2012 (false rumour) 8  Geosemantic filtering of evidence  7000+ tweets in 5 minute analysis window  114 ground truth tweets - WeatherChannel & CNN  Geosemantic filter reduced content volume by 95%  100% ground truth recall for CONFIRM class  85% ground truth recall for DENY class Geosemantics and Spatio-Temporal Grounding of Rumours New York Stock Exchange (building) Battery Park (park)
  • 10. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Case Study - Donetsk Airport 2015 (conflicting claims) 9  Spatio-temporal mapping of evidence  300,000 Tweets, YouTube & Instagram posts over 24 hours of Ukraine Crisis for 20th Jan 2015  4 ground truth YouTube videos used by LifeNews reports on 20th Jan 2015  Focus: Dontesk Airport cluster  Ground truth URI's ranked 10,14 & 28 out of 30 Geosemantics and Spatio-Temporal Grounding of Rumours Веселе (suburb) Donetsk Airport (building) Київський проспект (road)
  • 11. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Definitions 10  What is ‘credibility’ and ‘trust’ ?  Trust and credibility are not well defined – below is our interpretation  Credibility - consistency with other content (e.g. similar reports) and contextual information (e.g. local geography)  Trust - subjective assessment of likelihood of content being false  A credible news report might still be false! Knowledge-based Approach to Trust and Credibility Modelling
  • 12. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Approach 11  Our Approach – Knowledge-based Trust Modelling  Journalist already have personal sets of trusted sources they have come to rely upon  Knowledge-based approach  Journalist assert a-priori known facts (e.g. trusted sources, known locations)  Evidence from streams asserted incrementally into a triple store (i.e. useekm + owlim)  Simple inference » classify evidence » interactive exploration of evidence with journalist  OWL classes & individuals, owl:Restriction, owl:intersectionOf, SPARQL, GeoSPARQL ...  Not a black box - End users explore the evidence and we help them make a verification decision  Scalable approach able to represent different viewpoints of Journalists  State of the Art – Trust and Credibility Modelling  Unsupervised learning (e.g. Bayesian Network, Damper Shafer) » trust prediction without explanation  Supervised reputation models » trust prediction with explanation  Heuristics & activity metrics » trust prediction with explanation Knowledge-based Approach to Trust and Credibility Modelling
  • 13. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Early Results - Work in Progress 12 Knowledge-based Approach to Trust and Credibility Modelling
  • 14. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Early Results - Work in Progress 13 Knowledge-based Approach to Trust and Credibility Modelling
  • 15. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Early Results - Work in Progress 14 Knowledge-based Approach to Trust and Credibility Modelling
  • 16. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium Roadmap for REVEAL Trust and Credibility Analysis 15  REVEAL project runs until Sept 2016  Ethnographic studies with Journalists  Crawl content in parallel to journalists searching User Generated Content (UGC)  Record ground truth by observing Journalists verifying news for real & explaining decisions  Empirical analysis - compare automated decisions with ground truth  MediaEval 2015 verification challenge  Competition verifying images using a common Twitter dataset (10 different news events)  Users trials 2015 - 2016 Future Work
  • 17. REVEAL Project: Co-funded by the EU FP7 Programme Nr.: 610928 www.revealproject.eu © 2015 REVEAL consortium 16 Any questions? Stuart E. Middleton University of Southampton IT Innovation Centre email: sem@it-innovation.soton.ac.uk web: www.it-innovation.soton.ac.uk twitter:@stuart_e_middle, @IT_Innov, @RevealEU Many thanks for your attention!