SlideShare a Scribd company logo
1 of 15
Download to read offline
Timilar

Finding similarity between twitter users
           Semantic Web Project



            Amit Krishna Joshi
                  2011
Key concepts
 Tweet Similarity
   Twitter
   Keywords
   Semantic Meta-data
   Normalized Google Distance
Phases

Extract tweets and           Extract Semantics            Integrate and Design
user meta                    • Consume Alchemy web        user Interface
• Retrieve 100 most recent     service to receive         • Integrate all modules
  tweets                       semantic metadata of       • Desing user initerface
• Retrieve list of friends     tweets and the links in
                               tweets                     • Perform testing
  and friends
• Extract links from each    • Use cosine algorithm to
  tweet                        determine the similarity
                             • Implement google
                               similarity and computer
                               aggregate similarity
API and Web Services

 Twittter Rest API
   Get tweets
   Get friends and followers of a user


 Alchemy REST API:
   Get semantic meta-data for the tweets and contents of links in
   tweets

 Readablility API
   Clean up messy HTML before sending requests to Alchemy
Semantic Meta-data



 html, internet, web, social
  network, semantic web        FieldTerminology
Workflow
                                         1. Get tweets and user metadata


                                       2. Extracts urls and get url contents
         Two twitter
          usernames
                                       3. Clean up html contents
User                         Timilar
                                       4. Get Semantic Metadata
       1. Tag Cloud
       2. Similarity Chart
       3. Similarity Score             5. Compute Keyword and Semantic
                                       Similarity using Cosine Algorithm

                                       6. Compute Google Similarity for
                                       each pair of terms
Algorithm Implementation

 Cosine Similarity




 Google Similarity:
Google Similarity
Project Timeline
Enhancements
 Dynamic Similarity
 Automatic score generation for all friends
 Use Streaming API
Demo – Disaster !!!
 Need of recorded Video Demos ☺
Demo
Web Application
  Input – two twitter usernames
  Output –
    Tag cloud
    Keyword Similarity
    Semantic Similarity based on Alchemy API
    Aggregated Semantic Similarity using NGD
Accomplishments
 Finding similarity between any two entities
   instance matching
   semantic associations through
   schemas/vocabularies/ontologies/classifications
 Metadata and ontologies for connecting disparate data
 Latent Semantics
 Similarity Algorithms
   Jaccard’s Coefficient
   Cosine Similarity
   Google Similarity
Thanks!

More Related Content

Similar to Timilar ppt

J2EE : Java servlet and its types, environment
J2EE : Java servlet and its types, environmentJ2EE : Java servlet and its types, environment
J2EE : Java servlet and its types, environment
joearunraja2
 
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
Michael Koster
 
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
Michael Koster
 
Copyright © 2017, 2018 Sinclair Community College. All Right.docx
Copyright © 2017, 2018 Sinclair Community College. All Right.docxCopyright © 2017, 2018 Sinclair Community College. All Right.docx
Copyright © 2017, 2018 Sinclair Community College. All Right.docx
bobbywlane695641
 

Similar to Timilar ppt (20)

Hash Tag Generation For Social Media Content
Hash Tag Generation For Social Media ContentHash Tag Generation For Social Media Content
Hash Tag Generation For Social Media Content
 
Azure Digital Twins 2.0
Azure Digital Twins 2.0Azure Digital Twins 2.0
Azure Digital Twins 2.0
 
Html microdata
Html microdataHtml microdata
Html microdata
 
Oleg Trygub TweetSyn demo
Oleg Trygub TweetSyn demoOleg Trygub TweetSyn demo
Oleg Trygub TweetSyn demo
 
On the Persistence of Persistent Identifiers of the Scholarly Web
On the Persistence of Persistent Identifiers of the Scholarly WebOn the Persistence of Persistent Identifiers of the Scholarly Web
On the Persistence of Persistent Identifiers of the Scholarly Web
 
Development of Twitter Application #1 - Overview
Development of Twitter Application #1 - OverviewDevelopment of Twitter Application #1 - Overview
Development of Twitter Application #1 - Overview
 
Portal and Intranets
Portal and Intranets Portal and Intranets
Portal and Intranets
 
Sviluppare app per office
Sviluppare app per officeSviluppare app per office
Sviluppare app per office
 
SpringOne Tour: An Introduction to Azure Spring Apps Enterprise
SpringOne Tour: An Introduction to Azure Spring Apps EnterpriseSpringOne Tour: An Introduction to Azure Spring Apps Enterprise
SpringOne Tour: An Introduction to Azure Spring Apps Enterprise
 
J2EE : Java servlet and its types, environment
J2EE : Java servlet and its types, environmentJ2EE : Java servlet and its types, environment
J2EE : Java servlet and its types, environment
 
Ember - introduction
Ember - introductionEmber - introduction
Ember - introduction
 
What's new for Developers in SharePoint 2013
What's new for Developers in SharePoint 2013What's new for Developers in SharePoint 2013
What's new for Developers in SharePoint 2013
 
Build, Deploy, and Serve Machine-Learning Models on Streaming Data Using Amaz...
Build, Deploy, and Serve Machine-Learning Models on Streaming Data Using Amaz...Build, Deploy, and Serve Machine-Learning Models on Streaming Data Using Amaz...
Build, Deploy, and Serve Machine-Learning Models on Streaming Data Using Amaz...
 
Building Enterprise-Ready Knowledge Graph Applications in the Cloud
Building Enterprise-Ready Knowledge Graph Applications in the CloudBuilding Enterprise-Ready Knowledge Graph Applications in the Cloud
Building Enterprise-Ready Knowledge Graph Applications in the Cloud
 
Spring 3.1 in a Nutshell - JAX London 2011
Spring 3.1 in a Nutshell - JAX London 2011Spring 3.1 in a Nutshell - JAX London 2011
Spring 3.1 in a Nutshell - JAX London 2011
 
Spring Day | Spring 3.1 in a Nutshell | Sam Brannen
Spring Day | Spring 3.1 in a Nutshell | Sam BrannenSpring Day | Spring 3.1 in a Nutshell | Sam Brannen
Spring Day | Spring 3.1 in a Nutshell | Sam Brannen
 
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
Open Horizontal Platform - Web Scale Interoperability for the Internet of Thi...
 
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
Open Horizontal Platform - Web Scale Interoperability for IoT - CCNA 2013
 
Salesforce Lightning Web Components Overview
Salesforce Lightning Web Components OverviewSalesforce Lightning Web Components Overview
Salesforce Lightning Web Components Overview
 
Copyright © 2017, 2018 Sinclair Community College. All Right.docx
Copyright © 2017, 2018 Sinclair Community College. All Right.docxCopyright © 2017, 2018 Sinclair Community College. All Right.docx
Copyright © 2017, 2018 Sinclair Community College. All Right.docx
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 

Timilar ppt

  • 1. Timilar Finding similarity between twitter users Semantic Web Project Amit Krishna Joshi 2011
  • 2. Key concepts Tweet Similarity Twitter Keywords Semantic Meta-data Normalized Google Distance
  • 3. Phases Extract tweets and Extract Semantics Integrate and Design user meta • Consume Alchemy web user Interface • Retrieve 100 most recent service to receive • Integrate all modules tweets semantic metadata of • Desing user initerface • Retrieve list of friends tweets and the links in tweets • Perform testing and friends • Extract links from each • Use cosine algorithm to tweet determine the similarity • Implement google similarity and computer aggregate similarity
  • 4. API and Web Services Twittter Rest API Get tweets Get friends and followers of a user Alchemy REST API: Get semantic meta-data for the tweets and contents of links in tweets Readablility API Clean up messy HTML before sending requests to Alchemy
  • 5. Semantic Meta-data html, internet, web, social network, semantic web FieldTerminology
  • 6.
  • 7. Workflow 1. Get tweets and user metadata 2. Extracts urls and get url contents Two twitter usernames 3. Clean up html contents User Timilar 4. Get Semantic Metadata 1. Tag Cloud 2. Similarity Chart 3. Similarity Score 5. Compute Keyword and Semantic Similarity using Cosine Algorithm 6. Compute Google Similarity for each pair of terms
  • 8. Algorithm Implementation Cosine Similarity Google Similarity:
  • 11. Enhancements Dynamic Similarity Automatic score generation for all friends Use Streaming API
  • 12. Demo – Disaster !!! Need of recorded Video Demos ☺
  • 13. Demo Web Application Input – two twitter usernames Output – Tag cloud Keyword Similarity Semantic Similarity based on Alchemy API Aggregated Semantic Similarity using NGD
  • 14. Accomplishments Finding similarity between any two entities instance matching semantic associations through schemas/vocabularies/ontologies/classifications Metadata and ontologies for connecting disparate data Latent Semantics Similarity Algorithms Jaccard’s Coefficient Cosine Similarity Google Similarity