SlideShare a Scribd company logo
The PageRank Citation Ranking:Bringing Order to the Web Larry Page etc. Stanford University Presented by Guoqiang Su & Wei Li
Contents Motivation Related work Page Rank & Random Surfer Model Implementation Application Conclusion
Motivation ,[object Object]
Free of quality control on the web
Commercial interest to manipulate ranking,[object Object]
Backlink Link Structure of the Web Approximation of importance / quality
PageRank Pages with lots of backlinks are important Backlinks coming from important pages convey more importance to a page Problem: Rank Sink
Rank Sink Page cycles pointed by some incoming link Problem: this loop will accumulate rank but never distribute any rank outside
Escape Term Solution: Rank Source c is maximized and       = 1 E(u) is some vector over the web pages 	– uniform, favorite page etc.
Matrix Notation R is the dominant eigenvector and c is the dominant eigenvalue of                because c is maximized
Computing PageRank                                          		- initialize vector over web pages loop:                                          		- new ranks sum of normalized backlink ranks                             			      			           		- compute normalizing factor 			            		- add escape term 				 	- control parameter while                                		- stop when converged
Random Surfer Model Page Rank corresponds to the probability distribution of a random walk on the web graphs E(u) can be re-phrased as the random surfer gets bored periodically and jumps to a different page and not kept in a loop forever
Implementation Computing resources     —  24 million pages     —  75 million URLs Memory and disk storage Weight Vector    (4 byte float) 			 Matrix A    (linear access)
Implementation (Con't) Unique integer ID for each URL Sort and Remove dangling links Rank initial assignment Iteration until convergence Add back dangling links and Re-compute
Convergence Properties Graph (V, E) is an expander with factor  if for all (not too large) subsets S: |As| |s| Eigenvalue separation: Largest eigenvalue is sufficiently larger than the second-largest eigenvalue Random walk converges fast to a limiting probability distribution on a set of nodes in the graph.
Convergence Properties (con't) PageRank computation is O(log(|V|)) due to rapidly mixing graph G of the web.
Personalized PageRank Rank Source E can be initialized : 	– uniformly over all pages: e.g. copyright  	warnings, disclaimers, mailing lists archives  result in overly high ranking 	– total weight on a single page, e.g. Netscape, McCarthy   great variation of ranks under different single pages 	as rank source 	– and everything in-between, e.g. server root pages  allow manipulation by commercial interests
Applications I Estimate web traffic 	– Server/page aliases  	– Link/traffic disparity, e.g. porn sites, free web-mail Backlink predictor 	– Citation counts have been used to predict future citations  	– very difficult to map the citation structure of the web completely 	– avoid the local maxima that citation counts get stuck in and get better performance
Applications II - Ranking Proxy Surfer's Navigation Aid Annotating links by PageRank (bar graph) Not query dependent
Issues Users are no random walkers     	– Content based methods Starting point distribution – Actual usage data as starting vector Reinforcing effects/bias towards main pages How about traffic to ranking pages? No query specific rank Linkage spam     – PageRank favors pages that managed to get other pages to link to           them     – Linkage not necessarily a sign of relevancy, only of promotion           (advertisement…)
Evaluation I
Evaluation II

More Related Content

What's hot (10)

Pagerank
PagerankPagerank
Pagerank
 
Pagerank(2)
Pagerank(2)Pagerank(2)
Pagerank(2)
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
The Pagerank
The PagerankThe Pagerank
The Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 

Viewers also liked

Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
Alahad Group HR Services Staffing Solutions Training Payroll Outsourcing
Alahad Group HR Services Staffing Solutions Training Payroll OutsourcingAlahad Group HR Services Staffing Solutions Training Payroll Outsourcing
Alahad Group HR Services Staffing Solutions Training Payroll Outsourcing
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSAJobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
B2B Manpower Nepal | Recruitment Agencies in Nepal
B2B Manpower Nepal | Recruitment Agencies in NepalB2B Manpower Nepal | Recruitment Agencies in Nepal
B2B Manpower Nepal | Recruitment Agencies in Nepal
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
NPX Overview
NPX OverviewNPX Overview
NPX Overview
murp5348
 
Tidsstyring og selvledelse
Tidsstyring og selvledelseTidsstyring og selvledelse
Tidsstyring og selvledelse
Peder Giertsen
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan Alahad Group (Pvt) Ltd.
 
Analox Military Systems
Analox Military SystemsAnalox Military Systems
Analox Military Systems
Analox_AMS
 

Viewers also liked (11)

Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
 
Alahad Group HR Services Staffing Solutions Training Payroll Outsourcing
Alahad Group HR Services Staffing Solutions Training Payroll OutsourcingAlahad Group HR Services Staffing Solutions Training Payroll Outsourcing
Alahad Group HR Services Staffing Solutions Training Payroll Outsourcing
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
 
Kefir 2 Japan
Kefir 2 JapanKefir 2 Japan
Kefir 2 Japan
 
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSAJobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
Jobs in Saudi Arabia Search Saudi Arabia Jobs Recruitment Agencies in KSA
 
B2B Manpower Nepal | Recruitment Agencies in Nepal
B2B Manpower Nepal | Recruitment Agencies in NepalB2B Manpower Nepal | Recruitment Agencies in Nepal
B2B Manpower Nepal | Recruitment Agencies in Nepal
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
 
NPX Overview
NPX OverviewNPX Overview
NPX Overview
 
Tidsstyring og selvledelse
Tidsstyring og selvledelseTidsstyring og selvledelse
Tidsstyring og selvledelse
 
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
Recruitment Agencies in Pakistan, Employment Agencies Pakistan, Manpower Agen...
 
Analox Military Systems
Analox Military SystemsAnalox Military Systems
Analox Military Systems
 

Similar to Pagerank

Introduccion a las Finanzas
Introduccion a las FinanzasIntroduccion a las Finanzas
Introduccion a las Finanzaslaflaquita165
 
Pagerank
PagerankPagerank
Pagerankkaren
 
Pagerank (1)
Pagerank (1)Pagerank (1)
Pagerank (1)diego
 
Pagerank
PagerankPagerank
PagerankCarlos
 
Pagerank Di
Pagerank DiPagerank Di
Pagerank Dizulemita
 
Page rank by university of michagain.ppt
Page rank by university of michagain.pptPage rank by university of michagain.ppt
Page rank by university of michagain.ppt
rayyverma
 
Pagerank
PagerankPagerank
PagerankAdrian
 
Pagerank
PagerankPagerank
PagerankESPOL
 
Incremental Page Rank Computation on Evolving Graphs : NOTES
Incremental Page Rank Computation on Evolving Graphs : NOTESIncremental Page Rank Computation on Evolving Graphs : NOTES
Incremental Page Rank Computation on Evolving Graphs : NOTES
Subhajit Sahu
 
Markov chains and page rankGraphs.pdf
Markov chains and page rankGraphs.pdfMarkov chains and page rankGraphs.pdf
Markov chains and page rankGraphs.pdf
rayyverma
 

Similar to Pagerank (20)

Pagerank
PagerankPagerank
Pagerank
 
Introduccion a las Finanzas
Introduccion a las FinanzasIntroduccion a las Finanzas
Introduccion a las Finanzas
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank (1)
Pagerank (1)Pagerank (1)
Pagerank (1)
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank(2)
Pagerank(2)Pagerank(2)
Pagerank(2)
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank Di
Pagerank DiPagerank Di
Pagerank Di
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Page rank by university of michagain.ppt
Page rank by university of michagain.pptPage rank by university of michagain.ppt
Page rank by university of michagain.ppt
 
Ranking Web Pages
Ranking Web PagesRanking Web Pages
Ranking Web Pages
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Pagerank
PagerankPagerank
Pagerank
 
Incremental Page Rank Computation on Evolving Graphs : NOTES
Incremental Page Rank Computation on Evolving Graphs : NOTESIncremental Page Rank Computation on Evolving Graphs : NOTES
Incremental Page Rank Computation on Evolving Graphs : NOTES
 
Markov chains and page rankGraphs.pdf
Markov chains and page rankGraphs.pdfMarkov chains and page rankGraphs.pdf
Markov chains and page rankGraphs.pdf
 
Page Rank
Page RankPage Rank
Page Rank
 
Pagerank (1)
Pagerank (1)Pagerank (1)
Pagerank (1)
 

Recently uploaded

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 

Recently uploaded (20)

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 

Pagerank

  • 1. The PageRank Citation Ranking:Bringing Order to the Web Larry Page etc. Stanford University Presented by Guoqiang Su & Wei Li
  • 2. Contents Motivation Related work Page Rank & Random Surfer Model Implementation Application Conclusion
  • 3.
  • 4. Free of quality control on the web
  • 5.
  • 6. Backlink Link Structure of the Web Approximation of importance / quality
  • 7. PageRank Pages with lots of backlinks are important Backlinks coming from important pages convey more importance to a page Problem: Rank Sink
  • 8. Rank Sink Page cycles pointed by some incoming link Problem: this loop will accumulate rank but never distribute any rank outside
  • 9. Escape Term Solution: Rank Source c is maximized and = 1 E(u) is some vector over the web pages – uniform, favorite page etc.
  • 10. Matrix Notation R is the dominant eigenvector and c is the dominant eigenvalue of because c is maximized
  • 11. Computing PageRank - initialize vector over web pages loop: - new ranks sum of normalized backlink ranks - compute normalizing factor - add escape term - control parameter while - stop when converged
  • 12. Random Surfer Model Page Rank corresponds to the probability distribution of a random walk on the web graphs E(u) can be re-phrased as the random surfer gets bored periodically and jumps to a different page and not kept in a loop forever
  • 13. Implementation Computing resources — 24 million pages — 75 million URLs Memory and disk storage Weight Vector (4 byte float) Matrix A (linear access)
  • 14. Implementation (Con't) Unique integer ID for each URL Sort and Remove dangling links Rank initial assignment Iteration until convergence Add back dangling links and Re-compute
  • 15. Convergence Properties Graph (V, E) is an expander with factor  if for all (not too large) subsets S: |As| |s| Eigenvalue separation: Largest eigenvalue is sufficiently larger than the second-largest eigenvalue Random walk converges fast to a limiting probability distribution on a set of nodes in the graph.
  • 16. Convergence Properties (con't) PageRank computation is O(log(|V|)) due to rapidly mixing graph G of the web.
  • 17. Personalized PageRank Rank Source E can be initialized : – uniformly over all pages: e.g. copyright warnings, disclaimers, mailing lists archives  result in overly high ranking – total weight on a single page, e.g. Netscape, McCarthy  great variation of ranks under different single pages as rank source – and everything in-between, e.g. server root pages  allow manipulation by commercial interests
  • 18. Applications I Estimate web traffic – Server/page aliases – Link/traffic disparity, e.g. porn sites, free web-mail Backlink predictor – Citation counts have been used to predict future citations – very difficult to map the citation structure of the web completely – avoid the local maxima that citation counts get stuck in and get better performance
  • 19. Applications II - Ranking Proxy Surfer's Navigation Aid Annotating links by PageRank (bar graph) Not query dependent
  • 20. Issues Users are no random walkers – Content based methods Starting point distribution – Actual usage data as starting vector Reinforcing effects/bias towards main pages How about traffic to ranking pages? No query specific rank Linkage spam – PageRank favors pages that managed to get other pages to link to them – Linkage not necessarily a sign of relevancy, only of promotion (advertisement…)
  • 23. Conclusion PageRank is a global ranking based on the web's graph structure PageRank use backlinks information to bring order to the web PageRank can separate out representative pages as cluster center A great variety of applications