Analyzing Web Crawler as Feed Forward Engine for Efficient Solution to Search Problem in the Minimum Amount of Time through a Distributed Framework
•Download as PPT, PDF•
1 like•920 views
My presentation slides for paper presented in International Conference on Information Science and Applications, ICISA, Seoul 2010. Paper link: http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=5480411&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D5480411
![[object Object],[object Object],[object Object],[object Object],[object Object],International Conference on Information Science and Applications 2010](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Recommended
More Related Content
Viewers also liked
Similar to Analyzing Web Crawler as Feed Forward Engine for Efficient Solution to Search Problem in the Minimum Amount of Time through a Distributed Framework
Similar to Analyzing Web Crawler as Feed Forward Engine for Efficient Solution to Search Problem in the Minimum Amount of Time through a Distributed Framework (20)
More from M. Atif Qureshi
More from M. Atif Qureshi (10)
Recently uploaded
Recently uploaded (20)
Analyzing Web Crawler as Feed Forward Engine for Efficient Solution to Search Problem in the Minimum Amount of Time through a Distributed Framework
- 1. Authors Muhammad Atif Qureshi Arjumand Younus Francisco Rojas International Conference on Information Science and Applications 2010
- 3. Analyzing Web Crawler as Feed Forward Engine for Efficient Solution to Search Problem in the Minimum Amount of Time through a Distributed Framework International Conference on Information Science and Applications 2010
- 12. International Conference on Information Science and Applications 2010 [ Implementation Alternatives ] No. of Seed URLs were kept constant at 1000
- 13. International Conference on Information Science and Applications 2010 [ Implementation Alternatives ] Pool size was kept constant at 200
- 15. International Conference on Information Science and Applications 2010 [ Crawler Architecture]
- 16. International Conference on Information Science and Applications 2010 The distributed implementation was done with our own version of MapReduce[DG04] library. [ Crawler Architecture]
- 17. Target server: yahoo.com Same crawling machines Simultaneous and continuing connections [ Crawler Architecture] International Conference on Information Science and Applications 2010
- 18. [ Crawler Architecture] International Conference on Information Science and Applications 2010 Push Right-side Order URL Pop Left-side Priority 1 a.com 1 2 a.com /a 7 3 1 . a.com 5 4 b.com 2 5 c.net 3 6 1 . b.com 6 7 c.com 4
- 19. IMPLICATIONS International Conference on Information Science and Applications 2010
Editor's Notes
- Previous contributions have been made in web servers performance analysis
- Problems