Han Woo PARK Associate Professor Dept of Media & Communication,  YeungNam University , S.Korea Director of WCU Webometrics Institute  http://english-webometrics.yu.ac.kr  han [email_address] http://www.hanpark.net  Se Jung Park Ph.D. Student, Dept of Media and Communication, YeungNam University. S.Korea David Stuart Honorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK. Seung Wook Lee MA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea Understanding WeboNaver : API-based search tool for the Naver search engine 박한우 ,  박세정 , David Stuart,  이승욱  (2010). API 를 활용한 검색 프로그램  WeboNaver 의 이해와 적용  : 18 대 국회의원의 웹 가시성 분석 . Journal of the Korean Data Analysis Society. 11 권  6 호  (B). WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
The purpose of this paper is to introduce the  API-based webometrics tool  created for the  Korean search engine Naver This non-commercial software is designed to  collect large amounts of data automatically and  can easily distinguish between different types of  information on the web, which was impossible  before.  Webonaver (Webometrics Tool for Naver) (Image Source: Newsweek, 5 Nov 2007) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Rationale for the Naver “ Republic of Naver”  (Kim & Sohn, 2007) CEO Google, 30 May 2007) “ Korea is a great laboratory of the digital age.”  (Eric Schmidt,  “ Korea’s Naver is now the world’s 5th search  service provider, behind Google, Yahoo, Baidu  and Microsoft.”   (The AP, 9 Oct 2007) (Image Source: Newsweek, 5 Nov 2007) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Rationale for the Naver “ Google left behind as Koreans Naver-gate  the internet ”  (Financial Times, 2 Jan 2008) “ IN SOUTH KOREA People who want to look something up on the internet don’t “Google it”.  Instead they “ask Naver”.  (Economist, 30 Feb 2009) Yeon-Ok Lee and Park. H. W., (2008). "The Importance of Search Engines in Digital News Consumption A Comparative Study Between South Korea and the UK". refereed paper presented at the Workshop “Gatekeepers in a Digital Asian-European Media Landscape: The rising structural power of Internet search engines”(2008). WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Component of Naver WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  Log-in The articles title  (changing automatically ) The press linked Today’s  issues Quick menu browser window
Terms of Use WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Interface WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  The interface is fairly self-explanatory: Tick or untick to collect either only hit    number or the title, URL, and description    of the results  - Select which of the search options you    want to include - Click on the '...' button to select the text file    that contains the queries you wish to run - Click 'Run Queries' WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Getting an API key WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  URL  :  http://dev.naver.com/openapi/register **This page need the Login
Search query limit WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  API Key Search query limit per day: 25,000
Input file WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  *.txt file must encoded by UTF-8 type
Output file WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  When you tick it to collect only hit number, it shows the number of web pages containing search query
Pilot comparison between    API and Manual Webpage search WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  Comparison was done using randomly selected Korean politicians as of 12 Aug 2009
There are always differences between the   API’s results and the normal search results,  but these are miniscule differences in  comparison with the APIs of Google, Yahoo  and Bing Pilot comparison between    API’s and Manual WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Output file WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  When you tick it to parse the title, URL, and description of the results (except for images which doesn’t have) the number of  web pages containing search query
Issues in multiple hits WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  The multiple hits reflect the numbers displayed in pages of the Naver. It’s not program error. The Webonaver show actual different numbers of the results from the Naver.  The last hits show actual results Webonaver can extract.  It’s not the only case of the Naver, but also other search engines such as yahoo display different results as an each webpage.
Issues in multiple hits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Issues in multiple hits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Issues in multiple hits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Output file WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  The Naver API doesn't provide the  real URL. Rather it supplies a  'Naver API’.  But, user can visit an actual site  when they put the api-based URL  to the window browser of the Naver.
There are programming and time issues,  but there are also issues regarding how  service provider responds. Naver is more protective of handing out API  keys, in comparison with yahoo or Bing which  provide Open APIs. It is important that services are not abused. Ethical issues WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Korean National Assembly Members’ web presence Web presence of Korean 18 th  congressman between 27th August and 24th September is automatically collected using WeboNaver at an interval of a week. 20 members’ web presence including blog, scholar, news and web documents is visualized.
web presence of the term H1N1 is examined using Webonaver. We tested the usability and reliability of this tool.  Queres:  신종플루 ( A virus subtype H1N1 ) 신종 인플루엔자 ( Influenza A virus subtype H1N1) 신종인플루엔자 ( Influenza  A virus subtype H1N1) Users can get same results from certain words containing space character and the one without space using WeboNaver. But, it can not assume similar words as same. Users should consider which specific data they want to extract before using this tool. Web presence of the term H1N1 WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
API-based search tool such as WeboNaver enables researchers to capture massive web data automatically and systemically.  This software can help researchers improve efficiency of data analysis within a specified timeframe. Web data gathered using this tool can also be visualized to describe online trend. Conclusion WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Mayr, Philipp; Tosques, Fabio (2005).  Google Web APIs - An instrument for webometric  analyses?  pp. 677-678. In: Ingwersen, Peter; Larsen, Birger (eds.): 10th International Conference of the International Society for Scientometrics and informetrics. Stockholm (Sweden) http://www.ib.hu-berlin.de/~mayr/arbeiten/ISSI2005_Mayr_Toques.pdf The project site with the APIs demos is offline these days. But they are recovering the demos soon.  http://bsd119.ib.hu-berlin.de/%7Eft/ Reference  (Web APIs) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS  WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
This tool is publicly available.  Please check out WWI official website.  http://www.hanpark.net  ->software WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Understanding WeboNaver

  • 1.
    Han Woo PARKAssociate Professor Dept of Media & Communication, YeungNam University , S.Korea Director of WCU Webometrics Institute http://english-webometrics.yu.ac.kr han [email_address] http://www.hanpark.net Se Jung Park Ph.D. Student, Dept of Media and Communication, YeungNam University. S.Korea David Stuart Honorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK. Seung Wook Lee MA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea Understanding WeboNaver : API-based search tool for the Naver search engine 박한우 , 박세정 , David Stuart, 이승욱 (2010). API 를 활용한 검색 프로그램 WeboNaver 의 이해와 적용 : 18 대 국회의원의 웹 가시성 분석 . Journal of the Korean Data Analysis Society. 11 권 6 호 (B). WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 2.
    The purpose ofthis paper is to introduce the API-based webometrics tool created for the Korean search engine Naver This non-commercial software is designed to collect large amounts of data automatically and can easily distinguish between different types of information on the web, which was impossible before. Webonaver (Webometrics Tool for Naver) (Image Source: Newsweek, 5 Nov 2007) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 3.
    Rationale for theNaver “ Republic of Naver” (Kim & Sohn, 2007) CEO Google, 30 May 2007) “ Korea is a great laboratory of the digital age.” (Eric Schmidt, “ Korea’s Naver is now the world’s 5th search service provider, behind Google, Yahoo, Baidu and Microsoft.” (The AP, 9 Oct 2007) (Image Source: Newsweek, 5 Nov 2007) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 4.
    Rationale for theNaver “ Google left behind as Koreans Naver-gate the internet ” (Financial Times, 2 Jan 2008) “ IN SOUTH KOREA People who want to look something up on the internet don’t “Google it”. Instead they “ask Naver”. (Economist, 30 Feb 2009) Yeon-Ok Lee and Park. H. W., (2008). "The Importance of Search Engines in Digital News Consumption A Comparative Study Between South Korea and the UK". refereed paper presented at the Workshop “Gatekeepers in a Digital Asian-European Media Landscape: The rising structural power of Internet search engines”(2008). WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 5.
    Component of NaverWCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS Log-in The articles title (changing automatically ) The press linked Today’s issues Quick menu browser window
  • 6.
    Terms of UseWCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 7.
    Interface WCU WEBOMETRICSINSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS The interface is fairly self-explanatory: Tick or untick to collect either only hit number or the title, URL, and description of the results  - Select which of the search options you want to include - Click on the '...' button to select the text file that contains the queries you wish to run - Click 'Run Queries' WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 8.
    Getting an APIkey WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS URL : http://dev.naver.com/openapi/register **This page need the Login
  • 9.
    Search query limitWCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS API Key Search query limit per day: 25,000
  • 10.
    Input file WCUWEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS *.txt file must encoded by UTF-8 type
  • 11.
    Output file WCUWEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS When you tick it to collect only hit number, it shows the number of web pages containing search query
  • 12.
    Pilot comparison between API and Manual Webpage search WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS Comparison was done using randomly selected Korean politicians as of 12 Aug 2009
  • 13.
    There are alwaysdifferences between the API’s results and the normal search results, but these are miniscule differences in comparison with the APIs of Google, Yahoo and Bing Pilot comparison between API’s and Manual WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 14.
    Output file WCUWEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS When you tick it to parse the title, URL, and description of the results (except for images which doesn’t have) the number of web pages containing search query
  • 15.
    Issues in multiplehits WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS The multiple hits reflect the numbers displayed in pages of the Naver. It’s not program error. The Webonaver show actual different numbers of the results from the Naver. The last hits show actual results Webonaver can extract. It’s not the only case of the Naver, but also other search engines such as yahoo display different results as an each webpage.
  • 16.
    Issues in multiplehits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 17.
    Issues in multiplehits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 18.
    Issues in multiplehits example WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 19.
    Output file WCUWEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS The Naver API doesn't provide the real URL. Rather it supplies a 'Naver API’. But, user can visit an actual site when they put the api-based URL to the window browser of the Naver.
  • 20.
    There are programmingand time issues, but there are also issues regarding how service provider responds. Naver is more protective of handing out API keys, in comparison with yahoo or Bing which provide Open APIs. It is important that services are not abused. Ethical issues WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 21.
    Korean National AssemblyMembers’ web presence Web presence of Korean 18 th congressman between 27th August and 24th September is automatically collected using WeboNaver at an interval of a week. 20 members’ web presence including blog, scholar, news and web documents is visualized.
  • 23.
    web presence ofthe term H1N1 is examined using Webonaver. We tested the usability and reliability of this tool. Queres: 신종플루 ( A virus subtype H1N1 ) 신종 인플루엔자 ( Influenza A virus subtype H1N1) 신종인플루엔자 ( Influenza A virus subtype H1N1) Users can get same results from certain words containing space character and the one without space using WeboNaver. But, it can not assume similar words as same. Users should consider which specific data they want to extract before using this tool. Web presence of the term H1N1 WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 25.
    API-based search toolsuch as WeboNaver enables researchers to capture massive web data automatically and systemically. This software can help researchers improve efficiency of data analysis within a specified timeframe. Web data gathered using this tool can also be visualized to describe online trend. Conclusion WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 26.
    Mayr, Philipp; Tosques,Fabio (2005).  Google Web APIs - An instrument for webometric analyses?  pp. 677-678. In: Ingwersen, Peter; Larsen, Birger (eds.): 10th International Conference of the International Society for Scientometrics and informetrics. Stockholm (Sweden) http://www.ib.hu-berlin.de/~mayr/arbeiten/ISSI2005_Mayr_Toques.pdf The project site with the APIs demos is offline these days. But they are recovering the demos soon. http://bsd119.ib.hu-berlin.de/%7Eft/ Reference (Web APIs) WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
  • 27.
    This tool ispublicly available. Please check out WWI official website. http://www.hanpark.net ->software WCU WEBOMETRICS INSTITUTE INVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Editor's Notes

  • #2 WeboNaver 를 이용한 웹영향력분석의 이해
  • #28 WeboNaver 를 이용한 웹영향력분석의 이해