genta kaneyama, profile picture
Uploaded bygenta kaneyama
PDF, PPTX1,418 views

solr@twitter検索2010

solr勉強会2回目発表資料

Embed presentation

Download as PDF, PPTX
Solr@twitter (yats)   http://pcod.no-ip.org/yats/ twitter.com/@PENGUINANA_ 2010/3/11 solr  
twitter (yats)     2008/11   4.9   xxxGB   +1.2 /⽉月 ( …)   200 /   <1000ms(97%) <1500ms(99%)   204ms
twitter (yats)     2008/11   4.9   125GB   +1.2 /⽉月 ( …)   200 /   204ms   <1000ms(97%) <1500ms(99%)
    yats Solr ⼯工     ⾼高   tips   ( ⽇日 )   Solr ⽅方  
…     RSS   twitter   API (JSONP ) solr http ⾃自  
⾼高…     42 /s   ⼀一⽅方 …  
Solr     6   read only 4 ++     1⽇日/ 1 1 /⽉月     100 / 1 360 400 /⽇日  
Solr     6     read only 4   24 / 1 ⼗十 …     100 / 1  
tips     Jetty   Daemon   >solr[1-4…] start,restart,stop     java -Xms1500M -Xmx1500M -XX:+UseConcMarkSweepGC -XX: +UseParNewGC -XX:CMSInitiatingOccupancyFraction=70   Project vordemort …
tips       5     SSD OS   100GB OS 1GB   Solr ⽤用
   
   
    >   :  >260       >   :  >194       (260) |       (194) |       @zanki   @coinlocker69   ⾒見見 ⾳音   ⽅方   ⾒見見     ⼀一 ⼈人 ⽵竹   @GorosBar   ⼭山 ⼀一 w   @yawaraka_bank AKB     2   AKB ⼤大 ⼦子 3 …  #akb48 ⽅方     15⽇日  
      •  LDA •     
    LDA(Latent Dirichlet Allocation)   2 50 …   50 ⼒力力   ⾷食                   1 3 6 10 19 21 26 31 39 41 43 46 49 41   46  
  48% yats   300000 250000 200000 150000 100000 50000 0  
    Facet navigation   • Solr   •  ⽰示  
Solr     Facet navigation     Dynamic field   …   String tag_s ⾔言 ⼊入  
Facet navigation    if facetquery: params["facet"] = "true" params[“facet.field”] = “tag_s” params[“facet.mincount”] = “10” params["fq"] = facetquery  
Facet navigation     … <lst name="tag_s"> <int name=" ">2568</int> <int name=" ">711</int> <int name=" ">615</int> <int name=" ⾦金金">584</int> <int name=" ">507</int> <int name=" ">353</int> …
Apache Solr⼊入⾨門 …     Facet query … …  
    Apache   CPU : Core2Quad Q9650 / 4GB / HDD   Solr   CPU : Core2Quad Q9650 / 8GB / X25-M 160GB   Solr2(2010/3 S-in)   CPU : Core2Quad Q9550 / 16GB / X25-M 160GB
  • Streaming API • user_timeline • user_timeline   ++   ⽤用  

More Related Content

PDF
Storytelling For The Web: Integrate Storytelling in your Design Process
byChiara Aliotta
 
PDF
2024 Trend Updates: What Really Works In SEO & Content Marketing
bySearch Engine Journal
 
PDF
ニコニコ動画を検索可能にしてみよう
bygenta kaneyama
 
PDF
SolrとElasticsearchの比較
bygenta kaneyama
 
PDF
Solrを使ったレシピ検索のプロトタイピング
bygenta kaneyama
 
PDF
Solr at cookpad
bygenta kaneyama
 
PDF
Tokyotextmining#1 kaneyama genta
bygenta kaneyama
 
PPT
Solr@twitter検索
bygenta kaneyama
 
Storytelling For The Web: Integrate Storytelling in your Design Process
byChiara Aliotta
 
2024 Trend Updates: What Really Works In SEO & Content Marketing
bySearch Engine Journal
 
ニコニコ動画を検索可能にしてみよう
bygenta kaneyama
 
SolrとElasticsearchの比較
bygenta kaneyama
 
Solrを使ったレシピ検索のプロトタイピング
bygenta kaneyama
 
Solr at cookpad
bygenta kaneyama
 
Tokyotextmining#1 kaneyama genta
bygenta kaneyama
 
Solr@twitter検索
bygenta kaneyama
 

Featured

PDF
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
byOECD Directorate for Financial and Enterprise Affairs
 
PDF
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
bySocialHRCamp
 
PDF
2024 State of Marketing Report – by Hubspot
byMarius Sescu
 
PDF
Everything You Need To Know About ChatGPT
byExpeed Software
 
PDF
Product Design Trends in 2024 | Teenage Engineerings
byPixeldarts
 
PDF
How Race, Age and Gender Shape Attitudes Towards Mental Health
byThinkNow
 
PDF
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
bymarketingartwork
 
PDF
Skeleton Culture Code
bySkeleton Technologies
 
PDF
PEPSICO Presentation to CAGNY Conference Feb 2024
byNeil Kimberley
 
PDF
Content Methodology: A Best Practices Report (Webinar)
bycontently
 
PPTX
How to Prepare For a Successful Job Search for 2024
byAlbert Qian
 
PDF
Social Media Marketing Trends 2024 // The Global Indie Insights
byKurio // The Social Media Age(ncy)
 
PDF
Trends In Paid Search: Navigating The Digital Landscape In 2024
bySearch Engine Journal
 
PDF
5 Public speaking tips from TED - Visualized summary
bySpeakerHub
 
PDF
ChatGPT and the Future of Work - Clark Boyd
byClark Boyd
 
PDF
Getting into the tech field. what next
byTessa Mero
 
PDF
Google's Just Not That Into You: Understanding Core Updates & Search Intent
byLily Ray
 
PDF
How to have difficult conversations
byRajiv Jayarajah, MAppComm, ACC
 
PDF
Introduction to Data Science
byChristy Abraham Joy
 
PDF
Time Management & Productivity - Best Practices
byVit Horky
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
byOECD Directorate for Financial and Enterprise Affairs
 
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
bySocialHRCamp
 
2024 State of Marketing Report – by Hubspot
byMarius Sescu
 
Everything You Need To Know About ChatGPT
byExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
byPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
byThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
bymarketingartwork
 
Skeleton Culture Code
bySkeleton Technologies
 
PEPSICO Presentation to CAGNY Conference Feb 2024
byNeil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
bycontently
 
How to Prepare For a Successful Job Search for 2024
byAlbert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
byKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
bySearch Engine Journal
 
5 Public speaking tips from TED - Visualized summary
bySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
byClark Boyd
 
Getting into the tech field. what next
byTessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
byLily Ray
 
How to have difficult conversations
byRajiv Jayarajah, MAppComm, ACC
 
Introduction to Data Science
byChristy Abraham Joy
 
Time Management & Productivity - Best Practices
byVit Horky
 

solr@twitter検索2010

  • 1.
    Solr@twitter (yats)   http://pcod.no-ip.org/yats/ twitter.com/@PENGUINANA_ 2010/3/11 solr  
  • 2.
    twitter (yats)     2008/11   4.9   xxxGB   +1.2 /⽉月 ( …)   200 /   <1000ms(97%) <1500ms(99%)   204ms
  • 3.
    twitter (yats)     2008/11   4.9   125GB   +1.2 /⽉月 ( …)   200 /   204ms   <1000ms(97%) <1500ms(99%)
  • 4.
        yats Solr ⼯工     ⾼高   tips   ( ⽇日 )   Solr ⽅方  
  • 5.
    …     RSS  twitter   API (JSONP ) solr http ⾃自  
  • 6.
    ⾼高…     42 /s   ⼀一⽅方 …  
  • 7.
    Solr     6   read only 4 ++     1⽇日/ 1 1 /⽉月     100 / 1 360 400 /⽇日  
  • 8.
    Solr     6     read only 4   24 / 1 ⼗十 …     100 / 1  
  • 9.
    tips     Jetty  Daemon   >solr[1-4…] start,restart,stop     java -Xms1500M -Xmx1500M -XX:+UseConcMarkSweepGC -XX: +UseParNewGC -XX:CMSInitiatingOccupancyFraction=70   Project vordemort …
  • 10.
    tips       5     SSD OS   100GB OS 1GB   Solr ⽤用
  • 11.
       
  • 12.
       
  • 13.
        >   :  >260       >   :  >194       (260) |       (194) |       @zanki   @coinlocker69   ⾒見見 ⾳音   ⽅方   ⾒見見     ⼀一 ⼈人 ⽵竹   @GorosBar   ⼭山 ⼀一 w   @yawaraka_bank AKB     2   AKB ⼤大 ⼦子 3 …  #akb48 ⽅方     15⽇日  
  • 14.
          •  LDA •     
  • 15.
        LDA(Latent DirichletAllocation)   2 50 …   50 ⼒力力   ⾷食                   1 3 6 10 19 21 26 31 39 41 43 46 49 41   46  
  • 16.
      48% yats   300000 250000 200000 150000 100000 50000 0  
  • 17.
        Facet navigation   • Solr   •  ⽰示  
  • 18.
    Solr     Facet navigation     Dynamic field   …   String tag_s ⾔言 ⼊入  
  • 19.
    Facet navigation    if facetquery: params["facet"] = "true" params[“facet.field”] = “tag_s” params[“facet.mincount”] = “10” params["fq"] = facetquery  
  • 20.
    Facet navigation     … <lst name="tag_s"> <int name=" ">2568</int> <int name=" ">711</int> <int name=" ">615</int> <int name=" ⾦金金">584</int> <int name=" ">507</int> <int name=" ">353</int> …
  • 21.
    Apache Solr⼊入⾨門 …     Facet query … …  
  • 22.
        Apache   CPU : Core2Quad Q9650 / 4GB / HDD   Solr   CPU : Core2Quad Q9650 / 8GB / X25-M 160GB   Solr2(2010/3 S-in)   CPU : Core2Quad Q9550 / 16GB / X25-M 160GB
  • 23.