Final presentation at pfintern

4,587 views

Published on

PFIサマーインターン最終発表で使ったスライド

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
4,587
On SlideShare
0
From Embeds
0
Number of Embeds
2,704
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide































  • Final presentation at pfintern

    1. 1. PFI Final Presentation Masahiro Nakagawa Thu, September, 30, 2010 …
    2. 2. @repeatedly • • kzkindle ( ) • GodBull (RedBull ) • • Sedue
    3. 3. Sedue Architecture User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    4. 4. Realtime Indexing User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    5. 5. Realtime Indexing • Numeric Range Index • • • • C++ ... make … …
    6. 6. S3 User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    7. 7. DFS S3 • S3: Amazon • EC2
    8. 8. etc... • • • • zsh ( )
    9. 9. etc...
    10. 10.
    11. 11. version 1.6.x nightly
    12. 12. MongoDB • : http://www.mongodb.org/ • • • •
    13. 13. Sharding + Replica set
    14. 14. MongoDB Sharding User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    15. 15. … (2 ) 600insert/s ↓ 2 1 ↓ (2 ) 3 5000 prz ↓ 5000 (500 ) 4 ( :4 : 30 )
    16. 16. • → • • 100QPS • • mongoimport
    17. 17. Archive Manager
    18. 18. Sedue …( ´Д`)
    19. 19. Archive Manager User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    20. 20. • Heartbeat • Archive Manager • •
    21. 21. Heartbeat Virtual IP Heartbeat Active Stanby
    22. 22. Heartbeat × Virtual IP Heartbeat Active Stanby
    23. 23. Heartbeat Virtual IP Fail Over! Heartbeat Active Stanby
    24. 24. Connection Pooling ↓ …
    25. 25. Connection Pooling User Distributed File System Query Document Searchar Indexer Server Repository Archive Manager Config
    26. 26. • 20% • No Pooling 117s • Pooling 97s • MessagePack 2 0s 60s 120s
    27. 27. Export
    28. 28. Red Bull: 58 ( : 66) 2 D 0%!!

    ×