Алексей Лесовский "Тюнинг Linux для баз данных. "
Your SlideShare is downloading.
×
Check these out next
More Related Content
Slideshows for you (20)
Viewers also liked (10)
Similar to High Performance Weibo QCon Beijing 2011 (20)
Recently uploaded (20)
High Performance Weibo QCon Beijing 2011
- 1. Build High Performance Weibo System @TimYang
- 2. • • 140 • •
- 3. • QCon 2010 • WDC 2010
- 4. Agenda 3 4 2 1
- 5. Part 1
- 6. ( )
- 7. MySQL • •
- 8. • hash • • user_timeline index
- 9. • • • • 5 •
- 10. MySQL + cache • • • cache • •
- 11. NoSQL “Databases are specializing – the “one size fits all” approach no longer applies.” MongoDB
- 12. NoSQL? • • Redis • MongoDB • • Cassandra
- 13. • MongoDB • Redis • HBase • Cassandra
- 14. Redis - • • snapshot - • vm - • diskstore - • aof -
- 15. Redis - • string: key value redisObject 16 bytes/item • list: 40 bytes / item • hash: zipmap(<64) • set/sorted set
- 16. Redis - Replication • rdb •
- 17. Redis -
- 18. Redis - • • failover • list/set (optional)
- 19. • MySQL • NoSQL MySQL cache
- 20. Part 2
- 21. ( )
- 22. → →
- 23. Web cache cache •
- 24. “Web json cache json ( ) 2~5K , xml 10k , protobuf 500 ”
- 25. RDBMS→ Key value (JSON)→ Protocol buffers(binary)
- 26. JSON • DB • Cache • Message Queue • API
- 27. PB • Numeric: varint, from 1 byte • • Java, C++, Python...
- 28. • • cache • “192.168.0.1” → “0xc0a80000” → varint
- 29. Benchmark Text Text ( http://code.google.com/p/thrift-protobuf-compare/wiki/Benchmarking)
- 30. “We would like to provide public APIs that accept protocol buffers as well as XML, both because it is more efficient and because we're just going to convert that XML to protocol buffers on our end anyway.” - Google
- 31. • • •
- 32. “ ”
- 33. • LAMP • 1ms •
- 34. • MQ stat • MQ Processor stat
- 35. ? “1 ”
- 36. • Timeline • • • cache
- 37. 1. 2. 3. 4. cache master 5. replication
- 38. • 5
- 39. • 5 •
- 40. • 5 • •
- 41. • 5 • • •
- 42. • RAM is the new disk •
- 43. “Percona Server now both SQL and NOSQL HandlerSocket, 100 rps 12cores/24threads and 380GB of RAM, mysql Redis NoSQL ”
- 44. @jackbillow “ 1. PK lookup 2. cache ” @kobe “ innodb ” @TimYang “ InnoDB Adaptive Hash Indexes hash ”
- 45. • NoSQL • binlog Redis • jbinlog https://github.com/tangfl/jbinlog
- 46. Part 3
- 47. app
- 48. • • • spam • •
- 49. Text
- 50. • • GZIP •
- 51. Part 4
- 52. “@ Zheng:“ ” //@ : @bian " " http://t.cn/h0k4r (49)| (15)” 2 14 10:36 (22) | (10)
- 53. • •
- 54. • • • •
- 55. • • • • cache •
- 56. • •
- 57. Timeline Memcached MySQL Redis
- 58. • • RAM •
- 59. Q&A @TimYang
