微博cache设计谈

cache @TimYang

Agenda • Feed • Cache

• • , status feed •

Feed • feed • Push( ) • Pull( ) •

Push • feed • Inbox: • Outbox: • inbox( ) • Inbox( )

Push • • •

Pull • outbox( ) • Inbox( ) • Online computation

Pull • •

• • •

Cache memory is the new disk, and disk is the new tape. for "real-time" web applications, and systems that require massive scalability - Jim Gray

cache Weibo cache arch Inbox hot cache Outbox Vector cache Archive cache Social Following Followers users Graph Content Hot cache Total

Inbox • “ ” • cache id list • (hot cache) • get set • redis list/set

Outbox • • id list(e.g. 100) • id LRU

Social Graph cache • Following ids • Followers • • • delete all

Content cache • cache • • • • Open API xml, json...

Cache • •

Update Workﬂow Update status Content cache Hot Inbox Vector Outbox vector Content cache replication

• outbox hot vector • followers list • inbox

feed Home timeline Workﬂow home_timeline aggregator Content hot Inbox cache Outbox Vector cache Inbox archive Inbox archive Content cache

feed • inbox cache • • , following • id list feed

cache • • hot keys • • mutex

• Content cache • multi get n feed(n = items/ , e.g. 50) • cache = n * (feed + , e.g. 2k) • 1,000 /

• 1,000 800Mbps •1 8Gbps

• 1G 300~400Mbps • • local cache • •

hot keys • content cache of • create local cache 1. get user_yaochen_local 2. get user_yaochen 1. set user_yaochen_local:value 3. delete all

cache • key memcache • • LRU cache, • Memory storage

mutex • content item cache • db • db • key_mutex key • mutex

• • S2 • S2 •

S2 • Web 2.0 Social • What’s S2 • Social Platform & • Social Applications • www.s2forum.org

• • Sina App Engine • • •

Q&A • email: iso1600@gmail.com • @TimYang

http://timyang.net	9340
http://www.bsdmap.com	407
http://www.phpit.cn	252
http://www.360doc.com	91
http://yunti.sinaapp.com	64
http://www.cnblogs.com	55
http://blogread.cn	54
http://y.jmeye.com	47
http://xianguo.com	41
http://cache.baidu.com	39
http://timyang.blog.51cto.com	35
http://localhost	27
http://zhuaxia.com	23
http://www.zhuaxia.com	19
http://www.dcshi.com	17
http://static.slidesharecdn.com	11
http://blog.haohtml.com	11
http://210.51.190.51:8002	7
http://hanzheng.wordpress.com	7
http://httpwww.bsdmap.com	4
http://wew.bsdmap.com	4
http://207.46.192.232	4
http://old.xianguo.com	3
http://www.slideshare.net	3
http://web.mail.bsdmap.com	3
http://210.51.190.51	2
http://w3ww.bsdmap.com	2
http://translate.googleusercontent.com	2
http://webcache.googleusercontent.com	2
http://yaoge123blogwww.bsdmap.com	2
http://awww.bsdmap.com	1
http://www.mojibar.com	1
file://	1
http://ww.bsdmap.com	1
mk:@MSITStore:G:缓存优化cache使用技术.chm:://120.htm	1
http://note.sdo.com	1
url_unknown	1
http://grab.woxihuan.com	1
http://www.blogread.cn	1
http://tg1a152.mail.163.com	1

by Tim Y on Jul 26, 2010