Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

微博架构与平台安全

on

  • 48,730 views

新浪微博平台与安全架构

新浪微博平台与安全架构

Statistics

Views

Total Views
48,730
Views on SlideShare
31,249
Embed Views
17,481

Actions

Likes
249
Downloads
4,144
Comments
16

71 Embeds 17,481

http://timyang.net 12523
http://www.cnblogs.com 1887
http://www.alibuybuy.com 760
http://slj.me 697
http://www.phpit.cn 288
http://blogread.cn 150
http://www.ourlinux.net 90
http://static.slidesharecdn.com 87
http://blog.bypat.com 83
http://reader.youdao.com 79
http://www.20ju.com 76
http://www.php163.com 75
http://yunti.sinaapp.com 66
http://xianguo.com 65
http://blog.haohtml.com 56
http://irockman.me 49
http://www.techgig.com 46
http://www.zhuaxia.com 42
http://tangpb.wordpress.com 31
http://woshao.com 29
http://www.ililing.net 28
http://cache.baidu.com 27
http://zhuaxia.com 25
http://blog.bookcold.me 22
http://www.dcshi.com 19
http://www.codesky.net 17
http://www.cqumzh.cn 15
http://irockman.u4.30wan.com 13
http://www.blogread.cn 12
http://www.w3ccollege.org 11
http://www.onlydoo.com 9
http://y.jmeye.com 8
http://210.51.190.51:8002 7
http://10.150.200.57 7
http://10.1.2.100 6
http://3.alibuybuy.sinaapp.com 6
http://feeds.feedburner.com 5
http://www.mojibar.com 5
http://210.51.190.51 3
http://www.zzfx.com 3
http://www.yolao.com 3
https://www.linkedin.com 3
http://mailreader.163.com 3
http://translate.googleusercontent.com 3
http://wiki.umlife.net 3
http://www.qicun.cn 3
http://www.chuule.com 3
http://old.xianguo.com 2
http://web.365legou.com 2
http://twittertim.es 2
More...

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

110 of 16 Post a comment

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Write a comment...
    Are you sure you want to
    Your message goes here
    Processing…
  • 新浪微博至今发言或评论要刷新点按多次才能发出,有时weibo.com都无法访问,这些都是scalable扩展性做得不是非常线性的现象所在。
    Are you sure you want to
    Your message goes here
    Processing…
  • 55
    Are you sure you want to
    Your message goes here
    Processing…
  • 为什么下来的是key
    Are you sure you want to
    Your message goes here
    Processing…
  • 新浪微博平台与安全架构
    Are you sure you want to
    Your message goes here
    Processing…

110 of 16

Post Comment
Edit your comment
  • <br />
  • <br />
  • <br />
  • 1 week <br />
  • <br />
  • MPSS &#x5927;&#x7CFB;&#x7EDF;&#x666E;&#x904D;&#x539F;&#x5219; <br /> &#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x591A;&#x4E2A;&#x5C0F;&#x7684;&#x670D;&#x52A1;&#xFF0C;&#x800C;&#x4E0D;&#x662F;&#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x4E00;&#x4E2A;&#x5927;&#x670D;&#x52A1; <br /> &#x6700;&#x9AD8;&#x5C42;&#x6B21;&#xFF0C;&#x865A;&#x62DF;&#x5316; <br />
  • MPSS &#x5927;&#x7CFB;&#x7EDF;&#x666E;&#x904D;&#x539F;&#x5219; <br /> &#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x591A;&#x4E2A;&#x5C0F;&#x7684;&#x670D;&#x52A1;&#xFF0C;&#x800C;&#x4E0D;&#x662F;&#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x4E00;&#x4E2A;&#x5927;&#x670D;&#x52A1; <br /> &#x6700;&#x9AD8;&#x5C42;&#x6B21;&#xFF0C;&#x865A;&#x62DF;&#x5316; <br />
  • MPSS &#x5927;&#x7CFB;&#x7EDF;&#x666E;&#x904D;&#x539F;&#x5219; <br /> &#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x591A;&#x4E2A;&#x5C0F;&#x7684;&#x670D;&#x52A1;&#xFF0C;&#x800C;&#x4E0D;&#x662F;&#x4E00;&#x53F0;&#x670D;&#x52A1;&#x5668;&#x4E00;&#x4E2A;&#x5927;&#x670D;&#x52A1; <br /> &#x6700;&#x9AD8;&#x5C42;&#x6B21;&#xFF0C;&#x865A;&#x62DF;&#x5316; <br />
  • <br />
  • &#x9501;&#x8868;&#xFF1A;&#x540C;&#x65F6;&#x8BC4;&#x8BBA;&#xFF0C;&#x52A0;&#x5173;&#x6CE8;&#x589E;&#x591A; <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • &#x89E3;&#x51B3;&#x65B9;&#x6CD5;&#xFF1A; <br /> 1. &#x5408;&#x5E76;&#x6240;&#x6709;&#x8868;(&#x4E0D;&#x662F;&#x6700;&#x4F73;) <br /> 2. &#x4E8C;&#x6B21;&#x7D22;&#x5F15;&#xFF0C; <br />
  • &#x5F02;&#x6B65;&#x539F;&#x56E0;&#xFF1A;&#x53D1;&#x8868;&#x9700;&#x8981;&#x5165;&#x5E93;&#xFF0C;&#x7D22;&#x5F15;&#xFF0C;&#x7EDF;&#x8BA1;&#xFF0C;&#x540E;&#x53F0;&#xFF0C;&#x8BA1;&#x6570;&#x7B49;&#xFF0C;&#x5468;&#x671F;&#x8F83;&#x957F; <br />
  • todo: &#x6539;&#x8FDB;&#x601D;&#x8DEF;&#xFF0C;&#x589E;&#x52A0;&#x4F2A;&#x4EE3;&#x7801; <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />

微博架构与平台安全 微博架构与平台安全 Presentation Transcript

  • @TimYang
  • 0 ~ 50,000,000 3
  • 1 PHP MySQL Apache Linux
  • • / • 1 / insert / select
  • • LAMP • MySQL , MyISAM • MPSS (Multi-Port Single Server)
  • • • • • •
  • 2
  • 2
  • 2
  • 2
  • • • • key-value (NoSQL) •
  • • • • MemcacheQ • stats queue
  • • InnoDB • PHP libmemcached memcache •
  • • • “ ” • • • MySQL •
  • • • • CDN • •
  • • Web • • API • • •
  • “Break large complex systems down into many services... google.com search touches 100s of services (ads, web search, books, news, spelling correction...)” - Jeff Dean, Google Fellow
  • → →
  • 3
  • 3
  • 3
  • 3
  • 3
  • • • feed cache • •
  • • DB • • IDC
  • • 50,000,000 • 3,000 / • 3,689,713 11 10
  • • • • •
  • Web cache
  • • • • • 100 10 • 1000 100 •
  • CPU IO
  • “CPU L1 L2 L3 ” - @ ecug 2010 Erlang
  • cache
  • cache Inbox (home)
  • cache Inbox (home) Outbox (Myfeed)
  • cache Inbox (home) Outbox (Myfeed) Content
  • • • • Amazon S3: 99.9% • Amazon EC2: 99.95% • Facebook: n/a
  • • • • admission control... • , 7x24 • ,
  • • curl / • / access log • non-200 / / exceptions •
  • “Many services are written to alert operations on failure and to depend upon human intervention for recovery, about 20% of the time they will make mistakes. Designing for automation.” - James Hamilton,VP of Amazon
  • • • • • •
  • “System administration at Google usually have 1 week of "on call" duty, and the other 5 weeks are spent making improvements to make the on call portion more optimized, automated, and trouble- free” - Tom Limoncelli @ Everything Sysadmin Lumeta Corporation
  • • • IDC •
  • CDN
  • • • • •
  • • Master / Slave • master • Multi-Master • • • Paxos
  • Multi-Master Web
  • Yahoo! Message Broker
  • “We use YMB for replication for 2 reasons. 1.YMB ensure msgs are not lost before they are applied to the db. 2.YMB is designed for wide-area replication.This isolates individual PNUTS clusters from dealing with update between regions” PNUTS:Yahoo!’s Hosted Data Serving Platform
  • • API • Rest API • •
  • • (Stream API) • • • •
  • • 1 •
  • Weibo Data Msg MQ processor Queue Push DB push deamon Other Stream Server consumer
  • • • KISS Keep It Simple and Stupid • • batch insert • cursor read
  • Remote cache (Social Graph, nicks) Local Cache {uid:nick} Push {uid: Followers} data Receiver Social Stream Graph Service Stream Engine buffer resume continuation Weibo Jetty Continuation Servlet http://server/req?uid=1&since_id=2 Stream apps
  • • Stream Buffer • •
  • • • • •
  • Freq Realtime Post processing Content Offline Access log log analysis Activity log Abnormal Data Multi time monitor dimension data Weibo anti SPAM System
  • apps API requests • Auth url mapping • AppKey Auth Rate limit & Permission • OAuth Service method • • Output formatter(xml,json) Service
  • Join us! @TimYang