Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
,      ,
                                             构
                         ——   FreeWheel MRM



                   ...
,      构

Design with failure in mind
• There is no bug free software
• There is no failure proof hardware
Partition your ...
,       构

KISS
• Keep: Upkeep
  • Requirement is meant to change all the time
  • Software is meant to evolve all the tim...
•                            Up time 99.99%——        down<=4
     •
     • Web
     •                          failover
  ...
•
           •
           •                 /
           •
           •
•
     •                                        ,
...
Hadoop

Hadoop                    Map-Reduce

•
•
•
•                                      Mapper   Reducer


• NFS       ...
Hadoop                          (    )


•                                    (2k)
                                       ...
Hadoop                       (   )


•                        :
•                        :
•                        :
•   ...
Hadoop                       (    )


•                Local Reducer
                                      O(n)         O(...
•
     •
     •
     •
•
     •
     •
•
     •                   , Master-Slave,Delta Push.
     •                   IP S...
FreeWheel Confidential
dwang@freewheel.tv
                          +86-13901312946




FreeWheel Confidential
Upcoming SlideShare
Loading in …5
×
Upcoming SlideShare
Q1 2013 free_wheel_video_monetization_report
Next
Download to read offline and view in fullscreen.

1

Share

Download to read offline

Free Wheel高性能,高流量,多数据中心互联网应用架构实战

Download to read offline

Related Books

Free with a 30 day trial from Scribd

See all

Free Wheel高性能,高流量,多数据中心互联网应用架构实战

  1. 1. , , 构 —— FreeWheel MRM Diane Yu Co-Founder, CTO FreeWheel 2009-04 FreeWheel Confidential
  2. 2. , 构 Design with failure in mind • There is no bug free software • There is no failure proof hardware Partition your data • Load balance: Even partition • Easiness to repartition • Reduce dependency Redundancy • Reduce single point of failure • System auto recoverability Monitor, monitor, monitor • Monitor from customer perspective • Monitor from capacity perspective FreeWheel Confidential
  3. 3. , 构 KISS • Keep: Upkeep • Requirement is meant to change all the time • Software is meant to evolve all the time • Simple Stupid • More code, more maintenance • Something is wrong when it is complicated Just in time • Just in time design • Perfect design doesn’t exist • Design just enough to get started • Just in time refine/refactor • Know when to refactor • Refactor in pieces is always better than complete rewrite FreeWheel Confidential
  4. 4. • Up time 99.99%—— down<=4 • • Web • failover • • Watch Dog/SNMP • Counter + + • <150ms • Web Server + FastCGI • DB cache • Gomez FreeWheel Confidential
  5. 5. • • • / • • • • , • : • • Map-Reduce FreeWheel Confidential
  6. 6. Hadoop Hadoop Map-Reduce • • • • Mapper Reducer • NFS I/O • • Debug • FreeWheel Confidential
  7. 7. Hadoop ( ) • (2k) G~T • / • t A->B->C • A S1 • , A A0S1, A1S1 • A0S1 S1 S1L1 A1S1 S1L2 • • t t FreeWheel Confidential
  8. 8. Hadoop ( ) • : • : • : • : • : • Map-Reduce Hadoop • Local Matcher Map-Reduce FreeWheel Confidential
  9. 9. Hadoop ( ) • Local Reducer O(n) O(n/m),m • “ ” • Overhead • • Map-Reduce ETL FreeWheel Confidential
  10. 10. • • • • • • • • • , Master-Slave,Delta Push. • IP Sticky • FreeWheel Confidential
  11. 11. FreeWheel Confidential
  12. 12. dwang@freewheel.tv +86-13901312946 FreeWheel Confidential
  • mebeta

    Mar. 19, 2013

Views

Total views

1,117

On Slideshare

0

From embeds

0

Number of embeds

4

Actions

Downloads

28

Shares

0

Comments

0

Likes

1

×