Google arch-fangkun-qcon

1,148 views
1,073 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,148
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Google arch-fangkun-qcon

  1. 1. 03/28/11 Google
Inc
  2. 2. • • • •03/28/11 Google
Inc
  3. 3. • – • – Gmail, Calendar, Picasa, Docs, Google Apps,... – App Engine • – – – –03/28/11 Google
Inc
  4. 4. ‐‐
 Tera Gega Tera
‐‐
Peta ‐‐
 Peta03/28/11 Google
Inc
  5. 5. vs03/28/11 Google
Inc
  6. 6. vs03/28/11 Google
Inc
  7. 7. vs03/28/11 Google
Inc
  8. 8. vs03/28/11 Google
Inc
  9. 9. • • • •03/28/11 Google
Inc
  10. 10. • – 16GB
DRAM;
160
GB
SSD;
5
x
1TB
disk • (Rack) – 40
 – 48
port
Gigabit
Ethernet
switch • (Warehouse) – 10,000 (250
racks) – 2K
port
Gigabit
Ethernet
switch03/28/11 Google
Inc
  11. 11. ‐‐‐03/28/11 Google
Inc
  12. 12. ‐‐‐
03/28/11 Google
Inc
  13. 13. ‐‐‐
03/28/11 Google
Inc
  14. 14. • – ,
 ,
 – ,
 ,
 • – – • – – Flash
(SSD);
GPU03/28/11 Google
Inc
  15. 15. 3003/28/11 Google
Inc
  16. 16. ( ) 2000 – 2005 6–803/28/11 Google
Inc
  17. 17. ‐‐
03/28/11 Google
Inc
  18. 18. = 2.0 Google = 1.16 IT03/28/11 Google
Inc
  19. 19. • – ,
 ,
 – ,
 ,
 • – – • – – Flash
(SSD);
GPU03/28/11 Google
Inc
  20. 20. • 99.9%
 =
9
 /• 10,000
 – 0.25
 – 3
 – 1,000 – 1,000s
 – etc.,
etc.,
etc.03/28/11 Google
Inc
  21. 21. • • • – – –03/28/11 Google
Inc
  22. 22. • – ,
 ,
 – ,
 ,
 • – – • – – Flash
(SSD);
GPU03/28/11 Google
Inc
  23. 23. • • • •03/28/11 Google
Inc
  24. 24. (GFS) GFS Master Master Client GFS Master R p a c e s i Client lC0 C1 C1 C0 C3C3 C4 C3 C5 C4 03/28/11 Google
Inc
  25. 25. MapReduce Data Block 1 map Results ResultsData Data Data Block 2 datadatadatadatada datadata datadatada Reduce datadatatadatadata datadata tadatadata map datadatadatadatada datadata datadatadatadatadata tadatadata Data Block 3 Data Block 5 map map map Data Block 4 GFS Mapreduce 2004 , Hadoop , Facebook Hadoop03/28/11 Google
Inc
  26. 26. (Big
Table) • • – :
 – :
 – :
03/28/11 Google
Inc
  27. 27. • • • •03/28/11 Google
Inc
  28. 28. • • •03/28/11 Google
Inc
  29. 29. 03/28/11 Google
Inc
  30. 30. • • • •03/28/11 Google
Inc
  31. 31. • – Peter
Norvig – Stuart
Feldman – Edward
Chang – Xuemei
Gu – Hai
Fang03/28/11 Google
Inc
  32. 32. 03/28/11 Google
Inc
  33. 33. 杭州站 · 2011年10月20日~22日 www.qconhangzhou.com(6月启动)QCon北京站官方网站和资料下载 www.qconbeijing.com

×