Network Design in Cloud-ready IDC

1,329 views

Published on

To study the network key point in cloud enable datacenter. It includes network analysis, design and knobs.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,329
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
46
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Network Design in Cloud-ready IDC

  1. 1. 14th TWNIC OPM & TWNOG Seminar 2010/7/1, Taipei 雲端運算機房網路環境建置探討 智匯亞洲有限公司 許至凱 CCIE/JNCIE kaeatforum [at] gmail.com
  2. 2. Agenda <ul><li>這裡討論的雲端運算分類為何? </li></ul><ul><li>雲端運算機房網路建置要點 </li></ul><ul><ul><li>外部頻寬 </li></ul></ul><ul><ul><li>內部頻寬 </li></ul></ul><ul><ul><li>資訊安全 </li></ul></ul><ul><li>Private Cloud </li></ul><ul><li>Hadoop cluster 網路環境 </li></ul><ul><li>雲端運算網路趨勢 </li></ul><ul><ul><li>Higher bandwidth </li></ul></ul><ul><ul><li>Lower latency </li></ul></ul><ul><ul><li>Unified and converged interconnection </li></ul></ul><ul><li>參考資料 </li></ul>
  3. 3. 這裡討論的雲端運算分類為何? <ul><li>“ S-P-I” model </li></ul><ul><ul><li>Software-as-a-Service </li></ul></ul><ul><ul><li>Platform-as-a-Service </li></ul></ul><ul><ul><li>Infrastructure-as-a-Service </li></ul></ul>Storage-as-a-Service Database-as-a-Service Communication-as-a-Service Information-as-a-Service Process-as-a-Service Monitoring-as-a-Service Platform-as-a-Service Service-as-a-Service Security-as-a-Service Infrastructure-as-a-Service
  4. 4. 這裡討論的雲端運算分類為何? <ul><li>Cloud computing “S-P-I” stack </li></ul><ul><ul><ul><ul><ul><li>From “Cloud Computing Explained” by John Rhoton </li></ul></ul></ul></ul></ul>Colocation Hardware Virtualization Platform Application Real Estate Power Cooling Bandwidth Memory Computation Storage Provisioning Virtualization Billing APIs Development Environment Programming Language CRM Email UC … IaaS PaaS SaaS
  5. 5. 雲端運算機房網路建置要點 <ul><ul><li>頻寬:外部頻寬 </li></ul></ul><ul><ul><ul><li>雲端服務用戶皆利用 Internet 連至雲端機房 </li></ul></ul></ul><ul><ul><ul><ul><li>間隔過多的 ISP 將難以掌握網路連線狀況 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>足夠且直接的連線頻寬是維護雲端服務品質的基本要求 </li></ul></ul></ul></ul>
  6. 6. 雲端運算機房網路建置要點 <ul><ul><li>頻寬:內部頻寬 </li></ul></ul><ul><ul><ul><li>Virtualization </li></ul></ul></ul><ul><ul><ul><ul><li>User-to-VM; VM-to-VM, server-to-server </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>VM 流量行為難以掌握,充足的頻寬是必要條件 </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>使用 Non-blocking, Non-oversubscription 網路環境 </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Cross-datacenter </li></ul></ul></ul><ul><ul><ul><ul><li>Business continuity; Disaster recovery </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>為考慮 BC/DR ,跨資料中心的 VM 連線扮演重要角色 </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>也需一併考慮 Internet 連線設計如 GSLB </li></ul></ul></ul></ul></ul>GE GE 10GE GE GE 10GE Internet Internet
  7. 7. 雲端運算機房網路建置要點 <ul><ul><li>資訊安全 </li></ul></ul><ul><ul><ul><li>Face to Internet </li></ul></ul></ul><ul><ul><ul><ul><li>阻卻所有惡意的流量 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Scalable Firewall/IPS/DDoS mitigation/Web Application Firewall </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Face to cloud customers </li></ul></ul></ul><ul><ul><ul><ul><li>提供安全快速的存取方式 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>SSLVPN, Dedicated connection </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>WAN acceleration </li></ul></ul></ul></ul></ul>Cloud Service SSL VPN
  8. 8. Private cloud <ul><li>企業若希望享有 cloud computing 的優勢,但又不希望把企業資訊儲存在他人的平台上 </li></ul><ul><ul><li>建立自有的 cloud – private cloud </li></ul></ul><ul><li>Private cloud 特色 </li></ul><ul><ul><li>規模較小 </li></ul></ul><ul><ul><ul><li>可採取更扁平的網路架構,而非傳統三層式架構 </li></ul></ul></ul><ul><ul><ul><ul><li>降低複雜度 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>增進整體網路效能 </li></ul></ul></ul></ul><ul><ul><li>效能要求較高 </li></ul></ul><ul><ul><ul><li>High bandwidth </li></ul></ul></ul><ul><ul><ul><li>Low latency </li></ul></ul></ul><ul><ul><li>更豐富的虛擬化整合 </li></ul></ul><ul><ul><ul><li>除了 server virtualization ,還可以進行 desktop virtualization </li></ul></ul></ul><ul><ul><ul><ul><li>提昇虛擬化效益 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>網路必需能夠分辨重要性高的流量與一般流量 (QoS) </li></ul></ul></ul></ul>
  9. 9. Hadoop cluster 網路環境 <ul><li>在 over-subscription 網路環境中, Hadoop 可優先使用同一 rack 的 node 進行 MapReduce ,以獲取較佳的效能。 </li></ul><ul><ul><li>跨 rack 傳輸將使得延遲增加與可能造成 uplink 壅塞 </li></ul></ul><ul><ul><li>讓 Hadoop 了解 node 的網路架構 </li></ul></ul><ul><ul><ul><li>修改 DNSToSwitchMapping </li></ul></ul></ul>Sufficient bandwidth, less latency In-sufficient bandwidth, more latency N:1 over-subscription N:1 over-subscription Hadoop Cluster
  10. 10. Hadoop cluster 網路環境 <ul><li>區分 data traffic 與 client communication 所使用網路卡 </li></ul><ul><ul><li>獨立之 HDFS segment 可進行 Ethernet jumbo frame 調整以增進傳輸效能 </li></ul></ul><ul><ul><ul><li>修改 dfs.datanode.dns.interface </li></ul></ul></ul>HDFS segment; MTU>9000 (jumbp frame) IP segment; MTU=1500
  11. 11. 雲端運算網路趨勢 <ul><li>Higher bandwidth </li></ul><ul><ul><li>Over-subscription 網路造成潛在效能瓶頸 </li></ul></ul><ul><ul><ul><li>虛擬化將造成網路流量需求大增 </li></ul></ul></ul><ul><ul><li>將 Cloud computing LAN 昇級至 non-oversubscription 網路 </li></ul></ul><ul><ul><ul><li>避免任何壅塞發生 </li></ul></ul></ul>4:1 over-subscription GE GE GE GE GE Non-oversubscription GE GE GE GE 10GE UPGRADE
  12. 12. 雲端運算網路趨勢 <ul><li>Lower latency </li></ul><ul><ul><li>Wire latency (1500 bytes) </li></ul></ul><ul><ul><ul><li>GigabitEthernet: ~12μs </li></ul></ul></ul><ul><ul><ul><li>10GigabitEthernet: ~2μs </li></ul></ul></ul><ul><ul><li>在 SOA (Service-Oriented Architecture) 環境下,一個交易 (transaction) 需要跨多個 SOA 元件與網段才能完成 </li></ul></ul><ul><ul><ul><li>與單純的 standalone server solution 比起來,延遲時間增加 </li></ul></ul></ul><ul><ul><ul><li>由於這是 GigabitEthernet 電氣規範造成的限制,更換 GE 交換器或網卡無法有效解決 SOA 環境延遲增加的狀況 </li></ul></ul></ul><ul><ul><li>昇級 Cloud LAN 自 GE 至 10GE </li></ul></ul><ul><ul><ul><li>降低延遲時間 </li></ul></ul></ul><ul><ul><ul><li>增加有效頻寬 </li></ul></ul></ul>Internet Network latency = A A Internet Network latency = A + B + C + D A C B D
  13. 13. 雲端運算網路趨勢 <ul><li>Unified and converged interconnection </li></ul><ul><ul><li>目前 server 上主要 I/O 種類 : </li></ul></ul><ul><ul><ul><li>GigabitEthernet - LAN </li></ul></ul></ul><ul><ul><ul><li>IBA – InfiniBand Network </li></ul></ul></ul><ul><ul><ul><li>FC - SAN </li></ul></ul></ul><ul><ul><ul><li>SAS/SATA – Local storage </li></ul></ul></ul><ul><ul><li>Cloud datacenter approaches </li></ul></ul><ul><ul><ul><li>使用 Enhance Ethernet or IBA 來進行實體連線整合 </li></ul></ul></ul><ul><ul><ul><ul><li>VM 使用虛擬化 / 模擬裝置存取 I/O 資源 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>vFC, vFCoE, vGbE etc… </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><li>更有效使用高頻寬、低延遲網路 </li></ul></ul></ul></ul>GbE IBA FC SAS/SATA Enhance Ethernet; IBA Virtualization
  14. 14. 參考資料 <ul><li>Books </li></ul><ul><ul><li>Cloud & Virtualization </li></ul></ul><ul><ul><ul><li>Cloud Computing and SOA Convergence in Your Enterprise; A Step-by-Step Guide by David S. Linthicum </li></ul></ul></ul><ul><ul><ul><li>Cloud Computing Explained by John Rhoton </li></ul></ul></ul><ul><ul><ul><li>Cloud Computing; Implementation, Management, and Security by John W. Rittinghouse and James F. Ransome </li></ul></ul></ul><ul><ul><ul><li>The Green and Virtual Data Center by Greg Schulz </li></ul></ul></ul><ul><ul><li>Hadoop </li></ul></ul><ul><ul><ul><li>Hadoop: The Definitive Guide by Tom White </li></ul></ul></ul><ul><ul><ul><li>Pro Hadoop; Build scalable, distributed applications in the cloud by Jason Venner </li></ul></ul></ul>
  15. 15. Q & A

×