Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Network Design in Cloud-ready IDC

1,392 views

Published on

To study the network key point in cloud enable datacenter. It includes network analysis, design and knobs.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Network Design in Cloud-ready IDC

  1. 1. 14th TWNIC OPM & TWNOG Seminar 2010/7/1, Taipei 雲端運算機房網路環境建置探討 智匯亞洲有限公司 許至凱 CCIE/JNCIE kaeatforum [at] gmail.com
  2. 2. Agenda <ul><li>這裡討論的雲端運算分類為何? </li></ul><ul><li>雲端運算機房網路建置要點 </li></ul><ul><ul><li>外部頻寬 </li></ul></ul><ul><ul><li>內部頻寬 </li></ul></ul><ul><ul><li>資訊安全 </li></ul></ul><ul><li>Private Cloud </li></ul><ul><li>Hadoop cluster 網路環境 </li></ul><ul><li>雲端運算網路趨勢 </li></ul><ul><ul><li>Higher bandwidth </li></ul></ul><ul><ul><li>Lower latency </li></ul></ul><ul><ul><li>Unified and converged interconnection </li></ul></ul><ul><li>參考資料 </li></ul>
  3. 3. 這裡討論的雲端運算分類為何? <ul><li>“ S-P-I” model </li></ul><ul><ul><li>Software-as-a-Service </li></ul></ul><ul><ul><li>Platform-as-a-Service </li></ul></ul><ul><ul><li>Infrastructure-as-a-Service </li></ul></ul>Storage-as-a-Service Database-as-a-Service Communication-as-a-Service Information-as-a-Service Process-as-a-Service Monitoring-as-a-Service Platform-as-a-Service Service-as-a-Service Security-as-a-Service Infrastructure-as-a-Service
  4. 4. 這裡討論的雲端運算分類為何? <ul><li>Cloud computing “S-P-I” stack </li></ul><ul><ul><ul><ul><ul><li>From “Cloud Computing Explained” by John Rhoton </li></ul></ul></ul></ul></ul>Colocation Hardware Virtualization Platform Application Real Estate Power Cooling Bandwidth Memory Computation Storage Provisioning Virtualization Billing APIs Development Environment Programming Language CRM Email UC … IaaS PaaS SaaS
  5. 5. 雲端運算機房網路建置要點 <ul><ul><li>頻寬:外部頻寬 </li></ul></ul><ul><ul><ul><li>雲端服務用戶皆利用 Internet 連至雲端機房 </li></ul></ul></ul><ul><ul><ul><ul><li>間隔過多的 ISP 將難以掌握網路連線狀況 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>足夠且直接的連線頻寬是維護雲端服務品質的基本要求 </li></ul></ul></ul></ul>
  6. 6. 雲端運算機房網路建置要點 <ul><ul><li>頻寬:內部頻寬 </li></ul></ul><ul><ul><ul><li>Virtualization </li></ul></ul></ul><ul><ul><ul><ul><li>User-to-VM; VM-to-VM, server-to-server </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>VM 流量行為難以掌握,充足的頻寬是必要條件 </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>使用 Non-blocking, Non-oversubscription 網路環境 </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Cross-datacenter </li></ul></ul></ul><ul><ul><ul><ul><li>Business continuity; Disaster recovery </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>為考慮 BC/DR ,跨資料中心的 VM 連線扮演重要角色 </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>也需一併考慮 Internet 連線設計如 GSLB </li></ul></ul></ul></ul></ul>GE GE 10GE GE GE 10GE Internet Internet
  7. 7. 雲端運算機房網路建置要點 <ul><ul><li>資訊安全 </li></ul></ul><ul><ul><ul><li>Face to Internet </li></ul></ul></ul><ul><ul><ul><ul><li>阻卻所有惡意的流量 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Scalable Firewall/IPS/DDoS mitigation/Web Application Firewall </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Face to cloud customers </li></ul></ul></ul><ul><ul><ul><ul><li>提供安全快速的存取方式 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>SSLVPN, Dedicated connection </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>WAN acceleration </li></ul></ul></ul></ul></ul>Cloud Service SSL VPN
  8. 8. Private cloud <ul><li>企業若希望享有 cloud computing 的優勢,但又不希望把企業資訊儲存在他人的平台上 </li></ul><ul><ul><li>建立自有的 cloud – private cloud </li></ul></ul><ul><li>Private cloud 特色 </li></ul><ul><ul><li>規模較小 </li></ul></ul><ul><ul><ul><li>可採取更扁平的網路架構,而非傳統三層式架構 </li></ul></ul></ul><ul><ul><ul><ul><li>降低複雜度 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>增進整體網路效能 </li></ul></ul></ul></ul><ul><ul><li>效能要求較高 </li></ul></ul><ul><ul><ul><li>High bandwidth </li></ul></ul></ul><ul><ul><ul><li>Low latency </li></ul></ul></ul><ul><ul><li>更豐富的虛擬化整合 </li></ul></ul><ul><ul><ul><li>除了 server virtualization ,還可以進行 desktop virtualization </li></ul></ul></ul><ul><ul><ul><ul><li>提昇虛擬化效益 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>網路必需能夠分辨重要性高的流量與一般流量 (QoS) </li></ul></ul></ul></ul>
  9. 9. Hadoop cluster 網路環境 <ul><li>在 over-subscription 網路環境中, Hadoop 可優先使用同一 rack 的 node 進行 MapReduce ,以獲取較佳的效能。 </li></ul><ul><ul><li>跨 rack 傳輸將使得延遲增加與可能造成 uplink 壅塞 </li></ul></ul><ul><ul><li>讓 Hadoop 了解 node 的網路架構 </li></ul></ul><ul><ul><ul><li>修改 DNSToSwitchMapping </li></ul></ul></ul>Sufficient bandwidth, less latency In-sufficient bandwidth, more latency N:1 over-subscription N:1 over-subscription Hadoop Cluster
  10. 10. Hadoop cluster 網路環境 <ul><li>區分 data traffic 與 client communication 所使用網路卡 </li></ul><ul><ul><li>獨立之 HDFS segment 可進行 Ethernet jumbo frame 調整以增進傳輸效能 </li></ul></ul><ul><ul><ul><li>修改 dfs.datanode.dns.interface </li></ul></ul></ul>HDFS segment; MTU>9000 (jumbp frame) IP segment; MTU=1500
  11. 11. 雲端運算網路趨勢 <ul><li>Higher bandwidth </li></ul><ul><ul><li>Over-subscription 網路造成潛在效能瓶頸 </li></ul></ul><ul><ul><ul><li>虛擬化將造成網路流量需求大增 </li></ul></ul></ul><ul><ul><li>將 Cloud computing LAN 昇級至 non-oversubscription 網路 </li></ul></ul><ul><ul><ul><li>避免任何壅塞發生 </li></ul></ul></ul>4:1 over-subscription GE GE GE GE GE Non-oversubscription GE GE GE GE 10GE UPGRADE
  12. 12. 雲端運算網路趨勢 <ul><li>Lower latency </li></ul><ul><ul><li>Wire latency (1500 bytes) </li></ul></ul><ul><ul><ul><li>GigabitEthernet: ~12μs </li></ul></ul></ul><ul><ul><ul><li>10GigabitEthernet: ~2μs </li></ul></ul></ul><ul><ul><li>在 SOA (Service-Oriented Architecture) 環境下,一個交易 (transaction) 需要跨多個 SOA 元件與網段才能完成 </li></ul></ul><ul><ul><ul><li>與單純的 standalone server solution 比起來,延遲時間增加 </li></ul></ul></ul><ul><ul><ul><li>由於這是 GigabitEthernet 電氣規範造成的限制,更換 GE 交換器或網卡無法有效解決 SOA 環境延遲增加的狀況 </li></ul></ul></ul><ul><ul><li>昇級 Cloud LAN 自 GE 至 10GE </li></ul></ul><ul><ul><ul><li>降低延遲時間 </li></ul></ul></ul><ul><ul><ul><li>增加有效頻寬 </li></ul></ul></ul>Internet Network latency = A A Internet Network latency = A + B + C + D A C B D
  13. 13. 雲端運算網路趨勢 <ul><li>Unified and converged interconnection </li></ul><ul><ul><li>目前 server 上主要 I/O 種類 : </li></ul></ul><ul><ul><ul><li>GigabitEthernet - LAN </li></ul></ul></ul><ul><ul><ul><li>IBA – InfiniBand Network </li></ul></ul></ul><ul><ul><ul><li>FC - SAN </li></ul></ul></ul><ul><ul><ul><li>SAS/SATA – Local storage </li></ul></ul></ul><ul><ul><li>Cloud datacenter approaches </li></ul></ul><ul><ul><ul><li>使用 Enhance Ethernet or IBA 來進行實體連線整合 </li></ul></ul></ul><ul><ul><ul><ul><li>VM 使用虛擬化 / 模擬裝置存取 I/O 資源 </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>vFC, vFCoE, vGbE etc… </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><li>更有效使用高頻寬、低延遲網路 </li></ul></ul></ul></ul>GbE IBA FC SAS/SATA Enhance Ethernet; IBA Virtualization
  14. 14. 參考資料 <ul><li>Books </li></ul><ul><ul><li>Cloud & Virtualization </li></ul></ul><ul><ul><ul><li>Cloud Computing and SOA Convergence in Your Enterprise; A Step-by-Step Guide by David S. Linthicum </li></ul></ul></ul><ul><ul><ul><li>Cloud Computing Explained by John Rhoton </li></ul></ul></ul><ul><ul><ul><li>Cloud Computing; Implementation, Management, and Security by John W. Rittinghouse and James F. Ransome </li></ul></ul></ul><ul><ul><ul><li>The Green and Virtual Data Center by Greg Schulz </li></ul></ul></ul><ul><ul><li>Hadoop </li></ul></ul><ul><ul><ul><li>Hadoop: The Definitive Guide by Tom White </li></ul></ul></ul><ul><ul><ul><li>Pro Hadoop; Build scalable, distributed applications in the cloud by Jason Venner </li></ul></ul></ul>
  15. 15. Q & A

×