Sakura Cloud is a service developed and released in 2011. We use InfiniBand, witch is rare as an Internet service and it is used for connection between server and storage. In this presentation, we will briefly introduce the configuration of the system and explain the reasons and usage if InfiniBand. We are going to introduce operational comparisons and meris demerits with the services provided by Ethernet.
Sakura Cloud is a service developed and released in 2011. We use InfiniBand, witch is rare as an Internet service and it is used for connection between server and storage. In this presentation, we will briefly introduce the configuration of the system and explain the reasons and usage if InfiniBand. We are going to introduce operational comparisons and meris demerits with the services provided by Ethernet.
10. IP over InfiniBand
• RFC4755
• 簡単に言うと、ドライバ入れればIPが使えるってこと
[root@sac-is1a-sv001 ~]# ip a show dev ib0
5: ib0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 65520 qdisc
pfifo_fast master bond0 state UP qlen 256
link/infiniband
80:00:02:08:fe:80:00:00:00:00:00:00:00:02:c9:03:00:4e:53:cf brd
00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
─ MTU:65520
─ MACがチョー長い
─ (クラウドの都合でbond化してます)
─ 最近のディストリはドライバを標準搭載しています
10
11. IP over InfiniBand
• バースト転送性能は圧倒的
• 10,000発のflood pingの場合、10倍以上の差になる
11
InfiniBand
Ethernet
12. IP over InfiniBand
• ちょっとしたクセもある
• 平均的なRTTは
IBの方がよい
• 一発目だけ極端
に数値が悪い
• セグメント管理
の方式が異なる
ため
12
InfiniBand
Ethernet