Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

An Easy way to build a server cluster without top of rack switches (MEMO)

3,112 views

Published on

An Easy way to build a server cluster without top of rack switches (MEMO)

12-Feb-2015
SAKURA Internet Research Center.
Senior Researcher / Naoto MATSUMOTO

Published in: Technology
  • Be the first to comment

An Easy way to build a server cluster without top of rack switches (MEMO)

  1. 1. 12-Feb-2015 SAKURA Internet Research Center. Senior Researcher / Naoto MATSUMOTO
  2. 2. Proof of Concept Reduce top of rack switches costs 10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server Top of Rack SW Aggregation SW Paper: How to build and manage a large scale switchless server clustering, Naoto MATSUMOTO,IOT28, 2015 / The Special Interest Group on Internet and Operation Technology (SIG-IOT) / Information Processing Society of Japan.
  3. 3. How does it works Using OSPFv3 Link-state advertisement for server clustering Quagga or another routing daemons
  4. 4. How to build it (CentOS7) # yum install -y quagga iptables-services # nmcli con mod eth0 connection.autoconnect yes # nmcli con mod eth1 connection.autoconnect yes # nmcli con mod eth2 connection.autoconnect yes # nmcli con mod eth3 connection.autoconnect yes # echo "net.ipv6.conf.all.forwarding = 1" >> /etc/sysctl.conf # cp -p /etc/quagga/zebra.conf /etc/quagga/ospf6d.conf # setsebool -P zebra_write_config 1 # systemctl mask firewalld # systemctl disable ip6tables # systemctl enable ospf6d # systemctl start ospf6d # vtysh # configure terminal # router ospf6 # router-id 10.0.0.16 # redistribute connected # area 0.0.0.0 range fd50:d026:7eee::/48 # interface eth0 area 0.0.0.0 # interface eth1 area 0.0.0.0 # interface eth2 area 0.0.0.0 # interface eth3 area 0.0.0.0 # interface lo # ipv6 address fd50:d026:7eee:16::16/64 # end # write # quit # reboot Routing daemon setup OSPFv3 configuration
  5. 5. Fast OSPFv3 Link Update TIPS # uname -sr ; cat /etc/redhat-release Linux 3.10.0-123.13.2.el7.x86_64 CentOS Linux release 7.0.1406 (Core) # vtysh # configure terminal # interface eth0 # ipv6 ospf6 hello-interval 1 # ipv6 ospf6 retransmit-interval 2 # ipv6 ospf6 dead-interval 3 # interface eth1 # ipv6 ospf6 hello-interval 1 # ipv6 ospf6 retransmit-interval 2 # ipv6 ospf6 dead-interval 3 # interface eth2 # ipv6 ospf6 hello-interval 1 # ipv6 ospf6 retransmit-interval 2 # ipv6 ospf6 dead-interval 3 # interface eth3 # ipv6 ospf6 hello-interval 1 # ipv6 ospf6 retransmit-interval 2 # ipv6 ospf6 dead-interval 3 # end # write # quit OSPFv3 update interval adjustment
  6. 6. Workload models 10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server Web Service ...etc Hadoop, Software Defined Storage ...etc
  7. 7. Network Durability Using OSPFv3 Link-state updates for re-route and failover failover
  8. 8. Backward Compatibility Translation,proxy and tunneling for IPv4 backward compatibility 10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server IPv4 IPv6 NAT, Proxy, L2TPv3 ..etc
  9. 9. 19' Rack Design Reduce networking cables costs 10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server
  10. 10. Conclusion "An Easy way to build a server cluster without top of rack Switches" is ... - Reduce top of rack switches & cables costs. - Lightweight and simple configuration. - High network durability. - Good IPv4/IPv6 backward compatibility.
  11. 11. Thanks for your interset. SAKURA Internet Research Center.

×