Проектировка IPv6-оnly датацентра в Яндексе. Никита Широков
1.
2. IPv6 Only Data Centers
in Yandex
Nikita V. Shirokov, network engineer, AS13238
3. Before we start
«How we launched IPv6 in Yandex» by Vladimir Ivanov
Two networks:
〉 Backbone (user's traffic handling)
〉 Technological network (so called «Fastbone»; bulk traffic)
!
https://tech.yandex.ru/events/yac/2012/talks/380/
3
5. Why we decided to build IPv6 only DC
〉 We ran out of public v4 addresses (and almost ran out of 1918)
〉 We think that public v6 is better that CGN for InterDC
connectivity
5
6. Points of interest
〉 WAN
〉 Firewalls and SLBs
〉 Intra DC Network (rack to rack etc)
〉 Services
6
13. Services
Most of the services IPv6 ready since 2011+ (or so)
But:
〉 It’s easy to forget about monitoring
〉 or cluster’s management
〉 or replication’s transport
〉 or bootstrapping
13
14. Deploy. Phase 1
14
Backbone
Fastbone# show ipv6 bgp summary vrf …
BGP summary information for VRF …, address family IPv6 Unicast
BGP router identifier …, local AS number 65400
BGP table version is 288725, IPv6 Unicast config peers 210, capable peers 210
370 network entries and 370 paths using 45880 bytes of memory
BGP attribute entries [9/1224], BGP AS path entries [2/16]
BGP community entries [2/64], BGP clusterlist entries [0/0]
15. Not only IPv6 DC
RND: (or «I need something from github!111»)
〉 6to4 Nat. No need for high performance
Non Realtime servers needs to dl something from internet
(such as webrobots/spiders etc)
〉 4over6 tunneling or Dedicated racks with /26 IPv4 subnets
〉 Future: high performance 6to4 Netmap bassed NAT/FW
15
16. Not only IPv6 DC
!
Realtime servers needs to dl/query something from internet
(such as public dns resolvers etc)
〉 4over6 tunneling
〉 Future: high performance 6to4 Netmap bassed NAT/FW
16
19. Additional Slides:
19
WAN
L2 DC Fabric
SLB check:
http get from 10.x.x.x to
10.x.x.y
external IP to VIP
external IP to 10.x.x.y
PBR: from 10.x.x.y thru 10.x.x.x
20. Additional Slides:
20
WAN
L3 DC Fabric
external IP to VIP
external IP to VIP
encapsulated into SLB to
Server
we cant http get on VIP @ SLB (will go
to local IP @ loopback). therefore cant
check if this address exist @ Server