Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

229 views

Published on

APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

Published in: Internet
  • Be the first to comment

  • Be the first to like this

APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

  1. 1. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  2. 2. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ’ !      Dix-ie/NSPIXP PAIX EQUI6IX AMS-IXLINXUK6X JPNAP EQUI6IX AS2914 AS 4713 DE-CIX PARIX ESPANIX : Global IP Network POP Singapore NTT Singapore
  3. 3. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ‘ US Backbone Global Backbone OCN Aichi OCN Kyoto OCN Osaka OCN Hyogo OCN Hiroshima OCN Fukuoka OCN Hokkaido OCN Kanagawa OCN Miyagi OCN Chiba OCN Tokyo OCN 180 Gbps 20 Gbps 20 Gbps 480 Gbps 20 Gbps 80 Gbps 120 Gbps 80 Gbps 1Gbps NSPIXP-3 40Gbps JPNAP Osaka 90Gbps JPNAP 10Gbps dix-ie Domestic Peer Osaka GW 1Gbps Internet Multifeed ICP 20 Gbps 100 Gbps 440 Gbps 20 Gbps JAPAN BackBone 480 Gbps Osaka Core200 Gbps Aichi Core200 Gbps Gunma Core Tokyo Core 200 Gbps 200 Gbps Tokyo GW 560 Gbps EUROPE Backbone ASIA Backbone Houston Australia New York Chicago Warsaw Seattle Korea Miami Atlanta GenevaFrankfurt Dusseldorf Madrid Taiwan Osaka Hong Kong Dallas Amsterdam Singapore London Paris Tokyo Malaysia Washington D.C.San Jose Brussels Budapest SofiaBucharest 310 Gbps 240 Gbps Los Angeles
  4. 4. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.   ’ ‘ ) 6 6 3G 39A 3G 39A 3G 39A 3G 39A 3G 39A 3G 39A( 3G( 39A) 3G) /) -G / 3GA 5B 49I 5B 49I 5B 49I 5B 1E 9 BA 09E DA 7 E DA 39 9A 2A DA9 BA9 28 Mar 2003 installed 10G-IF in the backbone Feb 2007 100G between Japan to the U.S. (ntt.net) Nov 2001 Started FTTH service Dec 1996 Started OCN Aug 2011 500G between Japan to the U.S. (ntt.net) 2200 5800 20000
  5. 5. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ’
  6. 6. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  7. 7. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  ! 
  8. 8. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  !  % % % % %% % % -% - -% - - -%% - - - - - -% % - - % - - % % -% - % - - % -% - % -% - % -% - % - - % -% - % %- - % - - % - - % % - - ./623 3170/4 63 70/44250
  9. 9. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ! 
  10. 10. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  !  % %
  11. 11. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  ‘ 2008
  12. 12. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ! 
  13. 13. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  /32 /48
  14. 14. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  15. 15. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ! 
  16. 16. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !    !       
  17. 17. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. Gunma Core Miyaagi POP Hokkaido POP Kanawaga POP Chiba POP Aichi POP Kyoto POP Hyogo POP Hiroshima POP Fukuoka POP West Tokyo POP Tokyo Core 80G 100G 20G 20G 20G 120G 80G 180G 400G 20G20G Aichi Core 440G Osaka POP パケット 携帯網 (Dopa) 高速ディジタル/FR 携帯網 高速ディジタル FR IPルーティング網 接続専用サービス LAN PHS網 NTT-COM ハウジングビルLANLAN SDSLADSL FTTH B ADSL LAN LAN PSTN/ISDN Ether/FE/GE ATM/STM FWA LAN ADSLFTTH 専用線 帯域 確保 専用線 Ether/FE/GE ATM/STM ISDN ISDN ISDN LAN Osaka Core The internet The Internet VERIO IX (Tokyo) Private Peers (Osaka) IX (Osaka) Private Peers (Tokyo) AS4713 - Backbone                 AS4713 - Edge 40G X0G Tokyo POP ntt.net        XX0G 90G Tokyo 560G Osaka 480G 480G BGP4(+) BGP4(+) BGP4(+) Core routes To flet’s/business customers BGP4(+) / OSPF(3) Consumer custmers(IPv4/v6) Business customers(IPv4/v6)
  18. 18. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  19. 19. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !      ! 
  20. 20. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !    ’ core edge1, 2 core edge 3 BGP customers customers Core Router Peering Router1 Peering Router2 Housing service Router
  21. 21. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  22. 22. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.       ’
  23. 23. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !   
  24. 24. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  !  •  •  • 
  25. 25. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  26. 26. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !      ! 
  27. 27. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !    aggregate core aggregate core aggregate aggregate OSPF Area 0 edge ACT edge ②looks up BGP routes and forwards edgeα’s loopback because aggregate router know BGP routes. SBY edge ①look up the default-route when packet comes from downlink. because edge router is non BGP router. Internal routers Peering/Transit routers OSPF Area 1 Destnation address 192.168.1.1/24
  28. 28. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. OSPF Area 0 OSPF Area 1 aggregate core aggregate core aggregate aggregate Internal routers Peering/Transit routers edge ACT edge SBY edge ④Replacing Standby edge router to another aggregation router which located in same OSPF area ③Replacing this aggregation router when become EOL(End Of life)
  29. 29. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. OSPF Area 0 OSPF Area 1 aggregate core aggregate core aggregate aggregate edge ACT edge SBY edge ⑤Despite the migration to new aggregation router,Act edge router keep forwarding packets to upstream links. Because It don’t know the BGP routes. ⑥Aggregation router finds new ospf shotest path to edgeα’s loop back at downlink. Because OSPF prefer same area path to less metric path. Internal routersPeering/Transit routers ! 
  30. 30. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. OSPF Area 0 OSPF Area 1 aggregate core aggregate core aggregate aggregate edge Internal routersPeering/Transit routers SBY edge ACT edge If edge router has BGP routes. Routing loop will not happen. Because edge router looks up BGP routes and find edge α loopback. As a result packets are forwarded to new aggregation router, not to old aggregation router
  31. 31. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. ! 
  32. 32. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. –
  33. 33. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. –
  34. 34. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. – ’
  35. 35. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.  
  36. 36. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved. !  ! 
  37. 37. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.
  38. 38. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.39 !    "   !   
  39. 39. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.40
  40. 40. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.41 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP * i MED 10 * e MED 20 * i MED 10 * e MED 10 MED 30 * i MED 20 * i MED 20 2mins at R1 ASBR-1 (MED10)
  41. 41. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.42 !  Solution add-path BGP Best External +Full mesh diverse-path Internet-draft draft-ietf-idr-add- paths draft-ietf-idr-best- external draft-ietf-grow- diverse-bgp-path- dist Current I-D version 06 05 06 Author Cisco,Juniper,HP Cisco, Juniper Cisco,Verisign,KD DI, NTT MCL
  42. 42. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.43 * i MED 10 e MED 20e MED 20 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP * i MED 10 not advertise to any peers only best paths * i MED 10 * e MED 10
  43. 43. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.44 e MED 20 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP * i MED 10 long time to change the paths * e MED 10 MED 30 * i MED 20 updates updates * i MED 20 i MED 30 updates i MED 30 * * i MED 10 updatesupdates
  44. 44. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.45 * i MED 10 e MED 20e MED 20 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP * i MED 10 * e MED 10 Backup paths i MED 20 best-external MED20 MED20 best-external
  45. 45. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.46 e MED 20 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP * i MED 10 More quickly * e MED 10 MED 30 * i MED 20 updates updates i MED 30 updates i MED 30 * * i MED 10best-externalbest-external i MED 20* i MED 20
  46. 46. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.47 0.0%$ 10.0%$ 20.0%$ 30.0%$ 40.0%$ 50.0%$ 60.0%$ 70.0%$ 80.0%$ 90.0%$ 100.0%$ sec$ 0$$ 5$$ 10$$ 15$$ 20$$ 25$$ 30$$ 35$$ 40$$ 45$$ 50$$ 55$$ 60$$ 65$$ 70$$ 75$$ 80$$ 85$$ 90$$ 95$$100$$105$$110$$115$$120$$125$$130$$135$$140$$ disable$best7external$1st$ disable$best7external$2nd$ enable$best7external$1st$ enable$best7external$2nd$ !      130sec 95sec 27% improved
  47. 47. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.48
  48. 48. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.49 !  R1 R2 ASBR1 (MED10) ASBR-2 (MED20) iBGP eBGP a logical IF a physical IF 210sec at R1
  49. 49. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.50 •    •  •  50 OSPF hello
  50. 50. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.51 51 •  × –
  51. 51. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.52 •    •  •  52
  52. 52. ©Copyright © 2012 NTT Communications Corporation All Rights Reserved.53 !  !    ! 

×