APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

’
! 
 
 
Dix-ie/NSPIXP PAIX EQUI6IX
AMS-IXLINXUK6X
JPNAP
EQUI6IX
AS2914
AS 4713
DE-CIX
PARIX
ESPANIX
: Global IP Network POP
Singapore
NTT Singapore

‘
US Backbone
Global Backbone
OCN Aichi
OCN Kyoto
OCN Osaka
OCN Hyogo
OCN Hiroshima
OCN Fukuoka
OCN Hokkaido
OCN Kanagawa
OCN Miyagi
OCN Chiba
OCN Tokyo
OCN
180
Gbps
20
Gbps
20
Gbps
480
Gbps
20
Gbps
80
Gbps
120
Gbps
80
Gbps
1Gbps
NSPIXP-3
40Gbps
JPNAP Osaka
90Gbps
JPNAP
10Gbps
dix-ie
Domestic Peer
Osaka GW
1Gbps
Internet Multifeed
ICP
20
Gbps
100
Gbps
440
Gbps
20
Gbps
JAPAN BackBone 480
Gbps
Osaka Core200
Gbps
Aichi Core200
Gbps
Gunma Core
Tokyo Core
200
Gbps
200
Gbps
Tokyo GW
560
Gbps
EUROPE Backbone
ASIA Backbone
Houston
Australia
New York
Chicago
Warsaw
Seattle
Korea
Miami
Atlanta
GenevaFrankfurt
Dusseldorf
Madrid
Taiwan
Osaka
Hong Kong
Dallas
Amsterdam
Singapore
London
Paris
Tokyo
Malaysia
Washington D.C.San Jose
Brussels
Budapest
SofiaBucharest
310
Gbps
240
Gbps
Los Angeles

  ’ ‘
)
6
6
3G
39A
3G
39A
3G
39A
3G
39A
3G
39A
3G
39A(
3G(
39A)
3G)
/)
-G
/
3GA
5B
49I
5B
49I
5B
49I
5B
1E
9 BA 09E DA 7 E DA 39 9A

2A DA9 BA9
28
Mar 2003
installed 10G-IF
in the backbone
Feb 2007
100G between
Japan to the U.S.
(ntt.net)
Nov 2001
Started
FTTH service
Dec 1996
Started OCN
Aug 2011
500G between
Japan to the U.S.
(ntt.net)
2200
5800
20000

’

! 
!

! 
! 
%
%
%
%
%% %
%
-%
-
-%
-
-
-%%
-
-
-
-
-
-%
%
-
-
%
-
-
%
%
-%
-
%
-
-
%
-%
-
%
-%
-
%
-%
-
%
-
-
%
-%
-
%
%-
-
%
-
-
%
-
-
%
%
-
-
./623 3170/4
63
70/44250

!

! 
! 

% %

! 
‘
2008

! 
/32
/48

! 
 
!

Gunma
Core
Miyaagi
POP
Hokkaido
POP
Kanawaga
POP
Chiba
POP
Aichi
POP
Kyoto
POP
Hyogo
POP
Hiroshima
POP
Fukuoka
POP
West Tokyo
POP
Tokyo
Core
80G
100G
20G
20G
20G
120G
80G
180G
400G
20G20G
Aichi
Core
440G
Osaka POP
パケット
携帯網
(Dopa)
高速ディジタル／FR
携帯網
高速ディジタル
ＦＲ
IPルーティング網
接続専用サービス
LAN
PHS網
NTT-COM
ハウジングビルLANLAN
SDSLADSL
FTTH B
ADSL
LAN LAN
PSTN／ISDN
Ether/FE/GE
ATM/STM
FWA
LAN
ADSLFTTH
専用線
帯域
確保
専用線
Ether/FE/GE
ATM/STM
ISDN
ISDN
ISDN
LAN
Osaka
Core
The internet The Internet
ＶＥＲＩＯ IX (Tokyo)
Private Peers (Osaka)
IX (Osaka)
Private Peers (Tokyo)
AS4713 -
Backbone
AS4713 - Edge
40G
X0G
Tokyo POP
ntt.net

XX0G
90G
Tokyo
560G
Osaka
480G
480G
BGP4(+)
BGP4(+)
BGP4(+)
Core
routes
To flet’s/business customers
BGP4(+) /
OSPF(3)
Consumer custmers(IPv4/v6) Business customers(IPv4/v6)

! 
 
 
!

! 
  ’
core
edge1, 2
core
edge 3
BGP
customers
customers
Core
Router
Peering
Router1
Peering
Router2
Housing
service
Router

 
 
 
’

! 
! 
• 
• 
•

! 
 
aggregate
core
aggregate
core
aggregate aggregate
OSPF Area 0
edge ACT
edge
②looks up BGP routes
and forwards
edgeα’s loopback
because aggregate router
know BGP routes.
SBY
edge
①look up the default-route
when packet comes from
downlink.
because edge router is non
BGP router.
Internal routers
Peering/Transit
routers
OSPF Area 1
Destnation address
192.168.1.1/24

OSPF Area 0
OSPF Area 1
aggregate
core
aggregate
core
aggregate aggregate
Internal routers
Peering/Transit
routers
edge ACT
edge
SBY
edge
④Replacing Standby edge router
to another aggregation router
which located in same OSPF area
③Replacing this aggregation router
when become EOL(End Of life)

OSPF Area 0
OSPF Area 1
aggregate
core
aggregate
core
aggregate aggregate
edge ACT
edge
SBY
edge
⑤Despite the migration to
new aggregation router,Act
edge router keep forwarding
packets to upstream links.
Because It don’t know the
BGP routes.
⑥Aggregation router finds
new ospf shotest path to
edgeα’s loop back at
downlink. Because OSPF
prefer same area path to less
metric path.
Internal routersPeering/Transit
routers
!

OSPF Area 0
OSPF Area 1
aggregate
core
aggregate
core
aggregate aggregate
edge
Internal routersPeering/Transit
routers
SBY
edge
ACT
edge
If edge router has BGP
routes. Routing loop will not
happen. Because edge router
looks up BGP routes
and find edge α loopback. As
a result packets are
forwarded to new
aggregation router, not to old
aggregation router

–

–
’

©Copyright © 2012 NTT Communications Corporation All Rights Reserved.39
! 
  "
 
!

! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
* i MED 10
* e MED 20
* i MED 10
* e MED 10
MED 30
* i MED 20
* i MED 20
2mins
at R1
ASBR-1
(MED10)

! 
Solution add-path
BGP Best
External
+Full mesh
diverse-path
Internet-draft
draft-ietf-idr-add-
paths
draft-ietf-idr-best-
external
draft-ietf-grow-
diverse-bgp-path-
dist
Current I-D
version
06 05 06
Author Cisco,Juniper,HP Cisco, Juniper
Cisco,Verisign,KD
DI, NTT MCL

* i MED 10
e MED 20e MED 20
! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
* i MED 10
not
advertise to
any peers
only best
paths
* i MED 10
* e MED 10

e MED 20
! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
* i MED 10
long time to
change the
paths
* e MED 10
MED 30
* i MED 20
updates
updates
* i MED 20
i MED 30
updates
i MED 30
*
* i MED 10
updatesupdates

* i MED 10
e MED 20e MED 20
! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
* i MED 10
* e MED 10
Backup
paths
i MED 20
best-external
MED20 MED20
best-external

e MED 20
! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
* i MED 10
More quickly
* e MED 10
MED 30
* i MED 20
updates
updates
i MED 30
updates
i MED 30
*
* i MED 10best-externalbest-external
i MED 20* i MED 20

0.0%$
10.0%$
20.0%$
30.0%$
40.0%$
50.0%$
60.0%$
70.0%$
80.0%$
90.0%$
100.0%$
sec$ 0$$ 5$$ 10$$ 15$$ 20$$ 25$$ 30$$ 35$$ 40$$ 45$$ 50$$ 55$$ 60$$ 65$$ 70$$ 75$$ 80$$ 85$$ 90$$ 95$$100$$105$$110$$115$$120$$125$$130$$135$$140$$
disable$best7external$1st$
disable$best7external$2nd$
enable$best7external$1st$
enable$best7external$2nd$
! 
 
 
130sec
95sec
27% improved

! 
R1 R2
ASBR1
(MED10)
ASBR-2
(MED20)
iBGP
eBGP
a logical IF
a physical IF 210sec
at R1

• 
 
• 
• 
50
OSPF hello

51
• 
× –

• 
 
• 
• 
52

! 
! 
 
!

APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Viewers also liked

Viewers also liked (16)

Similar to APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

Similar to APRICOT 2012 - Living with the ever-growing BGP table: an OCN story (20)

Recently uploaded

Recently uploaded (20)