SoftBank Global AS migration practice, by Hirokazu Taira. A presentation given at APRICOT 2016’s Network Operations session on 24 February 2016.

1. Hirokazu Taira
SoftBank Corp.
SoftBank Global AS
migration practice
(APRICOT2016)

2. SoftBank(AS4725/AS17676) would like to share
SoftBank Global AS migration practice such as
challenge to solution, technical issue and
internal process to peering communities.
Summary
2

3. 1.Background
2.Migration plan
3.Backbone migration
4.Peer migration
5.Implementation process
Agenda
3

4. SoftBank company update
SoftBank
Mobile Corp.
SoftBank
Telecom Corp.
SoftBank BB
Corp.
Ymobile Corp.
Merger of 4 companies to maximum corporate value
SoftBank Corp.
SoftBank Mobile Corp.
Company name was changed again
4

5. SoftBank Internet configuration
Peer/Transit
AS4725
ODN
AS17676
YBB
Enterprises
Mobile
Broadband
users
40million mobile users
5million
5

6. Background
6

7. SoftBank Int’l traffic flow
Global ISPs
１００％
Users
70% of all international
traffic flow toward
AS17676 via AS4725
Once traffic toward AS17676
increases, AS4725 also need
to upgrade its own
network(Resource issue)
７０％
３０％
AS4725
ODN
AS17676
YBB
7

8. Time
Trafficvolume
Traffic forecast
ForecastActual
GAP widens
day by day
8

9. Solution of structure issue
Global ISPs
Users
７０％
No needed to upgrade
backbone for YBB
traffic increasing and
can use resource for
other purpose
Global AS migration from AS4725 to AS17676
解決
３０％
１００％
No resource issue
for int’l traffic
toward YBB
AS4725
ODN
AS17676
YBB
9

10. AS4725
AS17676 AS4725
AS17676
Ｊｕｓｔ replace?
It's easier said than done
Challenge to Global AS migration
Global AS migration from AS4725 to AS17676
10

11. Migration plan
11

12. Migration summary
◆Backbone migration
- YBB US POP setup
- New JP-US circuits setup for YBB
- Existing JP-US ccts migration (ODN⇒YBB)
- New JP-Asia ccts setup for YBB
◆Peer migration
- YBB US peer & transit
- YBB Asia peering
- Advertise ODN routes to YBB peers & transit
- Terminate ODN peers in US and Asia 12

13. Migration scale
◆International circuits
- New ccts : JP-US approx.300G, Asia 150G+
- Migration ccts:JP-US approx.300G, Asia 100G+
◆Number of peers
- YBB new peers: US 100+,Asia 30+
- ODN de-peers: US 100+ ,Asia 30+
- Advertise ODN routes to YBB peers : 600+
◆Number of Field Trial tests
- 10 times
◆Time frame
- Approx. 2 years 13

14. Migration timeframe
Y2013 Q3 Y2014 Y2015 Y2016 Q1
FS Plan
Peering
negotiation
Procurement
(DC/Node/CCTs)
Int’l circuits,
FT & Peering
Advertise
ODN prefixes
Terminate
ODN Peer
14

15. Backbone migration
15

16. Asia
peers
AS4725
US
peers
Up-
streams
AS17676
SoftBank Global NW(As of Mar,2014)
16

17. Asia
peers
AS4725
US
peers
Up-
streams
AS17676
SoftBank Global NW(As of Oct,2014)
17

18. Asia
peers
US
peers
Up-
streams
AS17676
AS4725
SoftBank Global NW(Mar,2016～)
18

19. Asia
peers
US
peers
Up-
streams
SB Global NW(Final)
AS17676
AS4725
19

20. Peer migration
20

21. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
Users
BGP community
service
Peer migration(As of Mar,2014)
21

22. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
Users
BGP community
service
Peer migration(Nov,2014～)
Peering with US,EU & Asia peers for AS17676
22

23. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
AS4725 routes
AS4725 routes
AS4725 routes
Users
BGP community
service
Implement BGP
community for
AS4725 users
Peer migration(Mar,2015～)
Field trial test for advertising AS4725 route
23

24. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
AS4725 routes
AS4725 routes
AS4725 routes
Users
BGP community
service
Implement BGP
community for
AS4725 users
Peer migration(Nov,2015～)
Advertising AS4725 routes to YBB peers
24

25. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
Full route
AS4725 routes
AS4725 routes
AS4725 routes
Users
BGP community
service
Advertise full routes to ODN
Peer migration(Feb,2016～)
Implement BGP
community for
AS4725 users
25

26. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
AS4725 routes
AS4725 routes
AS4725 routes
Users
BGP community
service
Terminate AS4725 peers for Asia & US
Peer migration(Mar,2016～)
Implement BGP
community for
AS4725 users
26

27. AS4725 AS17676
US/EU peers
transit
Japan peers
transitAsia peers
Full route
AS4725 routes
AS4725 routes
AS4725 routes
Users
BGP community
service
Peer migration(Final)
Implement BGP
community for
AS4725 users
27

28. Issues during migration
◆Technical issues
- Routing issue
- JP-US ECMP unbalance
- JP-US circuits errors
- Advertised Peer’s routes to Peers
◆Resource issues
- Test bed resource for verification test
- Schedule conflict with other works
28

29. Implementation
process
29

30. Why take long time ?
◆Background
- Internet is lifeline and social infrastructure
- Customer demands(The customer is king)
- Obligation to report to authority when
critical failure occurs.
No acceptable for interruption or
congestion in spite of Internet
30

31. Critical failure report
http://www.soumu.go.jp/menu_seisaku/ictseisaku/net_anzen/jiko/judai.html
1million
100,000
30,000
1hour 2hours
Number of
affected users
Failure Duration
(hours)
Voice service including
emergency call
Voice service excluding
emergency call
Internet service
without charge fee
Others including
Internet service
Duration Users
2 hours 30,000
1 hours 1million
Operators have an obligation to report to authority
when critical failure occurs.
12hours 24hours
31

32. Network design process
◆Should be no error during work
◆Prompt switch-back when failure during work
◆Observance of network design process
Field TrialWork Plan
Verification
Test at
test bed
Network
Design
Workapproval
meetingwithNOC
Review
Checkdifference
Reviewand
judgment
Review
Rehearsal
at test bed
Real
Implementation
32

33. Network design process committee
Section Section・・・・・・・・・・・・・・・・・・・・・・・・・・・・・・・・・・
Report Report
Analysis Review Kaizen
FeedbackFeedback
Network Operation Centers
Guideline
Network Division
Network design process organization
33

34. Implementation work rule
◆Conduct in accordance with operational manual
◆Maintenance windows is low traffic time(2-6AM)
◆Switch-back promptly when failure during work
Manual
Escalation
Operators NOC staff
Instruction of
switch-back
Manager
NOC
Manager
NOC
Manager
34

35. Conclusion
◆Global AS migration practice
- Challenging issue but happens often
- Sharing practice is important to maintain
the Internet
◆Implementation process
- It is also important to maintain the Internet
because the Internet is one of necessary
lifeline and social infrastructure
35

36. Thank you for your kind
attention.
36