Philip Smith began working with the internet in 1989 while completing his PhD. He helped design and implement TCP/IP networks at his university department. In 1993, he took a job at the UK's first ISP, PIPEX, where he helped upgrade their modems and learned about ISP backbones. Some key lessons he learned include: thoroughly testing new equipment for compatibility; planning network protocol migrations; the importance of peering relationships; and ensuring redundant network infrastructure is truly redundant. He also recounts incidents of bandwidth hijacking and outages caused by human errors.
HKNOG 10.0: 30 Years of Internet in HK – A Quick Look Back at the First 20 YearsAPNIC
APNIC Infrastructure and Development Director Che-Hoo Cheng remembers the first 20 years of the Internet at HKNOG 10.0, held online on 10 September 2021.
Presented by Mark Boxer & Jeff Bush of OFS
Agenda:
• Why Fiber?
• Fiber Feeds Everything
• Nuts and Bolts -The Components
• Installation Techniques
• Network Architectures and Planning
Presented at the Economic Development Conference in Ontario, CA, on October 25 2018, by John George.
Learn about FTTX, 5G, Rollable Ribbon, ADSS, Micro-cables, InvisiLight ® Solutions, and Slimbox® Solutions.
HKNOG 10.0: 30 Years of Internet in HK – A Quick Look Back at the First 20 YearsAPNIC
APNIC Infrastructure and Development Director Che-Hoo Cheng remembers the first 20 years of the Internet at HKNOG 10.0, held online on 10 September 2021.
Presented by Mark Boxer & Jeff Bush of OFS
Agenda:
• Why Fiber?
• Fiber Feeds Everything
• Nuts and Bolts -The Components
• Installation Techniques
• Network Architectures and Planning
Presented at the Economic Development Conference in Ontario, CA, on October 25 2018, by John George.
Learn about FTTX, 5G, Rollable Ribbon, ADSS, Micro-cables, InvisiLight ® Solutions, and Slimbox® Solutions.
We are providing FTTH (Fiber To The Home) using GPON technology based on customer requirements. In new projects, in order to attract more subscribers and satisfy their Ethernet+VoIP+CATV triple play service demand, fiber to the home network is the most suitable solution for cable operators GEPON system consists of an OLT (Optical Line Terminal) located in the operator's central office and an ONU (Optical Network Unit) located at customer premises for FTTH connections.
Influencing factors on your FTTx architecture - FTTH Europe Conference 2018 w...Comsof
Overview of internal and external factors that impact the network architecture
An operator chooses how to deploy its FTTH network. This is determined by the corporate strategy and is influenced by external market and regional factors. In this presentation we zoom in on these factors and strategic choices and examine the cost impact and practical implications of different architectures. We also look into real-life implementations from eir (Ireland) and Guifi-net (Spain).
10 Gigabit Ethernet Technology
Description: This presentation shows the use of 10 Gigabit Ethernet Technology
10 Gigabit Ethernet (10GE, 10GbE, or 10 GigE) is a group of computer networking technologies for transmitting Ethernet frames at a rate of 10 gigabits per second. It was first defined by the IEEE 802.3ae-2002 standard. Unlike previous Ethernet standards, 10 Gigabit Ethernet defines only full-duplex point-to-point links which are generally connected by network switches; shared-medium CSMA/CD operation has not been carried over from the previous generations Ethernet standards[1] so half-duplex operation and repeater hubs do not exist in 10GbE.
Contents:
Introduction
History
Evolution of 10 Gigabit Ethernet
10 Gigabit Ethernet Technology Overview ( 10GbE )
10 Gigabit Ethernet Standard
10 GbE Architectures
Applications For 10GbE
Using Fiber In 10 GbE
The Future Of 10 GbE
10 GbE Market Overview
Conclusion- Potentially lowest total cost of ownership (infrastructure/operational/human capital) Straight forward migration to higher performance levels, Proven multi-vendor and installed base interoperability (Plug and Play) and Familiar network management feature set.
Keywords: Qualitia, Technology, Internet, Ethernet, Fiber, Gigabit. Introduction and History of Gigabit Ethernet, 10 Gigabit Ethernet Technology Overview ( 10GbE ), 10 Gigabit Ethernet Standard, 10 GbE Architectures, Applications For 10GbE, Using Fiber In 10 GbE, The Future Of 10 GbE, 10 GbE Market
May 3rd 2016 DAS & Small Cells Workshop put on by Wireless Competition Bureau. This is from the first panel of the day to set the stage on small cells market and technology in commercial buildings.
m2fx : How Pushable fiber is transforming AfricaSimon Roberts
I recently hosted a workshop at the FTTH Africa conference on how the m2fx FTTH pushable solutions are transforming fiber installation and empowering operators and installers alike.
It's good to share and please enjoy
Parallel Wireless is reimagining LTE for public safety to provide control, coverage, and resilience for first responders. Learn more about our public safety LTE deployments at http://www.parallelwireless.com
Plan for all, build for 5G. Strategies for designing a heterogeneous fiber ne...Comsof
In this presentation we discuss the cost impact and practical implications of different deployment strategies of 5G and migration strategies to FTTH. We answer the following questions based on a case study on a reference area:
How to plan a heterogeneous network for 5G, FTTH, FTTB,...
How to build the initial 5G fiber network with support for future expansions
In this Assignment I discuss about Optical fiber, Evolution of optical fiber: from the beginning to present and beyond, Types of optical fibers used in commercial applications, Losses in optical fiber link, Submarine cable system worldwide, SONET, Fiber optic network backbone in Bangladesh, Applications of optical fiber in 4G technologies and beyond
We are providing FTTH (Fiber To The Home) using GPON technology based on customer requirements. In new projects, in order to attract more subscribers and satisfy their Ethernet+VoIP+CATV triple play service demand, fiber to the home network is the most suitable solution for cable operators GEPON system consists of an OLT (Optical Line Terminal) located in the operator's central office and an ONU (Optical Network Unit) located at customer premises for FTTH connections.
Influencing factors on your FTTx architecture - FTTH Europe Conference 2018 w...Comsof
Overview of internal and external factors that impact the network architecture
An operator chooses how to deploy its FTTH network. This is determined by the corporate strategy and is influenced by external market and regional factors. In this presentation we zoom in on these factors and strategic choices and examine the cost impact and practical implications of different architectures. We also look into real-life implementations from eir (Ireland) and Guifi-net (Spain).
10 Gigabit Ethernet Technology
Description: This presentation shows the use of 10 Gigabit Ethernet Technology
10 Gigabit Ethernet (10GE, 10GbE, or 10 GigE) is a group of computer networking technologies for transmitting Ethernet frames at a rate of 10 gigabits per second. It was first defined by the IEEE 802.3ae-2002 standard. Unlike previous Ethernet standards, 10 Gigabit Ethernet defines only full-duplex point-to-point links which are generally connected by network switches; shared-medium CSMA/CD operation has not been carried over from the previous generations Ethernet standards[1] so half-duplex operation and repeater hubs do not exist in 10GbE.
Contents:
Introduction
History
Evolution of 10 Gigabit Ethernet
10 Gigabit Ethernet Technology Overview ( 10GbE )
10 Gigabit Ethernet Standard
10 GbE Architectures
Applications For 10GbE
Using Fiber In 10 GbE
The Future Of 10 GbE
10 GbE Market Overview
Conclusion- Potentially lowest total cost of ownership (infrastructure/operational/human capital) Straight forward migration to higher performance levels, Proven multi-vendor and installed base interoperability (Plug and Play) and Familiar network management feature set.
Keywords: Qualitia, Technology, Internet, Ethernet, Fiber, Gigabit. Introduction and History of Gigabit Ethernet, 10 Gigabit Ethernet Technology Overview ( 10GbE ), 10 Gigabit Ethernet Standard, 10 GbE Architectures, Applications For 10GbE, Using Fiber In 10 GbE, The Future Of 10 GbE, 10 GbE Market
May 3rd 2016 DAS & Small Cells Workshop put on by Wireless Competition Bureau. This is from the first panel of the day to set the stage on small cells market and technology in commercial buildings.
m2fx : How Pushable fiber is transforming AfricaSimon Roberts
I recently hosted a workshop at the FTTH Africa conference on how the m2fx FTTH pushable solutions are transforming fiber installation and empowering operators and installers alike.
It's good to share and please enjoy
Parallel Wireless is reimagining LTE for public safety to provide control, coverage, and resilience for first responders. Learn more about our public safety LTE deployments at http://www.parallelwireless.com
Plan for all, build for 5G. Strategies for designing a heterogeneous fiber ne...Comsof
In this presentation we discuss the cost impact and practical implications of different deployment strategies of 5G and migration strategies to FTTH. We answer the following questions based on a case study on a reference area:
How to plan a heterogeneous network for 5G, FTTH, FTTB,...
How to build the initial 5G fiber network with support for future expansions
In this Assignment I discuss about Optical fiber, Evolution of optical fiber: from the beginning to present and beyond, Types of optical fibers used in commercial applications, Losses in optical fiber link, Submarine cable system worldwide, SONET, Fiber optic network backbone in Bangladesh, Applications of optical fiber in 4G technologies and beyond
India is the world’s second-largest telecommunications market, with 898 million subscribers as of March 2013. The sector's revenue grew by 13.4 per cent to reach US$ 64.1 billion in FY12. Wireless and wireline revenue increased at a compounded annual growth rate (CAGR) of 11.9 per cent to reach US$ 40.8 billion over FY07-12.; revenues from the telecom equipment segment in FY12 stood at US$ 23.5 billion as compared to US$ 23.4 billion in FY11.
Availability of affordable smartphones and lower rates are expected to drive growth in the Indian telecom industry. The Government of India (GOI) has been proactive in its efforts to transform India into a global telecommunication hub. The government has allowed foreign direct investment (FDI) of up to 74 per cent in basic and cellular, unified access, national/international long distance, and V-Sat services as well as public mobile radio trucked services. FDI of up to100 per cent is permitted for infrastructure providers offering dark fibre, electronic mail and voice mail.
The surge in the subscriber base has necessitated a network expansion covering a wider area, thereby creating a need for significant investment in telecom infrastructure. Telecom infrastructure in India is expected to increase at a CAGR of 20 per cent during 2008-15 to reach 571,000 towers in 2015.
Global Cyber Security trend & impact of Internet on the society of Bangladesh...Fakrul Alam
The internet has, in the mere space of a decade, completely revolutionized the way things are done in Bangladesh. Everything from making friends, shopping, learning and even starting and promoting businesses has experienced paradigm shifts due to the internet. But, despite the allures of connectivity. There are also dangers as well.
This event will focus on cyber security and how to keep privileged data safe from unwanted observation. The event will also talk about how society has changed, both good and bad, and how we can use this opportunity to drive more meaningful growth.
Introduction to Development for the InternetMike Crabb
Brief introduction into developing for the internet. A short history of how pages communicate with a server and a look a different web stacks that can be used in web development
An internet with lower case “i” is two or more networks that can communicate with each other. The most notable internet is called the Internet with upper case “I” is composed of thousands of interconnected networks The Internet as several backbones, provider networks, and customer networks. At the top level, the backbones (international ISPs) are large networks owned by some communication companies such as Sprint, Verizon (MCI), AT&T, and NTT. The backbone networks are connected through some complex switching systems, called peering points. At the second level, there are smaller networks, called provider networks that uses the services of the backbones and pay them for their services. The provider networks are connected to backbones or other provider networks. At the edge of the Internet the customer networks are networks that actually use the services provided by the Internet. They pay to provider networks for receiving services. Backbones and provider networks are also called Internet Service Providers (ISPs). The backbones are known as international ISPs and the provider networks are known as national or regional lSPs.
Presentation by Kevin Smith, Vodafone & Chair ETSI NGP (Next Generation Protocols) at the URLLC 2017 conference on Nov. 14, 2017.
*** Shared with Permission ***
Reconstructing computer networking with RINA: how solid scientific foundation...ICT PRISTINE
Reconstructing computer networking with RINA: how solid scientific foundations can allow Europe to become a world leader in internetworking, RINA tutorial to the EC
APNIC Training Delivery Manager Terry Sweetser presents an overview of Internet Exchange Points at PacNOG 31, held in Port Vila, Vanuatu from 26 to 30 June 2023.
PITA 27th AGM & Business Forum Expo 23: Internet Exchange PointsAPNIC
APNIC Training Delivery Manager Terry Sweetser presented on smarter networking and Internet traffic efficiency with Internet Exchange Points at the PITA 27th AGM & Business Forum Expo 23, held from 29 May to 1 June 2023, in Port Moresby, Papua New Guinea.
Italy Agriculture Equipment Market Outlook to 2027harveenkaur52
Agriculture and Animal Care
Ken Research has an expertise in Agriculture and Animal Care sector and offer vast collection of information related to all major aspects such as Agriculture equipment, Crop Protection, Seed, Agriculture Chemical, Fertilizers, Protected Cultivators, Palm Oil, Hybrid Seed, Animal Feed additives and many more.
Our continuous study and findings in agriculture sector provide better insights to companies dealing with related product and services, government and agriculture associations, researchers and students to well understand the present and expected scenario.
Our Animal care category provides solutions on Animal Healthcare and related products and services, including, animal feed additives, vaccination
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBrad Spiegel Macon GA
Brad Spiegel Macon GA’s journey exemplifies the profound impact that one individual can have on their community. Through his unwavering dedication to digital inclusion, he’s not only bridging the gap in Macon but also setting an example for others to follow.
Gen Z and the marketplaces - let's translate their needsLaura Szabó
The product workshop focused on exploring the requirements of Generation Z in relation to marketplace dynamics. We delved into their specific needs, examined the specifics in their shopping preferences, and analyzed their preferred methods for accessing information and making purchases within a marketplace. Through the study of real-life cases , we tried to gain valuable insights into enhancing the marketplace experience for Generation Z.
The workshop was held on the DMA Conference in Vienna June 2024.
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC
Ellisha Heppner, Grant Management Lead, presented an update on APNIC Foundation to the PNG DNS Forum held from 6 to 10 May, 2024 in Port Moresby, Papua New Guinea.
Instagram has become one of the most popular social media platforms, allowing people to share photos, videos, and stories with their followers. Sometimes, though, you might want to view someone's story without them knowing.
Ready to Unlock the Power of Blockchain!Toptal Tech
Imagine a world where data flows freely, yet remains secure. A world where trust is built into the fabric of every transaction. This is the promise of blockchain, a revolutionary technology poised to reshape our digital landscape.
Toptal Tech is at the forefront of this innovation, connecting you with the brightest minds in blockchain development. Together, we can unlock the potential of this transformative technology, building a future of transparency, security, and endless possibilities.
2. Background
n Internet involvement started in 1989 while at
University completing PhD in Physics
n Got a little bit side-tracked by Unix, TCP/IP and
ethernet
n Helped design and roll out new TCP/IP ethernet
network for Department
n Involved in day to day operations of CAD Lab as
well as Dept public Unix servers (HP and Sun)
n Caught the Internet bug!
3. How it all started
n At end of University Post Doc in 1992
n Job choice was lecturer or “commercial world”
n Chose latter – job at UK’s first ISP advertised on
Usenet News uk.jobs feed
n Applied, was successful, started at PIPEX in 1993
n First big task – upgrade modems from standalone
9.6kbps to brand new Miracom 14.4kbps rack
mount
n With upgradable FLASH for future standards upgrades!
4. In at the deep end
n Testing testing and more
testing
n Rackmount saved space
n But did V.32bis work with
all customers??
5. First lesson
n Apart from wishing to be back at Uni!
n Test against customers expectations and
equipment too
n Early v.32bis (14.4kbps) modems weren’t always
backward compatible with v.32 (9.6kbps) or older
standards
n One manufacturer’s v.32bis didn’t always talk to
another’s v.32bis – fall back to v.32 or slower
n Vendor’s promises and specification sheets
often didn’t completely match reality
6. ISP Backbones
n In those early days, BGP was “only for experts”, so I
watched in awe
n Learned a little about IGRP and BGPv3
n But not enough to be conversant
n April 1994 saw the migration from Classful to
Classless BGP
n Beta Cisco IOS had BGPv4 in it
n Which meant that our peering with UUNET could be
converted from BGPv3 to BGPv4
n With the cheerful warning that “this could break the
Internet”
7. ISP Backbones
n Internet didn’t break, and the whole Internet had
migrated to using classless routing by end of 1994
n But classful days had left a mess behind
n Large numbers of “Class Cs” still being announced
n The CIDR Report was born to try and encourage these Class
Cs to be aggregated
n Cisco made lots of money upgrading existing AGS and AGS+
routers from 4Mbytes to 16Mbytes of RAM to accommodate
n ISP engineers gained lots of scars on
hands from replacing memory boards
and interfaces
8. BGP improvements
n The ISP in 2014 has never had it so good!
n In 1994/5:
n iBGP was fully meshed
n Routers had 16Mbytes RAM
n Customer BGP announcements only changeable during
maintenance outages
n BGP table took most of the available RAM in a router
n The importance of separation of IGP/iBGP/eBGP was still not
fully appreciated
n No such thing as a BGP community or other labour saving
configuration features
9. BGP improvements
n Major US ISP backbone meltdown
n iBGP full mesh overloaded CPUs, couldn’t be
maintained
n Cisco introduced BGP Confederations, and a little
later Route Reflectors, into IOS
n By this point I was running our backbone
operations
n Colleague and I migrated from full mesh to per-
PoP Route Reflector setup in one 2 hour
maintenance window
10. Second Lesson
n Migrating an entire backbone of 8 PoPs and
50+ routers from one design of routing
protocol to another design should not be
done with out planning, testing, or phasing
n We were lucky it all “just worked”!
11. Peering with the “enemy”
n Early PIPEX days saw us have our own paid capacity
to the US
n With a couple of paid connections to Ebone (for their
“Europe” routes) and SWIPnet (as backup)
n Paid = V Expensive
n Interconnecting with UK competition (UKnet, Demon,
BTnet) seen as selling the family jewels! And would
be extremely bad for sales growth
n Even though RTT, QoS, customer complaints, extreme cost
of international bandwidth, logic and commonsense said
otherwise
n But we did connect to JANET (UK academics) – because
they were non-commercial and “nice guys”
12. Birth of LINX
n Thankfully logic, commonsense, RTT, QoS and finances
prevailed over the sales fear campaign
n The technical leadership of PIPEX, UKnet, Demon, BTnet and
JANET met and agreed an IXP was needed
n Sweden had already got Europe’s first IX, the SE-GIX, and that
worked v nicely
n Of course, each ISP wanted to host the IX as they had “the best
facilities”
n Luckily agreement was made for an
independent neutral location – Telehouse
n Telehouse was a Financial disaster-recovery
centre – they took some serious persuading
that this Internet thing was worth selling some
rack space to
13. Success: UK peering
n LINX was established
n Telehouse London
n 5 UK network operators (4 commercial, 1 academic)
n BTnet was a bit later to the party than the others
n First “fabric” was a redundant PIPEX 5-port ethernet hub!
n We had just deployed our first Catalyst 1201 in our PoPs
n Soon replaced with a Catalyst 1201 8-port 10Mbps ethernet
switch when the aggregate traffic got over about 3Mbps
n Joined by a second one when redundancy and more capacity
was needed
14. Third Lesson
n Peering is vital to the success of the Internet
n PIPEX sales took off
n Customer complaints about RTT and QoS disappeared
n Our traffic across LINX was comparable to our US traffic
n The LINX was critical in creating the UK Internet
economy
n Microsoft European Datacentre was UK based (launched in
1995), connecting via PIPEX and BTnet to LINX
n Our resellers became ISPs (peering at LINX, buying their
own international transit)
n More connections: smaller ISPs, international operators,
content providers (eg BBC)
15. IGPs
n IGRP was Cisco’s classful interior gateway protocol
n Migration to EIGRP (the classless version) happened
many months after the Internet moved to BGPv4
n Backbone point to point links were all /26s, and only visible
inside the backbone, so the classfulness didn’t matter
n EIGRP was Cisco proprietary, and with the increasing
availability of other router platforms for access and
aggregation services, decision taken to migrate to
OSPF
n Migration in itself was easy: EIGRP distance was 90, OSPF
distance was 110, so deployment of OSPF could be done “at
leisure”
16. Fourth Lesson
n IGP migration needs to be done for a reason
n With a documented migration and back out plan
n With caution
n The reasons need to be valid
n EIGRP to OSPF in the mid 90s took us from
working scalable IGP to IOS bug central L –
Cisco’s OSPF rewrite was still half a decade away
n UUNET was by then our parent, with a strong ISIS
heritage and recommendation
n Cisco made sure ISIS worked, as UUNET and Sprint
needed it to do so
17. Network Redundancy
n A single link of course means a single point of failure
– no redundancy
n PIPEX had two links from UK to US
n Cambridge to Washington
n London to New York
n On separate undersea cables
n Or so BT and C&W told us
n And therein is a long story about guarantees,
maintenance, undersea volcanoes, cable breaks, and
so on
18. Fifth Lesson
n Make sure that critical international fibre
paths:
n Are fully redundant
n Do not cross or touch anywhere end-to-end
n Go on the major cable systems the supplier claims
they go on
n Are restored after maintenance
n Have suitable geographical diversity (running in
the same duct is not diversity)
19. Aggregate origination
n Aggregate needs to be generated within ISP
backbone for reachability
n Leak subprefixes only for traffic engineering
n “Within backbone” does not mean overseas PoP or at the
peering edge of the network
n Remember those transatlantic cables
n Which were redundant, going to different cities, different
PoPs, diverse paths,…
n Having the Washington border routers originate our
aggregates wasn’t clever
20. Aggregate origination
n Both transatlantic cables failed
n Because one had been rerouted during maintenance – and
not put back
n So both our US circuits were on the same fibre – which
broke
n We didn’t know this – we thought the Atlantic ocean had
had a major event!
n Our backup worked – for outbound traffic
n But nothing came back – the best path as far as the US
Internet was concerned was via MAE-East and our UUNET
peering to our US border routers
n Only quick solution – switch the routers off, as
remote access wasn’t possible either
21. Sixth lesson
n Only originate aggregates in the core of
the network
n We did that, on most of the backbone core
routers, to be super safe
n But never on the border routers!!
22. How reliable is redundant?
n Telehouse London was mentioned earlier
n Following their very great reluctance to accept our PoP, and
the LINX, other ISPs started setting up PoPs in their facility
too
n After 2-3 years, Telehouse housed most of the UK’s ISP
industry
n The building was impressive:
n Fibre access at opposite corners
n Blast proof windows and a moat
n Several levels of access security
n 3 weeks of independent diesel power, as well as external
power from two different power station grids
23. How reliable is redundant?
n Technically perfect, but humans had to run it
n One day: Maintenance of the diesel generators
n Switch them out of the protect circuit (don’t want a power
cut to cause them to start when they were being serviced)
n Maintenance completed – they are switched back into the
protect circuit
n Only the operator switched off the external mains instead
n Didn’t realise the mistake until the UPSes had run out of power
n Switched external power back on – the resulting power surge
overloaded UPSes and power supplies of many network devices
n News headlines: UK Internet “switched off” by
maintenance error at Telehouse
24. How reliable is redundant?
n It didn’t affect us too badly:
n Once BT and Mercury/C&W infrastructure returned we got
our customer and external links back
n We were fortunate that our bigger routers had dual supplies,
one connected to UPS, the other to unprotected mains
n So even though the in-room UPS had failed, when the external
mains power came back, our routers came back – and survived
the power surge
n Other ISPs were not so lucky
n And we had to restrain our sales folks from being too smug
n But our MD did interview on television to point out the
merits of solid and redundant network design
25. Seventh lesson
n Never believe that a totally redundant
infrastructure is that
n Assume that each component in a network
will fail, no matter how perfect or reliable it
is claimed to be
n Two of everything!
26. Bandwidth hijack
n While we are talking about Telehouse
n And LINX…
n Early LINX membership rules were very restrictive
n Had to pay £10k membership fee
n Had to have own (proven) capacity to the US
n Was designed to keep smaller ISPs and resellers out of the
LINX – ahem!
n Rules eventually removed once the regulator started asking
questions – just as well!
n But ISPs still joined, many of them our former
resellers, as well as some startups
27. Bandwidth hijack
n We got a bit suspicious when one new ISP claimed
they had T3 capacity to the US a few days after we
had launched our brand new T3
n Cisco’s Netflow quickly became our friend
n Had just been deployed on our border routers at LINX and in
the US
n Playing with early beta software again on critical infrastructure J
n Stats showed outbound traffic from a customer of ours also
present at LINX (we didn’t peer with customers) was
transiting our network via LINX to the US
n Stats showed that traffic from an AS we didn’t peer with at
MAE-East was transiting our network to this customer
n What was going on??
28. Bandwidth hijack
n What happened?
n LINX border routers were carrying the full BGP table
n The small ISP had pointed default route to our LINX router
n They had another router in the US, at MAE-East, in their US
AS – and noticed that our MAE-East peering router also had
transit from UUNET
n So pointed a default route to us across MAE-East
n The simple fix?
n Remove the full BGP table and default routes from our LINX
peering routers
n Not announcing prefixes learned from peers to our border
routers
29. Eighth lesson
n Peering routers are for peering
n And should only carry the routes you wish peers
to see and be able to use
n Border routers are for transit
n And should only carry routes you wish your transit
providers to be able to use
30. The short sharp shock
n It may have only been 5 years from 1993 to 1997
n But the Internet adoption grew at a phenomenal rate
in those few years
n In the early 90s it was best effort, and end users
were still very attached to private leased lines, X.25,
etc
n By the late 90s the Internet had became big business
n Exponential growth in learning and experiences
n There were more than 8 lessons!
n (Of course, this was limited to North America and
Western Europe)
31. Moving onwards
n With UUNET’s global business assuming control of
and providing technical direction to all regional and
country subsidiaries, it was time to move on
n In 1998, next stop Cisco:
n The opportunity to “provide clue” internally on how ISPs
design, build and operate their networks
n Provide guidance on the key ingredients they need for their
infrastructure, and IOS software features
n All done within the company’s Consulting Engineering
function
n The role very quickly became one of infrastructure
development
32. Internet development
n Even though it was only over 5 years, I had
accumulated in-depth skillset in most aspects of ISP
design, set up, and operational best practices
n The 90s were the formative years of the Internet and the
technologies underlying it
n Best practices gained from experiences then form the basis
for what we have today
n Account teams and Cisco country operations very
quickly involved me in educating Cisco ISP
customers, new and current
n Working with a colleague, the Cisco ISP/IXP
Workshops were born
33. Internet development
n Workshops:
n Teaching IGP and BGP design and
best practices, as well as new features
n Covered ISP network design
n Introduced the IXP concept, and encouraged the formation
of IXes
n Introduced latest infrastructure security BCPs
n Early introduction to IPv6
n Out of the workshops grew
requests for infrastructure
development support from all
around the world
34. Development opportunities
n Bringing the Internet to Bhutan
n Joining AfNOG instructor team to teach BGP and
scalable network design
n Introducing IXPs to several countries around Asia
n Improving the design, operation and scalability of
service provider networks all over Asia, Africa, Middle
East and the Pacific
n Helping establishing network operations groups
(NOGs) – SANOG, PacNOG, MENOG etc
n Growing APRICOT as the Asia Pacific region’s premier
Internet Operations Summit
35. NOG Development
n Started getting more involved in helping with
gatherings of local and regional operations
community
n APRICOT was the first experience – difficulties of
APRICOT ‘98 and ‘99 led to a refresh of the
leadership in time for APRICOT 2001
n APRICOT growing from strength to strength – but
annual conference had 56 economies across
AsiaPac to visit!
n Regional and Local NOGs were the only way to
scale
36. NOG Development
n NZNOG and JANOG were starting
n SANOG launched in January 2003, hosted
alongside Nepalese IT event
n Several international “NOG experts” participated
n Purpose (from www.sanog.org):
n And this is a common theme for most NOGs founded
since
SANOG was started to bring together operators for educational as well as co-
operation. SANOG provides a regional forum to discuss operational issues and
technologies of interest to data operators in the South Asian Region.
37. Ingredients for a successful NOG
① Reach out to community and organise a
meeting of interested participants
② Reach out to colleagues in community and
further afield and ask them to come talk
about interesting operational things
③ Figure out seed funding and find a place to
meet
④ Commit to a 2nd NOG meeting
⑤ Have fun!
38. Ingredients for a successful NOG
n Avoid:
n Setting up lots of committees before the NOG
meets for the first time
n Worrying about what fees to charge or discounts
to provide
n Worrying about making a profit
n Hiring expensive venues, event organisers
n Providing expensive giveaways
n Providing speaking opportunities to product
marketeers
39. Ingredients for a successful NOG
n During that first meeting:
n Solicit suggestions about the next meeting
n Location, content, activities
n Suggest a mailing list
n And then set it up, encouraging participants to join
n Encourage organisations participating to consider
future sponsorship
n Encourage colleagues to help with various tasks
n Organise a meeting of the folks who helped pull
the first meeting together
n Here is the first committee, the Coordination Team
40. Ingredients for a successful NOG
n After the first meeting:
n Plan that 2nd meeting, relaxation is not allowed
n Don’t expect lots of people to rush and help
n NOG leadership is about being decisive and assertive
n And can often be lonely
n Organise the next meeting of the Coordination
Team (face to face, teleconference,…)
n Don’t lose momentum
n Keep the Coordination Team involved
41. Ingredients for a successful NOG
n Going forwards:
n Encourage discussion and Q&A on the mailing list
n No question is too silly
n Run the second meeting, plan the third
n But don’t try and do too many per year – one or two are
usually enough
n Don’t rely on the international community for everything
– encourage and prioritise local participation
n Start thinking about breaking even
n After the 2nd or 3rd meeting, assistance with
programme development – the next committee!
42. The final lesson?
n Setting up a NOG takes effort and persistence
n Bring the community along with you
n People attend, and return, if the experience is
positive and the content is worth coming for
n Include all sectors and regions the NOG claims to
cover
n Budget needs to be neutral, sponsorship
generous, participant costs low
n No bureaucracy!
43. The story goes on…
n IXP experiences
n Nepal, Bangladesh, Singapore, Vanuatu,
India, Pakistan, Uganda, PNG, Fiji, Samoa,
Thailand, Mongolia, Philippines,…
45. The story goes on…
n Satellites
n falling out of sky
n latency/tcp window vs performance
46. The story goes on…
n Fibre optics being stolen
n Folks thinking it is copper
47. The story goes on…
n The North Sea fogs and snow which
block microwave transmission
48. The story goes on…
n “You don’t understand, Philip”
n From ISPs, regulators, business leaders,
who think their environment is unique in
the world
49. The story goes on…
n “Ye cannae change the laws o’ physics!”
n To operators and end users who complain
about RTTs
§ Montgomery “Scotty” Scott: Star Trek