APNIC Training Delivery Manager Terry Sweetser presents an overview of Internet Exchange Points at PacNOG 31, held in Port Vila, Vanuatu from 26 to 30 June 2023.
APNIC Training Delivery Manager for SEA and SA, Shane Hermoso, presents on the importance of peering and IXPs at the Women in Networking series on 17 November 2021
Webinar topic: BGP Services IP Transit vs IP Peering
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing BGP Services IP Transit vs IP Peering
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/en/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
Recording available on Youtube
https://youtu.be/TYNHBSTxiOE
APNIC Training Delivery Manager for SEA and SA, Shane Hermoso, presents on the importance of peering and IXPs at the Women in Networking series on 17 November 2021
Webinar topic: BGP Services IP Transit vs IP Peering
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing BGP Services IP Transit vs IP Peering
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/en/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
Recording available on Youtube
https://youtu.be/TYNHBSTxiOE
This slide deck was used for a 2-day short course at IIT Gandhinagar in Spring 2015. Being a 2-day course, it focuses more on a qualitative description of how we access the Internet.
In this webinar, we cover how Border Gateway Protocol works. Starting from key concepts, you'll learn about Autonomous Systems, the BGP protocol, AS Path, learning and advertising routes, RIBs and route selection. See the webinar recording at https://www.thousandeyes.com/webinars/how-bgp-works
Presented by Mark Boxer & Jeff Bush of OFS
Agenda:
• Why Fiber?
• Fiber Feeds Everything
• Nuts and Bolts -The Components
• Installation Techniques
• Network Architectures and Planning
Best Network Performance Monitoring ToolJoe Shestak
Latest information about basic of Network Performance monitoring and best network monitoring tool with it's key features. I hope this information helps you to choose best network monitoring tools for your enterprise.
Border Gateway Protocol (BGP) is a standardized exterior gateway protocol designed to exchange routing and reachability information among autonomous systems (AS) on the Internet.
NSO: Network Service Orchestrator enabled by Tail-f Hands-on LabCisco Canada
The Network Service Orchestrator (NSO) is a multi-vendor network orchestrator developed by Tail-f, a recent Cisco acquisition in the area of network management and orchestration. This 4hs session will give an introduction to the NCS system and show hands-on the tool and its different interfaces: network-wide CLI, REST API, etc. Participants will also create one basic network services models using the YANG language.
MPLS VPN is a family of methods for using multiprotocol label switching (MPLS) to create virtual private networks (VPNs). MPLS VPN is a flexible method to transport and route several types of network traffic using an MPLS backbone.
In this webinar, we discuss a feature from mikrotik routerOS that is called fastpath. This feature will improve routerboard performance by increasing number of packet per second and lowering CPU usage. Fastpath requires several conditions to be active, and the webinar is talking about them.
the recording is available on youtube (GLC Networks Channel): https://www.youtube.com/channel/UCI611_IIkQC0rsLWIFIx_yg
PacNOG 25: Keeping local traffic local by doing local peering APNIC
APNIC Infrastructure and Development Director Che-Hoo Cheng presented on 'Keeping Local Traffic Local by Doing Local Peering'. about the concepts of peering, the benefits of peering, and the roles of Internet exchange Points (IXPs) to facilitate easier local peering. Che-Hoo also shared his experience in operating an IXP.
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...APNIC
Che-Hoo Cheng, Senior Director, Development at APNIC presents on the "Benefits of doing Internet peering and running an Internet Exchange (IX)" at the Communications Regulatory Commission of Mongolia's IPv6, IXP, Datacenter - Policy and Regulation International Trends Forum in Ulaanbaatar, Mongolia on 7 March 2024
This slide deck was used for a 2-day short course at IIT Gandhinagar in Spring 2015. Being a 2-day course, it focuses more on a qualitative description of how we access the Internet.
In this webinar, we cover how Border Gateway Protocol works. Starting from key concepts, you'll learn about Autonomous Systems, the BGP protocol, AS Path, learning and advertising routes, RIBs and route selection. See the webinar recording at https://www.thousandeyes.com/webinars/how-bgp-works
Presented by Mark Boxer & Jeff Bush of OFS
Agenda:
• Why Fiber?
• Fiber Feeds Everything
• Nuts and Bolts -The Components
• Installation Techniques
• Network Architectures and Planning
Best Network Performance Monitoring ToolJoe Shestak
Latest information about basic of Network Performance monitoring and best network monitoring tool with it's key features. I hope this information helps you to choose best network monitoring tools for your enterprise.
Border Gateway Protocol (BGP) is a standardized exterior gateway protocol designed to exchange routing and reachability information among autonomous systems (AS) on the Internet.
NSO: Network Service Orchestrator enabled by Tail-f Hands-on LabCisco Canada
The Network Service Orchestrator (NSO) is a multi-vendor network orchestrator developed by Tail-f, a recent Cisco acquisition in the area of network management and orchestration. This 4hs session will give an introduction to the NCS system and show hands-on the tool and its different interfaces: network-wide CLI, REST API, etc. Participants will also create one basic network services models using the YANG language.
MPLS VPN is a family of methods for using multiprotocol label switching (MPLS) to create virtual private networks (VPNs). MPLS VPN is a flexible method to transport and route several types of network traffic using an MPLS backbone.
In this webinar, we discuss a feature from mikrotik routerOS that is called fastpath. This feature will improve routerboard performance by increasing number of packet per second and lowering CPU usage. Fastpath requires several conditions to be active, and the webinar is talking about them.
the recording is available on youtube (GLC Networks Channel): https://www.youtube.com/channel/UCI611_IIkQC0rsLWIFIx_yg
PacNOG 25: Keeping local traffic local by doing local peering APNIC
APNIC Infrastructure and Development Director Che-Hoo Cheng presented on 'Keeping Local Traffic Local by Doing Local Peering'. about the concepts of peering, the benefits of peering, and the roles of Internet exchange Points (IXPs) to facilitate easier local peering. Che-Hoo also shared his experience in operating an IXP.
Benefits of doing Internet peering and running an Internet Exchange (IX) pres...APNIC
Che-Hoo Cheng, Senior Director, Development at APNIC presents on the "Benefits of doing Internet peering and running an Internet Exchange (IX)" at the Communications Regulatory Commission of Mongolia's IPv6, IXP, Datacenter - Policy and Regulation International Trends Forum in Ulaanbaatar, Mongolia on 7 March 2024
What is the internet, really? It is a network of networks which are all interconnected to various degrees. Where they interconnect is typically at an internet exchange (IX) or internet exchange point (IXP). IX are important because they make the internet (and especially their user's networks) more resilient (robust and fault tolerant), more performant (higher bandwidth & lower latency), and quite often more cost effective. It's not difficult to connect to an IX but you do need to know the basic requirements, process, and best practices. You can also use a new open-source automation platform, called PeerCtl, to make connecting over an IX even easier.
These slides are from a talk I gave on 4 May 2023 in Albuquerque, NM, USA.
The talk covers:
* What is the Internet, really?
* What is an Internet Exchange (IX)?
* Why are IX’ (and interconnection) important?
* How-To Start Interconnecting
Network Convergence of Mobile, Broadband and Wi-Fi3G4G
A presentation and video by Ben Toner, Founder & Director, Numerous Networks exploring the convergence of Mobile, Broadband and Wi-Fi
*** SHARED WITH PERMISSION ***
All our #3G4G5G slides and videos are available at:
Videos: https://www.youtube.com/3G4G5G
Slides: https://www.slideshare.net/3G4GLtd
5G Page: https://www.3g4g.co.uk/5G/
Free Training Videos: https://www.3g4g.co.uk/Training/
SGNOG 6: The stories of IXP development and the way forward APNIC
Infrastructure and Development Director, Che-Hoo Cheng gives and overview of IXP development and the way forward at SGNOG 6 in Singapore on 20 July 2018.
PCTA IX Summit 2018: The stories of IXP development and the way forward APNIC
Che-Hoo Cheng gives an overview of the benefits of IXPs, case studies of successful IXPs and what to consider going forward at the PCTA IX Summit 2018 in Manila, Philippines on 29 October 2018.
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC
Ellisha Heppner, Grant Management Lead, presented an update on APNIC Foundation to the PNG DNS Forum held from 6 to 10 May, 2024 in Port Moresby, Papua New Guinea.
Registry Data Accuracy Improvements, presented by Chimi Dorji at SANOG 41 / I...APNIC
Chimi Dorji, Internet Resource Analyst at APNIC, presented on Registry Data Accuracy Improvements at SANOG 41 jointly held with INNOG 7 in Mumbai, India from 25 to 30 April 2024.
APNIC Policy Roundup, presented by Sunny Chendi at the 5th ICANN APAC-TWNIC E...APNIC
Sunny Chendi, Senior Advisor, Membership and Policy at APNIC, presents 'APNIC Policy Roundup' at the 5th ICANN APAC-TWNIC Engagement Forum and 41st TWNIC OPM in Taipei, Taiwan from 23 to 24 April.
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024APNIC
Dave Phelan, Senior Network Analyst/Technical Trainer at APNIC, presents 'DDoS In Oceania and the Pacific' at NZNOG 2024 held in Nelson, New Zealand from 8 to 12 April 2024.
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...APNIC
Geoff Huston, Chief Scientist at APNIC deliver keynote presentation on the 'Future Evolution of the Internet' at the Everything Open 2024 conference in Gladstone, Australia from 16 to 18 April 2024.
IP addressing and IPv6, presented by Paul Wilson at IETF 119APNIC
Paul Wilson, Director General of APNIC delivers a presentation on IP addressing and IPv6 to the Policymakers Program during IETF 119 in Brisbane Australia from 16 to 22 March 2024.
draft-harrison-sidrops-manifest-number-01, presented at IETF 119APNIC
Tom Harrison, Product and Delivery Manager at APNIC presents at the Registration Protocols Extensions working group during IETF 119 in Brisbane, Australia from 16-22 March 2024
APNIC Update and RIR Policies for ccTLDs, presented at APTLD 85APNIC
APNIC Senior Advisor, Membership and Policy, Sunny Chendi presented on APNIC updates and RIR Policies for ccTLDs at APTLD 85 in Goa, India from 19-22 February 2024.
Lao Digital Week 2024: It's time to deploy IPv6APNIC
APNIC Development Director Che-Hoo Cheng presents on the importance of deploying IPv6 at the Lao Digital Week 2024, held in Vientiane, Lao PDR from 10 to 14 January 2024.
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesSanjeev Rampal
Talk presented at Kubernetes Community Day, New York, May 2024.
Technical summary of Multi-Cluster Kubernetes Networking architectures with focus on 4 key topics.
1) Key patterns for Multi-cluster architectures
2) Architectural comparison of several OSS/ CNCF projects to address these patterns
3) Evolution trends for the APIs of these projects
4) Some design recommendations & guidelines for adopting/ deploying these solutions.
# Internet Security: Safeguarding Your Digital World
In the contemporary digital age, the internet is a cornerstone of our daily lives. It connects us to vast amounts of information, provides platforms for communication, enables commerce, and offers endless entertainment. However, with these conveniences come significant security challenges. Internet security is essential to protect our digital identities, sensitive data, and overall online experience. This comprehensive guide explores the multifaceted world of internet security, providing insights into its importance, common threats, and effective strategies to safeguard your digital world.
## Understanding Internet Security
Internet security encompasses the measures and protocols used to protect information, devices, and networks from unauthorized access, attacks, and damage. It involves a wide range of practices designed to safeguard data confidentiality, integrity, and availability. Effective internet security is crucial for individuals, businesses, and governments alike, as cyber threats continue to evolve in complexity and scale.
### Key Components of Internet Security
1. **Confidentiality**: Ensuring that information is accessible only to those authorized to access it.
2. **Integrity**: Protecting information from being altered or tampered with by unauthorized parties.
3. **Availability**: Ensuring that authorized users have reliable access to information and resources when needed.
## Common Internet Security Threats
Cyber threats are numerous and constantly evolving. Understanding these threats is the first step in protecting against them. Some of the most common internet security threats include:
### Malware
Malware, or malicious software, is designed to harm, exploit, or otherwise compromise a device, network, or service. Common types of malware include:
- **Viruses**: Programs that attach themselves to legitimate software and replicate, spreading to other programs and files.
- **Worms**: Standalone malware that replicates itself to spread to other computers.
- **Trojan Horses**: Malicious software disguised as legitimate software.
- **Ransomware**: Malware that encrypts a user's files and demands a ransom for the decryption key.
- **Spyware**: Software that secretly monitors and collects user information.
### Phishing
Phishing is a social engineering attack that aims to steal sensitive information such as usernames, passwords, and credit card details. Attackers often masquerade as trusted entities in email or other communication channels, tricking victims into providing their information.
### Man-in-the-Middle (MitM) Attacks
MitM attacks occur when an attacker intercepts and potentially alters communication between two parties without their knowledge. This can lead to the unauthorized acquisition of sensitive information.
### Denial-of-Service (DoS) and Distributed Denial-of-Service (DDoS) Attacks
1.Wireless Communication System_Wireless communication is a broad term that i...JeyaPerumal1
Wireless communication involves the transmission of information over a distance without the help of wires, cables or any other forms of electrical conductors.
Wireless communication is a broad term that incorporates all procedures and forms of connecting and communicating between two or more devices using a wireless signal through wireless communication technologies and devices.
Features of Wireless Communication
The evolution of wireless technology has brought many advancements with its effective features.
The transmitted distance can be anywhere between a few meters (for example, a television's remote control) and thousands of kilometers (for example, radio communication).
Wireless communication can be used for cellular telephony, wireless access to the internet, wireless home networking, and so on.
This 7-second Brain Wave Ritual Attracts Money To You.!nirahealhty
Discover the power of a simple 7-second brain wave ritual that can attract wealth and abundance into your life. By tapping into specific brain frequencies, this technique helps you manifest financial success effortlessly. Ready to transform your financial future? Try this powerful ritual and start attracting money today!
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBrad Spiegel Macon GA
Brad Spiegel Macon GA’s journey exemplifies the profound impact that one individual can have on their community. Through his unwavering dedication to digital inclusion, he’s not only bridging the gap in Macon but also setting an example for others to follow.
test test test test testtest test testtest test testtest test testtest test ...
PacNOG 31: Internet Exchange Points
1. 1
1 v1.0
Internet Exchange Points
APNIC
2023-05-30
Pacific Islands Telecommunications Association
Annual General Meeting
Primary Author: Che-Hoo Cheng, APNIC Director of Infrastructure & Development
2. 2 v1.0
2
Agenda
Objectives of Transit and Peering and Benefits of IXP
IXP Network Design and Operations
Operation/Business/Governance Models for IXPs
IXP Development Work of APNIC
3. 3
Terry Sweetser
(2023-1989)=34 years of industry
experience.
At times: APNIC Community Trainer, CTO,
Consultant, Founder, Engineer, Coach,
Mentor, Geek, Nerd, etc
APNIC Training Delivery Manager for
South Asia and Oceania
Nationality: Australian
Languages: English
Quals: BEng MBA MIEAust
about.me/terry.sweetser
4. 4 v1.0
4
Disclaimer
There is no “One
Size Fits All”
There are many
different
“recipes” for
running an IXP
Just to provide hints, not
answers
Cannot cover all scenarios here
because of limited time
6. 6 v1.0
6
How Does
Internet
Operate?
Internet is a network of
networks, composed of
networks of service
providers (ISPs) and
users
User networks connect
to ISPs
Small ISPs connect to
larger ISPs
Various networks (large
or small) are
interconnected with
one another to form
The Internet
7. 7 v1.0
7
Autonomous Systems
• A network on Internet is called Autonomous System (AS) which is
represented by AS Number (ASN)
o ASN is unique around the world
▸ APNIC is in charge of ASN assignment for APAC region (56 economies)
o Used together with BGP (Border Gateway Protocol) for interconnections with
multiple networks (or multi-homing)
o Networks having ASNs can be more independent, or portable
▸ Together with portable IP addresses
▸ Like what APNIC members are enjoying…
8. 8 v1.0
8
Transit Provider /
Internet Gateway
(Upstream)
Global Internet
Downstream
Customer
Customer
routes only
Routes of
the whole world
All customer routes
Ordinary Transit Model – Internet Gateway
9. 9 v1.0
9
Transit in
General
Networks need to pay transit
providers to get to the whole
Internet
Can connect to multiple
transit providers for
resilience and portability
A few very large ISPs act as transit
providers for the whole world (the
so-called tier-1 networks) which do
not need to pay others to get full
Internet connectivity
Other ISPs must be transit
customers of those tier-1
networks directly or
indirectly in order to gain
full connectivity
Networks on Internet are trying to
bypass transit providers as much as
possible
By doing direct peering with
various networks for lower
cost and higher
performance
10. 10 v1.0
10
Transit Provider A
(Upstream)
Transit Provider B
(Upstream)
Downstream
Customer
Downstream
Customer
Downstream
Customer
Downstream
Customer
Routes of A and
its customers
Routes of B and
its customers
Ordinary Peering Model
11. 11 v1.0
11
Peering in General
• AS’s are interconnected/peered at Internet exchanges points (IXPs) or privately
• Interconnection/peering is among ISPs / data centres / content providers / content distribution
network (CDN) providers / cloud services providers which have different ASNs using BGP protocol
• For higher performance, lower latency and lower cost
• Usually no settlement between peers and cost is shared
For mutual benefits
• Local-to-local traffic do NOT need to route through overseas
• Important to local Internet development
Local Peering
• BLPA (Bi-Lateral Peering Agreement)
Between 2 ASes
• MLPA (Multi-Lateral Peering Agreement)
Among > 2 ASes
12. 12 v1.0
12
Private Peering
• A form of BLPA having dedicated point-to-point connection between 2 ASes
• Using cross-connect or local loop or IPL to interconnect
o Cost is usually shared between 2 peers
• May have multiple connections between 2 ASes for resiliency
• Not quite cost-effective
o Spare bandwidth cannot be used for other traffic
o Unless the traffic volume is really high
• Not very scalable
o nC2 physical connections for n ASes to peer fully with one another
14. 14 v1.0
14
Total Number of Circuits for Full Interconnections
• 3 networks: 3C2 = 3; plus 2 router ports per network
• 4 networks: 4C2 = 6; plus 3 router ports per network
• 5 networks: 5C2 = 10; plus 4 router ports per network
• 6 networks: 6C2 = 15; plus 5 router ports per network
• 7 networks: 7C2 = 21; plus 6 router ports per network
• 8 networks: 8C2 = 28; plus 7 router ports per network
• 9 networks: 9C2 = 36; plus 8 router ports per network
• 10 networks: 10C2 = 45; plus 9 router ports per network
15. 15 v1.0
15
What is an Internet eXchange Point (IXP)?
• An IXP is a shared physical network infrastructure over which various Autonomous
Systems can do easy peering with one another
One physical connection to IXP can be used for interconnections with multiple
networks
More cost-effective and scalable, especially with more participants
ASes to be served by IXP include Internet Gateways, Internet Service Providers
(ISPs), Research & Education (R&E) Networks, Cloud Service Providers, Content
Providers and Content Delivery Network (CDN) Providers
16. 16 v1.0
16
Simplest IXP Topology
IXP Switch
Border Router
of ISP A
Border Router
of ISP B
Border Router
of ISP D
Border Router
of ISP C
17. 17 v1.0
17
IXP Topology with Minimal Switch/Site Resilience
IXP Switch x 2
(at same location or different locations)
Border Router
of ISP A
Border Router
of ISP B
Border Router
of ISP D
Border Router
of ISP C
18. 18 v1.0
18
Total Number of Circuits for IXP Connections
• 3 networks: 3 or 6* (vs 3); plus 1 or 2* router ports per network (vs 2)
• 4 networks: 4 or 8* (vs 6); plus 1 or 2* router ports per network (vs 3)
• 5 networks: 5 or 10* (vs 10); plus 1 or 2* router ports per network (vs 4)
• 6 networks: 6 or 12* (vs 15); plus 1 or 2* router ports per network (vs 5)
• 7 networks: 7 or 14* (vs 21); plus 1 or 2* router ports per network (vs 6)
• 8 networks: 8 or 16* (vs 28); plus 1 or 2* router ports per network (vs 7)
• 9 networks: 9 or 18* (vs 36); plus 1 or 2* router ports per network (vs 8)
• 10 networks: 10 or 20* (vs 45); plus 1 or 2* router ports per network (vs 9)
* 2 circuits and router ports per network for resilience
19. 19 v1.0
19
Main Benefits of IXP
• One main objective of an IXP is to keep local traffic local
o Important to local Internet development
• Helps bypass 3rd-party network infrastructure for easy interconnection and direct traffic exchange
among participating networks
o Reduced cost – cheaper connectivity, often low fixed cost
o Enhanced network performance – faster speed, larger capacities
o Reduced latency – lower delay, switching at less than a millisecond
• Helps encourage development of more local content and local applications
o Helps local data centre business and other businesses
• Everybody benefits
o The gain for each may be different but all will gain
o In the end, the most important outcome is customer/user experience improves
• Often considered as Critical Internet Infrastructure locally, regionally or globally
20. 20 v1.0
20
Pacific Islands
• Far from any other places
• External connectivity is very expensive
o More submarine cables are being built for them
• Small markets because of small population
• Usually just a few ISPs but they may not be interconnected locally
• Local traffic across ISPs usually routed through US or Australia
• Local IXP is very much needed for helping Internet development
• Observed immediate benefits on Day 1 of set-up of Fiji-IXP
o Much improved latency and high volume of traffic
• Small land-locked economies have more or less similar issues
21. 21
Before Fiji-IXP was
set up
• A Fijian ISP in Suva accessing
content at the University of the
South Pacific in Suva
• Packet travels > 25,000km
• Physical distance < 10km
• Adding long latency
• Possibly high jitter too
• Using expensive submarine
capacity
• Return path had similar issue
22. 22 v1.0
22
Value and Attractiveness of an IXP
• Proportional to the number of different networks (ASNs) connected and the
amount of traffic volume
• Snowball effect after reaching critical mass
o The initial period usually is the hardest
▸ Most will take wait-and-see approach
o Gradually will have good mix of networks of different types
▸ E.g. Eyeballs vs Content
▸ Business and Consumer
▸ Fixed and Mobile
24. 24 v1.0
24
Simplest IXP Topology
IXP Switch
Border Router
of ISP A
Border Router
of ISP B
Border Router
of ISP D
Border Router
of ISP C
25. 25 v1.0
25
IXPs are Layer-2 Networks
• Switched Ethernet
o One physical connection for interconnections with multiple networks
o Only routers are allowed to connect to the switching fabric directly
• IXP participants can do direct Bilateral Peering (BLPA) over the layer 2
infrastructure anytime
• With Route Server added to the layer 2 infrastructure, IXP participants can also do
Multilateral Peering (MLPA) for easier interconnections among everybody
o Traffic exchange is direct and not going through the route server
• Those called themselves “IX” but serving layer-3 services are considered as
transit providers
o Note that IXPs, transit providers and data centres are not the same things
26. 26 v1.0
26
Evolution
IXP development is an evolutionary process done step by step
It can be improved over time, but picking the right initial neutral organisation
& governance model and a neutral site at the start is important for future
success
Some Local IXPs can evolve into Regional IXPs
27. 27 v1.0
27
Possible Steps for IXP Development
• Can be gradual, step by step (some steps can be skipped or be done at the same time)
• Layer-2 network is the bare minimal
o Can use private IP addresses if small amount of participants
• Public IP addresses next
o Legal entity issue
• Site resilience is IMPORTANT while equipment resilience is also included
o Has to have site resilience sooner or later
• Route server(s) with ASN follows
o RPKI/ROV consideration
• Other value added services
o DNS: Root / TLDs / Recursive
o Shared CDN Caches (Transit for Cache Fill)
28. 28 v1.0
28
IP/ASN Resources for an IXP
Considered as Critical
Infrastructure under APNIC Policy
• Using public IP addresses and
ASN is recommended
• IPv4: /24
• IPv6: /48
• ASN: 1 (for route server to
facilitate multilateral peering)
But IXP may need another
network to provide transit
• Own servers such as network
management & monitoring
• DNS anycast servers:
Authoritative or
Cache/Resolving/Recursive
• Shared CDN Caches for
Participants (Capacity)
• Small network
29. 29 v1.0
29
IXP Topology with Minimal Switch/Site Resilience
IXP Switch x 2
(at same location or different locations)
Border Router
of ISP A
Border Router
of ISP B
Border Router
of ISP D
Border Router
of ISP C
30. 30 v1.0
30
Adding Route Server for Multilateral Peering
Routes
Redistribute
Routes to All
RS
31. 31 v1.0
31
Route Origin Validation (ROV) at IXP
– via Route Server for Improved Routing Security
Validated
cache
Validator
RPKI-to-Router (RTR)
Routes
Tagged/Filtered
Routes
RS
32. 32 v1.0
32
Scalability and
Resilience Issues
IXPs were supposed to
have no packet loss in
its infrastructure
And with very low
latency and very good
resilience too
Become an issue when
IXP grow beyond one
switch
Due to not enough
ports or expanding to
multiple sites
Inter-switch links are
the risk
Over-subscription has
to be minimised
Also need to minimise single point of failure
34. 34 v1.0
34
Port Security Is Important
Minimum protection to the layer-2
broadcast domain
Most IXPs allow just one MAC
address per port (physical or
virtual)
Strictly one IPv4 address, one IPv6
address and one MAC address per
port (physical or virtual)
“Violation Restrict” instead of
“Violation Shutdown”
A few IXPs allow more MAC
address per port but still a small
number
Must also do Ether-type filtering
and broadcast/multicast traffic
filtering/rate-limiting
35. 35 v1.0
35
Vulnerabilities of IXPs
• Why can’t all router vendors have Proxy ARP disabled as default?
• Cannot stop it totally because of possible human errors
• Can only do regular monitoring by checking the ARP table
• EVPN over VxLAN technology may help but it is not a simple technology
Proxy ARP
• May happen when there is asymmetric routing seen from an IXP
• Can be mitigated by sending proactive ARP check to all active addresses every hour or so
• EVPN over VxLAN technology may help but it is not a simple technology
Unknown Unicast Flooding
• Can cause trouble to multiple connections when there is big congestion on one port
o Unknown to innocent participants which do not have any congestion
• Just be careful when choosing switch models
o Also avoid switch models with small buffer
Shared Buffer over Multiple Switch Ports
37. 38 v1.0
38
Government-led vs Industry-led
Subsidized vs Self-financed
Developed economies vs Developing economies
Commercial vs Non-profit
IXP Models
• No one single model which can suit all situations
• Neutrality is very important, but not always achieved
38. 39 v1.0
39
Commercial vs Non-Profit
Commercial set-up is free to do anything
No need to care about neutrality too much
IXP may be a service to help other business
Non-profit set-up tends to be more
cautious
Neutrality is more important, at least to the target
participants
Tend to be more independent from individual
participants
Tend to offer fewer services
39. 40 v1.0
40
Developed Economies
• Even for not-for-profit set-up
• Less government involvement
IXPs are business
• Keen competition
Multiple IXPs
• Government? Industry group?
Customer pressure?
But if they cannot keep
intra-economy traffic local,
someone needs to step up
40. 41 v1.0
41
IXPs and Data Centres in Developed Economies
• They are natural partners
• Common situation in advanced metro cities
o Multiple IXPs in one Data Centre
▸ A lot of data centres have their IXPs
o One IXP in multiple Data Centres
▸ The same layer-2 broadcast domain
▸ Circuit cost is a burden to the IXP
▸ A lot of telco’s have their IXPs
o Healthy competition would be good
▸ Customers have choices
▸ Also for better resilience
41. 42 v1.0
42
Developing Economies
• Some do not have any IXPs yet
• Local traffic does not stay local
o A lose-lose situation for everybody
• IXPs can help Internet development a lot
o Better to be non-for-profit set-up
o May need to start with subsidized model
o May not be a business at all
o Help from government is mostly needed
o Active participation of the biggest players is also very important
42. 43 v1.0
43
Governance for Non-Profit IXPs
• Multi-stakeholder bottom-up approach is an approach with good
acceptance by the community
o E.g. membership-based model
• Government support is also important
o At the very least, should get the proper license
• Be as inclusive as possible in order to provide maximum benefits to the
whole community which it serves
• Should be fair and consistent to every participant or member
• Should be open and transparent as much as possible
43. 44 v1.0
44
Membership-Based Model
• Networks connected can join as members
o Open membership vs closed membership
o Mandatory membership vs optional membership
• Full Members with voting rights vs Associate Members without voting rights
o Licensed ISPs vs others
o Local legal entities vs overseas legal entities
• Governance by the Board elected
o Policy decisions
o Financial responsibilities
• Government’s role
o A facilitator at the very least
44. 45 v1.0
45
Neutral Locations
• May choose one of the followings as starting point:
o University
o Landing Station
o Technology Park
o Carrier Neutral Commercial Data Center
o Government Data Center
• Having multiple carrier options with easy access is important
• Should maintain neutrality continuously
• Expansion to multiple sites within the same metro area can be done on Day 1 or
be done gradually coupled with growth
o This also helps improve neutrality as more options are provided
45. 46 v1.0
46
Geography
• IXP usually is NOT expanded beyond a metro area so as to avoid
competing with IXP participants and to maintain neutrality
o And simple port charging model can be used
• Usually start with the biggest city first and gradually set up separate
infrastructure in other bigger cities one by one
46. 47 v1.0
47
To Add Value
• Domain Name Infrastructure: DNS infrastructure is very important to Internet
operations so Root/TLD DNS server instance(s) should be connected directly to
IXP for direct peering in order to benefit all participants for better DNS
performance and resilience
• Shared CDN Caches: Connecting cache servers of popular content to the IXP will
help everyone save bandwidth, but the cost of the transit bandwidth needed for
cache-fill has to be properly shared by the ISPs benefited
o Different CDN providers have different supported models
o Need to think about long-term sustainability
• NOTE: Transit for the above should NOT be used for providing usual transit
service to IXP participants so as to maintain neutrality
47. 48 v1.0
48
Financial Model for Non-Profit IXPs
• Seed money?
o Perhaps from subsidies and/or sponsorship/donation
• IXPs need money to operate continuously
o Need to have a long-term sustainable finance model for full cost recovery of CapEx and OpEx
▸ All cost should be covered
o Should not forget about the limited lifetime of the equipment used so must save money for
future major equipment upgrade say once every 5 years
▸ By setting up a reserve fund
• Subsidies, sponsorship or volunteers support may not be stable
• Those networks which are benefited should all contribute in a fair way
o A charging model should be devised to help achieve that
• A good financial model will help sustain the IXP operations in long term
48. 49 v1.0
49
Charging Model
• Simple port charging model is the most common model in the industry
o Monthly Recurrent Charge (MRC) provides stable income
o 100GE port MRC / 10GE port MRC = 3 to 6
o 10GE port MRC / GE port MRC = 1 to 4
o Volume discount may be applied to encourage more connections for various purposes
▸ With or without Link Aggregation
▸ For better resilience and/or more bandwidth buffer (headroom)
o NRC (Non-Recurrent Charge) charged with no contract or no NRC for a fixed-term contract
• Charge by usage for shared CDN cache service
o Accurate usage accounting by trusted party is crucial
49. 51 v1.0
51
Which Models Can Sustain?
• IXP alone cannot make big money
• IXP may just be a value-added service
• Little issue if it is with good financial model
Pure Business Model
• Funding may or may not be long-term
• Little issue if funding is long-term
Subsidized Model
• May be risky as sponsorship or support of volunteers
is not guaranteed unless it is small enough and
without growth
Model relying on
sponsorship and/or
volunteers
• Most neutral
• Proper governance is important
• Need to have good financial model for long-term
sustainability
Membership-based
Model
50. 52 v1.0
52
Politics Involved in Early IXP Development
• Usually larger ISPs like IXP less than smaller ISPs
o Smaller ISPs are target customers of larger ISPs so larger ISPs have fear of losing market share
o Dominant ISPs having >60% of market share think they are the IXPs
• Larger ISPs refuse to connect to IXP making the value of IXP lower
o But IXPs do help provide a level-playing field for smaller ISPs
• There are multiple possible mitigation options for that but in any case, larger ISPs need to
collaborate
o E.g. separating access networks from Internet gateway / transit network
• If hurting the goal of “Keeping Local Traffic Local”, then it is lose-lose to everybody
• Government involvement may help or may hurt the case
o It depends on the relationship between the industry and the government
o Forcing large ISPs to do peering may not achieve the expected outcomes
• Having an IXP is NOT a magic wand to solve all the issues but collaborative spirit is J
51. 54 v1.0
54
Independent Legal Entity for IXP?
• Not critical but highly desirable
• Allow for demonstration of independence and/or neutrality
o Such as jointly owned by members
o Or a separate company from the mother company
• Possible use of the legal entity
o License
o Agreements with participants / members
▸ Bank accounts for collecting incomes and spending
o APNIC membership
▸ Do allow transitional arrangement
52. 56 v1.0
56
Government Funding for IXPs?
• More needed during infancy stage of IXP development
o Government usually can only provide one-off funding support
• For long-term, IXPs need to have a long-term sustainable financial model
o Better be together with bottom-up industry-led governance for IXP
o Align with bottom-up multi-stakeholder approach
53. 57 v1.0
57
IXP Serving Licensed ISPs Only?
• Can be a starting point for non-profit local IXP if so desired
• But sooner or later, the IXP should be opened up for all kinds of networks
including CDN networks, authoritative DNS servers, large enterprise
networks (e.g. government departments, universities, banks and hospitals)
and overseas networks so as to further enhance the importance and the
status of the IXP
o Can drive down the pricing of Internet connectivity further
• With proper environment, the local IXP may become an regional IXP
54. 59 v1.0
59
Only a Few International Gateway Licensees?
• International Gateways may just do private peering with full mesh among
themselves for keeping local traffic local
o But this may not help lower the cost of local traffic as local traffic is mixed with
international traffic
• To improve the situation, a local IXP can be set up just for local traffic
o To separate local traffic from international traffic
o Access networks and other networks can all connect to it for exchanging local traffic
o But access networks should be separated from international gateways under the
same groups with different ASNs in order to take full advantage of this set-up
55. 60 v1.0
60
Possible Scenario for Improving Local Peering
IGW IGW
IGW
Global Internet
Access
Network
Access
Network
Access
Network
Access
Network
Other
Network
Other
Network
Other
Network
Other
Network
IXP
Border
IPL
IPL
IPL
Private
Peering
Private
Peering
Private
Peering
56. 61 v1.0
61
IXP across Multiple Cities / Economies?
• Affect neutrality?
o Generally considered as competing with participants which provide services across
the same set of locations
• Bad for non-profit IXPs targeting all kinds of networks or providers?
o Those that see competition may not join and then it may affect the goal of “keeping
local traffic local”
o Commercial IXPs can take this business risk especially if this may help their other
business
57. 64 v1.0
64
Shared CDN Caches Offered by IXP?
• More and more local IXPs in developing economies want to provide shared
caches for their participants to increase their value
o Cost recovery and cost sharing / accounting are major issues to them though
o Can do charging by usage which should be fairer
• CDN providers are starting to accept such model
o They still mostly look at cache efficiency (cache hit ratio) and traffic volume for
justifications
• It should be good to consider it
o At smaller developing economies
o Especially for gathering small ISPs together to meet the requirements of CDN
providers
59. 69 v1.0
69
IXP Development Work of APNIC
• APNIC strongly believes IXPs help Internet development
o After all, IXPs serve and benefit APNIC members
o In fact, IXPs need IP addresses and ASNs and so are APNIC members themselves
• Do more on helping those developing economies
o Especially those which do not have any IXP yet
o Or those which their only IXP is not functioning well
• Training and Technical Assistance work primarily
o Not just for IXP operators but also for IXP participants
o Also help talk to major stakeholders to convince them of the benefits of having a local IXP while
maintaining neutrality
o May need help of Community Trainers and Consultants from time to time
• Having been supporting IXP development in Fiji, PNG, Vanuatu, Mongolia, Bhutan,
Myanmar, Pakistan, India and others
60. 70 v1.0
70
IXP Development Package of APNIC
• Training & Technical Assistance primarily
o Technical & non-technical
• Other possible support items (on case-by-case basis according to individual needs):
o Ethernet switch
o Route Server
o ROV & IPv6 deployment support
o IXP Manager
o Root Server anycast instance
o RIPE Atlas Anchor
• Collaboration with APIX & ISOC along with APNIC Foundation
o MOU signed: https://www.apnic.net/wp-content/uploads/2022/03/Memorandum-of-Understanding-
IXP-Support-APIX-ISOC-APNIC-APNIC-Foundation-FINAL-SIGNED.pdf
• APIX & MANRS Memberships are recommended to all IXPs
61. 71 v1.0
71
Other Help & Support by APNIC
• APIX
• Peering Asia
• Peering Forums
hosted by not-
for-profit IXPs
• NOGs (which
IXPs usually
support)
APNIC also
provides
help &
support to:
• PeeringDB
• IXP-DB
• IXP Manager
APNIC
Foundation
sponsors:
63. 73 v1.0
73
Final Remarks
• IXPs will continue to play a key role for easier interconnections among
networks
o Especially for developing economies
o But IXP is NOT a magic wand to solve all the issues
▸ Collaborative spirit is
• Need to find a suitable model for long-term sustainability
• Relative neutrality is important
o So have to maintain it as much as possible
• After all, “Keeping Local Traffic Local” is the most important thing for the
whole country/economy