SlideShare a Scribd company logo
1 of 27
Tracking Bulgarian Internet evolution 
from 
2001 till now 
Nikolay Milovanov 
Vasil Yordanov 
https://github.com/iTransformers
Network evolution in nutshell 
• Network evolution could be expressed as: 
– Topology changes: 
• Appearance, disappearance of nodes or links 
• Changes in network diameter 
• Changes in node ranks 
• Changes in clustarization and giant components 
– Changes in node/edge properties 
• Appearance of new metadata 
• Disappearance of such 
• Changes in node/edge metadata values 
– All the above reflects changes in the law as per which network 
evolves : 
• An example of such law is Barbatsi and Albert law – e.g human 
networks evolve as per power law
Examples for evolving networks 
• Internet 
• WWW 
• Social 
• Bio 
• Communication 
• Networks of SA components and connectors 
• Knowing the law will allow us to predict how 
does the network will evolve
So a question emerge: How can we track how does 
the network evolves? 
– Globul OMC used a notepad to write down each 
and every event that happens in the network 
– Traffic/Performance monitoring systems might 
give us such information but in really it is quite 
difficult to abstract it (too much details) 
– Well we don’t care so much of the tiny networking 
details we care for evolution on a architecture 
level!
Views and perspectives 
• Many stakeholders result in many perspectives and thus many 
views of the network are required! 
The cardiologist needs a 
cardiogram 
.. But the orthopedist 
needs an X-ray scan 
Stakeholders needs views of the network that will allow them 
to reason about it!
In more common language 
• Core network engineers needs a view of the 
core network, they don’t care much about the 
access… 
• BGP peering needs a view of the BGP they 
don’t care much neither about the core nor 
about the access! 
• Support guys from Plovdiv field maintenance 
team needs a view of the network from their 
region, they don’t care about Sofia network
Initial questions 
• How does the number of Bulgarian Internet 
Autonomous systems evolve through the 
years (totals and node births/deaths) 
• How did the number of Bulgarian Internet 
BGP peering to the rest of the world changed 
over the years? 
• What is the number of total advertised 
addresses? 
• All that has to be done for IPv4 & IPv6
BG INTERNET IPV4
Bulgarian IPv4 autonomous systems 
(totals per year) 
600 
500 
400 
300 
200 
100 
0 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
International BGP Peering BG to * 
120 
100 
80 
60 
40 
20 
0 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
Bulgarian IPv4 address space 
7000000 
6000000 
5000000 
4000000 
3000000 
2000000 
1000000 
0 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
IPv4 AS birth /dead 
Achieved by diffing per year 
60 
50 
40 
30 
20 
10 
0 
Node births 
Node deads
BG INTERNET IPV6
BG IPv6 ASNs 
60 
50 
40 
30 
20 
10 
0 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
International IPv6 peering 
35 
30 
25 
20 
15 
10 
5 
0 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
Advertised IPv6 Address Space 
300000 M 
250000 M 
200000 M 
150000 M 
100000 M 
50000 M 
M 
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
BG IPv6 AS birth /dead 
Achieved by diffing per year 
12 
10 
8 
6 
4 
2 
0 
2001-2002 2002-2003 2003-2004 2004-2005 2005-2006 2006-2007 2007-2008 2008-2009 2009-2010 2010-2011 2011-2012 2012-2013 2013-2014
HOW DID WE DO IT?
The approach -1 
• We have generated Global IPv4/IPv6 Internet maps from MRT (RFC 6396) 
files. 
• The raw data from the repository of the route views project 
ftp://archive.routeviews.org/ 
• Each MRT file will contain full Internet routing table. 
• We will extract BGP AS PATH attributes and will generate a map based on 
Internet Autonomous System numbers. 
• As part of the map generation process each BGP AS has been enriched by 
whois info from http://www.potaroo.net/bgp/iana/asn.txt) 
• The maps itself are generate d with javaMrt2Graphml 
https://github.com/iTransformers/javaMrt2Graphml 
• We will generate one map per year (lazy and statistically incorrect) 
• Each map will contain the “whole” Internet
The approach 2 
• Each Internet map sub-graph will be filtered by 
netTransformer to a BG Internet sub-graph. 
• By BG Internet we mean Bulgarian ASNs and their 
peering to the rest of the world (e.g Bulgaria 
connectivity to abroad). 
• With netTetTransformer we will generate graph diffs on 
yearly by year basis (e. 2001-2002, 2002 – 2003 and so 
on) 
• Finally will calculate node rankings and will generate 
diff reports 
• All that was used for the presented statistics 
generation
netTransformer 
• Software for tracking and pushing the network 
evolution process 
• Network transformation – a process in which we 
push the network evolution in direction that suits 
our stakeholder interest 
• It is able to discover networks, to fill in different 
network models, to diff between any two 
discovered network states 
• It is able also to “talk” with network devices and 
to executes the steps of the strategies for 
network from state to state transformation.
netTransformer 
• Written in java, xslt, glue with maven, groovy, Spring, JUNG 
and a lot of swing ;) 
• https://github.com/iTransformers/netTransformer 
• GPL! 
• Architecture is based on the following key 
Interfaces/components 
– Discoverers (anybody can implement his own, we have a couple raging 
from SNMP, Openflow floodlight, BGP peering and some others). 
– Node or Network Listeners 
– Viewer, resourceFactories, activationFactories 
– postDiscoverers (asses networks after the discovery has finished!)
netTransformer Look and feels
Internet BGP AS Node Metadata 
Autonomous system ID 
IPv6 advertised prefix 
count 
AS name & description (whois) 
Advertised IPv4/IPv6 prefixes 
(comma separated) 
IPv4/IPv6 address count 
Country of affiliation 
IPv4 advertised prefix 
count
Graph Diffing
A few words about OpenSource and our motivation 
• The surprising truth about what motivates us 
https://www.youtube.com/watch?v=u6XAPnuFjJc
Tracking Bulgarian Internet evolution from 
2001 till now 
Nikolay Milovanov 
Vasil Yordanov 
https://github.com/iTransformers/ 
QUESTIONS!

More Related Content

Similar to networkEvolution

IETF Activities Update
IETF Activities UpdateIETF Activities Update
IETF Activities UpdateARIN
 
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]APNIC
 
Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?Memoori
 
BGP evolution -from SDN perspective
BGP evolution -from SDN perspectiveBGP evolution -from SDN perspective
BGP evolution -from SDN perspectiveMiya Kohno
 
Three years of OFELIA - taking stock
Three years of OFELIA - taking stockThree years of OFELIA - taking stock
Three years of OFELIA - taking stockFIBRE Testbed
 
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...PROIDEA
 
2-background-5g.ppt
2-background-5g.ppt2-background-5g.ppt
2-background-5g.pptNilamHonmane
 
BSides: BGP Hijacking and Secure Internet Routing
BSides: BGP Hijacking and Secure Internet RoutingBSides: BGP Hijacking and Secure Internet Routing
BSides: BGP Hijacking and Secure Internet RoutingAPNIC
 
The case for IPv6
The case for IPv6The case for IPv6
The case for IPv6APNIC
 
IPv6 Development in ITB 2013
IPv6 Development in ITB 2013IPv6 Development in ITB 2013
IPv6 Development in ITB 2013Affan Basalamah
 
RouteFlow & IXPs
RouteFlow & IXPsRouteFlow & IXPs
RouteFlow & IXPsnvirters
 
RIPE NCC RIS (Routing Information Service)
RIPE NCC RIS (Routing Information Service)RIPE NCC RIS (Routing Information Service)
RIPE NCC RIS (Routing Information Service)RIPE NCC
 
ARIN 36 IETF IPv6 Activities Report
ARIN 36 IETF IPv6 Activities ReportARIN 36 IETF IPv6 Activities Report
ARIN 36 IETF IPv6 Activities ReportARIN
 

Similar to networkEvolution (20)

IETF Activities Update
IETF Activities UpdateIETF Activities Update
IETF Activities Update
 
IP Routing
IP RoutingIP Routing
IP Routing
 
Smart net
Smart netSmart net
Smart net
 
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
 
Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?
 
BGP evolution -from SDN perspective
BGP evolution -from SDN perspectiveBGP evolution -from SDN perspective
BGP evolution -from SDN perspective
 
Three years of OFELIA - taking stock
Three years of OFELIA - taking stockThree years of OFELIA - taking stock
Three years of OFELIA - taking stock
 
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...
PLNOG 8: Jan Zorz - Mobile broadband and IPv6 in Slovenia, DSMIP6-TLS and GEN...
 
2-background-5g.ppt
2-background-5g.ppt2-background-5g.ppt
2-background-5g.ppt
 
2-background-5g.ppt
2-background-5g.ppt2-background-5g.ppt
2-background-5g.ppt
 
BSides: BGP Hijacking and Secure Internet Routing
BSides: BGP Hijacking and Secure Internet RoutingBSides: BGP Hijacking and Secure Internet Routing
BSides: BGP Hijacking and Secure Internet Routing
 
The case for IPv6
The case for IPv6The case for IPv6
The case for IPv6
 
IPv6 Development in ITB 2013
IPv6 Development in ITB 2013IPv6 Development in ITB 2013
IPv6 Development in ITB 2013
 
Chap1
Chap1Chap1
Chap1
 
RouteFlow & IXPs
RouteFlow & IXPsRouteFlow & IXPs
RouteFlow & IXPs
 
RIPE NCC RIS (Routing Information Service)
RIPE NCC RIS (Routing Information Service)RIPE NCC RIS (Routing Information Service)
RIPE NCC RIS (Routing Information Service)
 
ARIN 36 IETF IPv6 Activities Report
ARIN 36 IETF IPv6 Activities ReportARIN 36 IETF IPv6 Activities Report
ARIN 36 IETF IPv6 Activities Report
 
IoT overview 2014
IoT overview 2014IoT overview 2014
IoT overview 2014
 
Final_Vanet
Final_VanetFinal_Vanet
Final_Vanet
 
SDI to IP 2110 Transition Part 1
SDI to IP 2110 Transition Part 1SDI to IP 2110 Transition Part 1
SDI to IP 2110 Transition Part 1
 

More from Nikolay Milovanov

LoRa online training for utility guys
LoRa online training for utility guysLoRa online training for utility guys
LoRa online training for utility guysNikolay Milovanov
 
LoRa мрежи за ютилити компании
LoRa мрежи за ютилити компанииLoRa мрежи за ютилити компании
LoRa мрежи за ютилити компанииNikolay Milovanov
 
ThingsLog - приказка за един теч
ThingsLog - приказка за един течThingsLog - приказка за един теч
ThingsLog - приказка за един течNikolay Milovanov
 
From OpenStack to Docker swarm
From OpenStack to Docker swarmFrom OpenStack to Docker swarm
From OpenStack to Docker swarmNikolay Milovanov
 
DevOps as an emerging university discipline
DevOps as an emerging university disciplineDevOps as an emerging university discipline
DevOps as an emerging university disciplineNikolay Milovanov
 
Департаменти Информатика и Телекомуникации в Нов Български Университет
Департаменти Информатика и Телекомуникации в Нов Български Университет Департаменти Информатика и Телекомуникации в Нов Български Университет
Департаменти Информатика и Телекомуникации в Нов Български Университет Nikolay Milovanov
 

More from Nikolay Milovanov (10)

LoRa online training for utility guys
LoRa online training for utility guysLoRa online training for utility guys
LoRa online training for utility guys
 
LoRa мрежи за ютилити компании
LoRa мрежи за ютилити компанииLoRa мрежи за ютилити компании
LoRa мрежи за ютилити компании
 
Thingslog bg facilities
Thingslog bg facilitiesThingslog bg facilities
Thingslog bg facilities
 
ThingsLog
ThingsLogThingsLog
ThingsLog
 
ThingsLog - приказка за един теч
ThingsLog - приказка за един течThingsLog - приказка за един теч
ThingsLog - приказка за един теч
 
ThingsLog
ThingsLogThingsLog
ThingsLog
 
Expect4java
Expect4javaExpect4java
Expect4java
 
From OpenStack to Docker swarm
From OpenStack to Docker swarmFrom OpenStack to Docker swarm
From OpenStack to Docker swarm
 
DevOps as an emerging university discipline
DevOps as an emerging university disciplineDevOps as an emerging university discipline
DevOps as an emerging university discipline
 
Департаменти Информатика и Телекомуникации в Нов Български Университет
Департаменти Информатика и Телекомуникации в Нов Български Университет Департаменти Информатика и Телекомуникации в Нов Български Университет
Департаменти Информатика и Телекомуникации в Нов Български Университет
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 

Recently uploaded (20)

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 

networkEvolution

  • 1. Tracking Bulgarian Internet evolution from 2001 till now Nikolay Milovanov Vasil Yordanov https://github.com/iTransformers
  • 2. Network evolution in nutshell • Network evolution could be expressed as: – Topology changes: • Appearance, disappearance of nodes or links • Changes in network diameter • Changes in node ranks • Changes in clustarization and giant components – Changes in node/edge properties • Appearance of new metadata • Disappearance of such • Changes in node/edge metadata values – All the above reflects changes in the law as per which network evolves : • An example of such law is Barbatsi and Albert law – e.g human networks evolve as per power law
  • 3. Examples for evolving networks • Internet • WWW • Social • Bio • Communication • Networks of SA components and connectors • Knowing the law will allow us to predict how does the network will evolve
  • 4. So a question emerge: How can we track how does the network evolves? – Globul OMC used a notepad to write down each and every event that happens in the network – Traffic/Performance monitoring systems might give us such information but in really it is quite difficult to abstract it (too much details) – Well we don’t care so much of the tiny networking details we care for evolution on a architecture level!
  • 5. Views and perspectives • Many stakeholders result in many perspectives and thus many views of the network are required! The cardiologist needs a cardiogram .. But the orthopedist needs an X-ray scan Stakeholders needs views of the network that will allow them to reason about it!
  • 6. In more common language • Core network engineers needs a view of the core network, they don’t care much about the access… • BGP peering needs a view of the BGP they don’t care much neither about the core nor about the access! • Support guys from Plovdiv field maintenance team needs a view of the network from their region, they don’t care about Sofia network
  • 7. Initial questions • How does the number of Bulgarian Internet Autonomous systems evolve through the years (totals and node births/deaths) • How did the number of Bulgarian Internet BGP peering to the rest of the world changed over the years? • What is the number of total advertised addresses? • All that has to be done for IPv4 & IPv6
  • 9. Bulgarian IPv4 autonomous systems (totals per year) 600 500 400 300 200 100 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 10. International BGP Peering BG to * 120 100 80 60 40 20 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 11. Bulgarian IPv4 address space 7000000 6000000 5000000 4000000 3000000 2000000 1000000 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 12. IPv4 AS birth /dead Achieved by diffing per year 60 50 40 30 20 10 0 Node births Node deads
  • 14. BG IPv6 ASNs 60 50 40 30 20 10 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 15. International IPv6 peering 35 30 25 20 15 10 5 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 16. Advertised IPv6 Address Space 300000 M 250000 M 200000 M 150000 M 100000 M 50000 M M 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
  • 17. BG IPv6 AS birth /dead Achieved by diffing per year 12 10 8 6 4 2 0 2001-2002 2002-2003 2003-2004 2004-2005 2005-2006 2006-2007 2007-2008 2008-2009 2009-2010 2010-2011 2011-2012 2012-2013 2013-2014
  • 18. HOW DID WE DO IT?
  • 19. The approach -1 • We have generated Global IPv4/IPv6 Internet maps from MRT (RFC 6396) files. • The raw data from the repository of the route views project ftp://archive.routeviews.org/ • Each MRT file will contain full Internet routing table. • We will extract BGP AS PATH attributes and will generate a map based on Internet Autonomous System numbers. • As part of the map generation process each BGP AS has been enriched by whois info from http://www.potaroo.net/bgp/iana/asn.txt) • The maps itself are generate d with javaMrt2Graphml https://github.com/iTransformers/javaMrt2Graphml • We will generate one map per year (lazy and statistically incorrect) • Each map will contain the “whole” Internet
  • 20. The approach 2 • Each Internet map sub-graph will be filtered by netTransformer to a BG Internet sub-graph. • By BG Internet we mean Bulgarian ASNs and their peering to the rest of the world (e.g Bulgaria connectivity to abroad). • With netTetTransformer we will generate graph diffs on yearly by year basis (e. 2001-2002, 2002 – 2003 and so on) • Finally will calculate node rankings and will generate diff reports • All that was used for the presented statistics generation
  • 21. netTransformer • Software for tracking and pushing the network evolution process • Network transformation – a process in which we push the network evolution in direction that suits our stakeholder interest • It is able to discover networks, to fill in different network models, to diff between any two discovered network states • It is able also to “talk” with network devices and to executes the steps of the strategies for network from state to state transformation.
  • 22. netTransformer • Written in java, xslt, glue with maven, groovy, Spring, JUNG and a lot of swing ;) • https://github.com/iTransformers/netTransformer • GPL! • Architecture is based on the following key Interfaces/components – Discoverers (anybody can implement his own, we have a couple raging from SNMP, Openflow floodlight, BGP peering and some others). – Node or Network Listeners – Viewer, resourceFactories, activationFactories – postDiscoverers (asses networks after the discovery has finished!)
  • 24. Internet BGP AS Node Metadata Autonomous system ID IPv6 advertised prefix count AS name & description (whois) Advertised IPv4/IPv6 prefixes (comma separated) IPv4/IPv6 address count Country of affiliation IPv4 advertised prefix count
  • 26. A few words about OpenSource and our motivation • The surprising truth about what motivates us https://www.youtube.com/watch?v=u6XAPnuFjJc
  • 27. Tracking Bulgarian Internet evolution from 2001 till now Nikolay Milovanov Vasil Yordanov https://github.com/iTransformers/ QUESTIONS!