CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, talk at Google London, Feb'2015

Dima Karamshuk
Dima Karamshukdata scientist
CD-GAIN: Content Delivery
Through the Analysis of Users' Access Patterns
Dmytro Karamshuk1, Nishanth Sastry1, Jigna Chandaria2, Andy Secker2
1King's College London, 2BBC R&D
CD-GAIN: ESPRC project in collaboration with BBC R&D, http://bit.ly/cd-gain
CISCO Visual Networking Index
Some Figures
• Video traffic in 2013 accounted for 66% of all traffic
on the Internet and is predicted to reach 79% by 2018
• Nearly three-fourths of the world’s mobile data traffic
will be video by 2019
…which Raise Some Issues
User Experience Carbon Footprint
Business Models
Users - 32 M/month
IP address – 20 M/month
Sessions - 1.9 Billion
May 2013 – Jan 2014
≈ 50% of the UK population
First-mile view of the UK’s IP-ecosystem
2 x [INFOCOM’2015], [WWW’2013]
Where the market is heading?
Fixed-line Internet market
(5 representative providers)
Mobile market is more dynamic than the fixed-line Internet market
Mobile Internet market
(5 representative providers)
Pricing Models
All-you-can-eat data
(M1, M5)
Limited-cap data packages
(M2 – M4)
All-you-can-eat plans boost
users consumption
Users of all-you-can-eat data
providers are more “loyal”
Behavioral Shift
• Fixed-line accesses (F1-F5) peaks in the evening
• Limited data caps (M2-M4) peak in commute hours
Mobile users watch more
during commutes
• Unlimited plans (M1, M5) is a superposition of both
Product Bundles
Inter-ISP attractiveness: normalized fraction of shared users
between a pair of mobile and fixed-line ISP
Product bundles can be used to share infrastructure between
peaking in non-intersecting time periods mobile and fixed-line ISPs
Combinations of ISPs
corresponding to existing
product bundles
Limitations to mobile-fixed interactions
Correlation of content
popularity across different ISPs
Share of accesses
per content genre
User of mobile and fixed-line ISPs watch slightly different content
More on Infrastructural Support
Regional activity levels are correlated with the access speed
Solution: let’s install more distributed caches!!!
Content Delivery: traditional approach
Install more distributed caches Requires investments
Increased carbon footprint
Peer-assisted Content Delivery
Content Delivery
Network
user
user user
user
user
user
average of 5K users online every sec in the first day after release
5K duplicates
Ask users for assistance
P2P: Obstacles
Bitrate Stratification
Partial Participation
ISP friendliness
1080p
720p
480p
Dealing with Obstacles
Five biggest ISPs account for over
80% of traffic
Two main bitrate formats
dominate in over 70% of sessions
Traffic fragmentation by ISP and bitrate formats
yields few large content swarms
Traffic Savings and Swarm Capacity
Traffic gain:
- volume of traffic downloaded from content delivery nodes
- total volume of traffic watched by the users
potential traffic gains for popular content are immense despite constraints
Swarm capacity: c
G 1
Ts
Tu
- average number of users online
A Simple Theoretical Model
model the system as an infinite servers queue
CDN user
1
user
2
user
3
intuition: the more users in a swarm
the more savings
Higher Demand means Higher Savings
ci
=ui
riAverage number of peers online
G(c)=1−(
c(1+e
c
c
−m
(mΓ(m)−Γ(1+m,c)))
m
+1)
−1
How much we can offload to peers
Traffic gains are growing with
the demand and the size of content
request ratemean session duration
G c 1 e
c
Particularly, if m=1:
Theory VS Simulations
Theory is in a good agreement with simulations
Savings across Content Corpus
Top-5% of the content
corpus accounts for 80% of traffic
Most of accesses happen in the
first day after release
Yes, it’s all about very popular content
https://vimeo.com/99054874
How about Unpopularity Content?
Content Bundling Client Caching
Pro-active pushing VS reactive pulling?
Client Caching
client caching can boost gains for up to 20%
Improv. in a single swarm Improv. for the content corpus
Carbon Footprint
number of hops = 5-7 number of hops = 3
Traditional content delivery network Peer-assisted CDN
Number of networking nodes powered to delivery a video
in peer-assisted scenario is potentially smaller
Potential Energy Savings
Average distance between peers
in a swarm with a given capacity
Energy savings for a swarm
with a given capacity
peer-assisted content distribution may lead to energy savings
Conclusions
• there is substantial difference in accesses patterns between fixed-
line ISPs, mobile ISPs with all-you-can-eat data and limited data-
caps
• this difference can be effectively exploited in shared mobile-fixed
infrastructures
•user engagement depends on the level of infrastructural support
• with peer-assisted delivery savings grow with demands even
despite obstacles
• peer-assisted CDN can also be green
Dmytro Karamshuk
King's College London
follow me on Twitter: @karamshuk
Our website:
http://bit.ly/cd-gain
1 of 25

Recommended

ISP-friendly Peer-assisted On-demand Streaming of Long Duration Content in BB... by
ISP-friendly Peer-assisted On-demand Streaming of Long Duration Content in BB...ISP-friendly Peer-assisted On-demand Streaming of Long Duration Content in BB...
ISP-friendly Peer-assisted On-demand Streaming of Long Duration Content in BB...Dima Karamshuk
3K views26 slides
The Evolution of Broadband from Coverage to Quality by
The Evolution of Broadband from Coverage to QualityThe Evolution of Broadband from Coverage to Quality
The Evolution of Broadband from Coverage to QualityInternational Institute of Communications
1.1K views18 slides
HPSN2 presentation by
HPSN2 presentationHPSN2 presentation
HPSN2 presentationswashbuckle
509 views77 slides
Satellite Broadband by
Satellite BroadbandSatellite Broadband
Satellite BroadbandJulian McGougan
138 views14 slides
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser... by
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...Dima Karamshuk
919 views19 slides

More Related Content

What's hot

Intelligent Wireless Backhaul Solutions by
Intelligent Wireless Backhaul SolutionsIntelligent Wireless Backhaul Solutions
Intelligent Wireless Backhaul Solutionsblinqnet
295 views7 slides
Chris Townsend - BDUK - inca presentation sept 2015 .1 by
Chris Townsend - BDUK -  inca presentation sept 2015 .1Chris Townsend - BDUK -  inca presentation sept 2015 .1
Chris Townsend - BDUK - inca presentation sept 2015 .1Independent Networks Co-operative Association
619 views18 slides
ISP status in Bangladesh 2016 by
ISP status in Bangladesh 2016ISP status in Bangladesh 2016
ISP status in Bangladesh 2016Bangladesh Network Operators Group
1.2K views10 slides
Spectrum sharing by
Spectrum sharingSpectrum sharing
Spectrum sharingtechUK
992 views13 slides
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum Sharing by
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum SharingUK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum Sharing
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum SharingtechUK
1.1K views15 slides
Spectrum sharing and licensed shared access: Draft Report by
Spectrum sharing and licensed shared access: Draft ReportSpectrum sharing and licensed shared access: Draft Report
Spectrum sharing and licensed shared access: Draft ReporttechUK
851 views25 slides

What's hot(20)

Intelligent Wireless Backhaul Solutions by blinqnet
Intelligent Wireless Backhaul SolutionsIntelligent Wireless Backhaul Solutions
Intelligent Wireless Backhaul Solutions
blinqnet295 views
Spectrum sharing by techUK
Spectrum sharingSpectrum sharing
Spectrum sharing
techUK992 views
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum Sharing by techUK
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum SharingUK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum Sharing
UK Spectrum Policy Forum - Rachel Clark, Ofcom - Spectrum Sharing
techUK1.1K views
Spectrum sharing and licensed shared access: Draft Report by techUK
Spectrum sharing and licensed shared access: Draft ReportSpectrum sharing and licensed shared access: Draft Report
Spectrum sharing and licensed shared access: Draft Report
techUK851 views
'Audiometrics: Measuring Audio Consumption In The UK' by Daniel Nathan & Gran... by Grant Goddard
'Audiometrics: Measuring Audio Consumption In The UK' by Daniel Nathan & Gran...'Audiometrics: Measuring Audio Consumption In The UK' by Daniel Nathan & Gran...
'Audiometrics: Measuring Audio Consumption In The UK' by Daniel Nathan & Gran...
Grant Goddard844 views
City fibre inca inca birmingham 250917 by James Saunby
City fibre   inca inca birmingham 250917City fibre   inca inca birmingham 250917
City fibre inca inca birmingham 250917
James Saunby93 views
NextShare Platform by sototozo
NextShare PlatformNextShare Platform
NextShare Platform
sototozo447 views
Chris cheeseman, BT - FCCG interim report recommendations by techUK
Chris cheeseman, BT - FCCG interim report recommendationsChris cheeseman, BT - FCCG interim report recommendations
Chris cheeseman, BT - FCCG interim report recommendations
techUK507 views
Mobile spectrum-032013-digiversion by Value Partners
Mobile spectrum-032013-digiversionMobile spectrum-032013-digiversion
Mobile spectrum-032013-digiversion
Value Partners482 views
1-7 P2PMS P2P-Next by skame
1-7 P2PMS P2P-Next1-7 P2PMS P2P-Next
1-7 P2PMS P2P-Next
skame161 views

Viewers also liked

Locations and Networks at scale: From insights to predictive models, workshop... by
Locations and Networks at scale: From insights to predictive models, workshop...Locations and Networks at scale: From insights to predictive models, workshop...
Locations and Networks at scale: From insights to predictive models, workshop...Dima Karamshuk
627 views7 slides
Identifying Partisan Slant in News Articles and Twitter during Political Crises by
Identifying Partisan Slant in News Articles and Twitter during Political CrisesIdentifying Partisan Slant in News Articles and Twitter during Political Crises
Identifying Partisan Slant in News Articles and Twitter during Political CrisesDima Karamshuk
993 views12 slides
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser... by
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...Dima Karamshuk
948 views17 slides
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ... by
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...Dima Karamshuk
6.7K views26 slides
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ... by
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...Dima Karamshuk
703 views27 slides
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNIS by
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNISGEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNIS
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNISDamien Demaj
7.3K views39 slides

Viewers also liked(7)

Locations and Networks at scale: From insights to predictive models, workshop... by Dima Karamshuk
Locations and Networks at scale: From insights to predictive models, workshop...Locations and Networks at scale: From insights to predictive models, workshop...
Locations and Networks at scale: From insights to predictive models, workshop...
Dima Karamshuk627 views
Identifying Partisan Slant in News Articles and Twitter during Political Crises by Dima Karamshuk
Identifying Partisan Slant in News Articles and Twitter during Political CrisesIdentifying Partisan Slant in News Articles and Twitter during Political Crises
Identifying Partisan Slant in News Articles and Twitter during Political Crises
Dima Karamshuk993 views
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser... by Dima Karamshuk
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...
On Factors Affecting the Usage and Adoption of a Nation-wide TV Streaming Ser...
Dima Karamshuk948 views
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ... by Dima Karamshuk
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...
Modeling the Social, Spatial, and Temporal dimensions of Human Mobility in a ...
Dima Karamshuk6.7K views
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ... by Dima Karamshuk
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...
Take-away TV: Recharging Work Commutes with Greedy and Predictive Preloading ...
Dima Karamshuk703 views
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNIS by Damien Demaj
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNISGEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNIS
GEOVISUALIZING SPATIO-TEMPORAL PATTERNS IN TENNIS
Damien Demaj7.3K views
Geo-Spotting: Mining Online Location-based Services for Optimal Retail Store ... by Dima Karamshuk
Geo-Spotting: Mining Online Location-based Services for Optimal Retail Store ...Geo-Spotting: Mining Online Location-based Services for Optimal Retail Store ...
Geo-Spotting: Mining Online Location-based Services for Optimal Retail Store ...
Dima Karamshuk4.4K views

Similar to CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, talk at Google London, Feb'2015

Attack of the Content Clones: Saving the Internet from On-demand Video Streaming by
Attack of the Content Clones: Saving the Internet from On-demand Video StreamingAttack of the Content Clones: Saving the Internet from On-demand Video Streaming
Attack of the Content Clones: Saving the Internet from On-demand Video Streamingnishanthsastry
331 views45 slides
Andrew Haynes NextGen 09 by
Andrew Haynes NextGen 09Andrew Haynes NextGen 09
Andrew Haynes NextGen 09Marit Hendriks
936 views14 slides
[Streamroot] Whitepaper peer assisted adaptive streaming by
[Streamroot] Whitepaper peer assisted adaptive streaming[Streamroot] Whitepaper peer assisted adaptive streaming
[Streamroot] Whitepaper peer assisted adaptive streamingVu Nguyen
467 views14 slides
Over the Top Content Delivery: State of the Art and Challenges Ahead by
Over the Top Content Delivery: State of the Art and Challenges AheadOver the Top Content Delivery: State of the Art and Challenges Ahead
Over the Top Content Delivery: State of the Art and Challenges AheadAlpen-Adria-Universität
13.4K views164 slides
Delivering on the broadband promise: technology trends and institutional land... by
Delivering on the broadband promise: technology trends and institutional land...Delivering on the broadband promise: technology trends and institutional land...
Delivering on the broadband promise: technology trends and institutional land...Antonio Bove
599 views18 slides
QoE-enabled big video streaming for large-scale heterogeneous clients and net... by
QoE-enabled big video streaming for large-scale heterogeneous clients and net...QoE-enabled big video streaming for large-scale heterogeneous clients and net...
QoE-enabled big video streaming for large-scale heterogeneous clients and net...redpel dot com
325 views11 slides

Similar to CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, talk at Google London, Feb'2015(20)

Attack of the Content Clones: Saving the Internet from On-demand Video Streaming by nishanthsastry
Attack of the Content Clones: Saving the Internet from On-demand Video StreamingAttack of the Content Clones: Saving the Internet from On-demand Video Streaming
Attack of the Content Clones: Saving the Internet from On-demand Video Streaming
nishanthsastry331 views
[Streamroot] Whitepaper peer assisted adaptive streaming by Vu Nguyen
[Streamroot] Whitepaper peer assisted adaptive streaming[Streamroot] Whitepaper peer assisted adaptive streaming
[Streamroot] Whitepaper peer assisted adaptive streaming
Vu Nguyen467 views
Over the Top Content Delivery: State of the Art and Challenges Ahead by Alpen-Adria-Universität
Over the Top Content Delivery: State of the Art and Challenges AheadOver the Top Content Delivery: State of the Art and Challenges Ahead
Over the Top Content Delivery: State of the Art and Challenges Ahead
Delivering on the broadband promise: technology trends and institutional land... by Antonio Bove
Delivering on the broadband promise: technology trends and institutional land...Delivering on the broadband promise: technology trends and institutional land...
Delivering on the broadband promise: technology trends and institutional land...
Antonio Bove599 views
QoE-enabled big video streaming for large-scale heterogeneous clients and net... by redpel dot com
QoE-enabled big video streaming for large-scale heterogeneous clients and net...QoE-enabled big video streaming for large-scale heterogeneous clients and net...
QoE-enabled big video streaming for large-scale heterogeneous clients and net...
redpel dot com325 views
International Journal of Engineering Research and Development (IJERD) by IJERD Editor
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
IJERD Editor191 views
Streaming, Content Delivery & Networks Dr Angus Hay Neotel by guest22cb1ea7
Streaming, Content Delivery & Networks Dr Angus Hay NeotelStreaming, Content Delivery & Networks Dr Angus Hay Neotel
Streaming, Content Delivery & Networks Dr Angus Hay Neotel
guest22cb1ea7759 views
PLNOG 3: Andrew Haynes - The Future of the Networked World: Are you ready fo... by PROIDEA
PLNOG 3: Andrew Haynes -  The Future of the Networked World: Are you ready fo...PLNOG 3: Andrew Haynes -  The Future of the Networked World: Are you ready fo...
PLNOG 3: Andrew Haynes - The Future of the Networked World: Are you ready fo...
PROIDEA26 views
Arcus Advisors Report_Quality of Service by Scott Landman
Arcus Advisors Report_Quality of ServiceArcus Advisors Report_Quality of Service
Arcus Advisors Report_Quality of Service
Scott Landman306 views
5 maximazing networkcapacity_v4-jorge_alvarado by SSPI Brasil
5 maximazing networkcapacity_v4-jorge_alvarado5 maximazing networkcapacity_v4-jorge_alvarado
5 maximazing networkcapacity_v4-jorge_alvarado
SSPI Brasil165 views
traffic pattern-based content leakage detection for trusted content delivery ... by swathi78
traffic pattern-based content leakage detection for trusted content delivery ...traffic pattern-based content leakage detection for trusted content delivery ...
traffic pattern-based content leakage detection for trusted content delivery ...
swathi78226 views
Caching necessity and benifits for mobile Operator by Md. Abdul Hadi Dipu
Caching necessity and benifits for mobile OperatorCaching necessity and benifits for mobile Operator
Caching necessity and benifits for mobile Operator
JPJ1445 Traffic Pattern-Based Content Leakage Detection for Trusted Content D... by chennaijp
JPJ1445 Traffic Pattern-Based Content Leakage Detection for Trusted Content D...JPJ1445 Traffic Pattern-Based Content Leakage Detection for Trusted Content D...
JPJ1445 Traffic Pattern-Based Content Leakage Detection for Trusted Content D...
chennaijp644 views
NetIX - Moving Traffic to the Expressway Jan 2016 by Ken Lefkowitz
NetIX - Moving Traffic to the Expressway Jan 2016NetIX - Moving Traffic to the Expressway Jan 2016
NetIX - Moving Traffic to the Expressway Jan 2016
Ken Lefkowitz161 views
TRAFFIC PATTERN-BASED CONTENT LEAKAGE DETECTION FOR TRUSTED CONTENT DELIVERY ... by Shakas Technologies
TRAFFIC PATTERN-BASED CONTENT LEAKAGE DETECTION FOR TRUSTED CONTENT DELIVERY ...TRAFFIC PATTERN-BASED CONTENT LEAKAGE DETECTION FOR TRUSTED CONTENT DELIVERY ...
TRAFFIC PATTERN-BASED CONTENT LEAKAGE DETECTION FOR TRUSTED CONTENT DELIVERY ...
Using Bandwidth Aggregation to Improve the Performance of Video Quality- Adap... by paperpublications3
Using Bandwidth Aggregation to Improve the Performance of Video Quality- Adap...Using Bandwidth Aggregation to Improve the Performance of Video Quality- Adap...
Using Bandwidth Aggregation to Improve the Performance of Video Quality- Adap...
BTI Systems CommunicAsia Presentation by BTI Systems
BTI Systems CommunicAsia PresentationBTI Systems CommunicAsia Presentation
BTI Systems CommunicAsia Presentation
BTI Systems468 views

Recently uploaded

Sustainable Marketing by
Sustainable MarketingSustainable Marketing
Sustainable MarketingTheo van der Zee
9 views50 slides
DU Series - Day 4.pptx by
DU Series - Day 4.pptxDU Series - Day 4.pptx
DU Series - Day 4.pptxUiPathCommunity
94 views28 slides
OMS: Diretrizes para um controle da promoção comercial dos ditos substitutos ... by
OMS: Diretrizes para um controle da promoção comercial dos ditos substitutos ...OMS: Diretrizes para um controle da promoção comercial dos ditos substitutos ...
OMS: Diretrizes para um controle da promoção comercial dos ditos substitutos ...Prof. Marcus Renato de Carvalho
88 views24 slides
UiPath Document Understanding_Day 2.pptx by
UiPath Document Understanding_Day 2.pptxUiPath Document Understanding_Day 2.pptx
UiPath Document Understanding_Day 2.pptxRohitRadhakrishnan8
282 views21 slides
Serverless cloud architecture patterns by
Serverless cloud architecture patternsServerless cloud architecture patterns
Serverless cloud architecture patternsJimmy Dahlqvist
17 views52 slides
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf by
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdfIGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdfRIPE NCC
15 views11 slides

Recently uploaded(20)

Serverless cloud architecture patterns by Jimmy Dahlqvist
Serverless cloud architecture patternsServerless cloud architecture patterns
Serverless cloud architecture patterns
Jimmy Dahlqvist17 views
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf by RIPE NCC
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdfIGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
RIPE NCC15 views
𝐒𝐨𝐥𝐚𝐫𝐖𝐢𝐧𝐝𝐬 𝐂𝐚𝐬𝐞 𝐒𝐭𝐮𝐝𝐲 by Infosec train
𝐒𝐨𝐥𝐚𝐫𝐖𝐢𝐧𝐝𝐬 𝐂𝐚𝐬𝐞 𝐒𝐭𝐮𝐝𝐲𝐒𝐨𝐥𝐚𝐫𝐖𝐢𝐧𝐝𝐬 𝐂𝐚𝐬𝐞 𝐒𝐭𝐮𝐝𝐲
𝐒𝐨𝐥𝐚𝐫𝐖𝐢𝐧𝐝𝐬 𝐂𝐚𝐬𝐞 𝐒𝐭𝐮𝐝𝐲
Infosec train7 views
We see everywhere that many people are talking about technology.docx by ssuserc5935b
We see everywhere that many people are talking about technology.docxWe see everywhere that many people are talking about technology.docx
We see everywhere that many people are talking about technology.docx
ssuserc5935b6 views
google forms survey (1).pptx by MollyBrown86
google forms survey (1).pptxgoogle forms survey (1).pptx
google forms survey (1).pptx
MollyBrown8614 views
Building trust in our information ecosystem: who do we trust in an emergency by Tina Purnat
Building trust in our information ecosystem: who do we trust in an emergencyBuilding trust in our information ecosystem: who do we trust in an emergency
Building trust in our information ecosystem: who do we trust in an emergency
Tina Purnat85 views
PORTFOLIO 1 (Bret Michael Pepito).pdf by brejess0410
PORTFOLIO 1 (Bret Michael Pepito).pdfPORTFOLIO 1 (Bret Michael Pepito).pdf
PORTFOLIO 1 (Bret Michael Pepito).pdf
brejess04107 views
AI Powered event-driven translation bot by Jimmy Dahlqvist
AI Powered event-driven translation botAI Powered event-driven translation bot
AI Powered event-driven translation bot
Jimmy Dahlqvist16 views
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdf by RIPE NCC
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdfOpportunities for Youth in IG - Alena Muravska RIPE NCC.pdf
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdf
RIPE NCC9 views
UiPath Document Understanding_Day 3.pptx by UiPathCommunity
UiPath Document Understanding_Day 3.pptxUiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptx
UiPathCommunity95 views
Existing documentaries (1).docx by MollyBrown86
Existing documentaries (1).docxExisting documentaries (1).docx
Existing documentaries (1).docx
MollyBrown8613 views

CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, talk at Google London, Feb'2015

  • 1. CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns Dmytro Karamshuk1, Nishanth Sastry1, Jigna Chandaria2, Andy Secker2 1King's College London, 2BBC R&D CD-GAIN: ESPRC project in collaboration with BBC R&D, http://bit.ly/cd-gain
  • 2. CISCO Visual Networking Index Some Figures • Video traffic in 2013 accounted for 66% of all traffic on the Internet and is predicted to reach 79% by 2018 • Nearly three-fourths of the world’s mobile data traffic will be video by 2019
  • 3. …which Raise Some Issues User Experience Carbon Footprint Business Models
  • 4. Users - 32 M/month IP address – 20 M/month Sessions - 1.9 Billion May 2013 – Jan 2014 ≈ 50% of the UK population First-mile view of the UK’s IP-ecosystem 2 x [INFOCOM’2015], [WWW’2013]
  • 5. Where the market is heading? Fixed-line Internet market (5 representative providers) Mobile market is more dynamic than the fixed-line Internet market Mobile Internet market (5 representative providers)
  • 6. Pricing Models All-you-can-eat data (M1, M5) Limited-cap data packages (M2 – M4) All-you-can-eat plans boost users consumption Users of all-you-can-eat data providers are more “loyal”
  • 7. Behavioral Shift • Fixed-line accesses (F1-F5) peaks in the evening • Limited data caps (M2-M4) peak in commute hours Mobile users watch more during commutes • Unlimited plans (M1, M5) is a superposition of both
  • 8. Product Bundles Inter-ISP attractiveness: normalized fraction of shared users between a pair of mobile and fixed-line ISP Product bundles can be used to share infrastructure between peaking in non-intersecting time periods mobile and fixed-line ISPs Combinations of ISPs corresponding to existing product bundles
  • 9. Limitations to mobile-fixed interactions Correlation of content popularity across different ISPs Share of accesses per content genre User of mobile and fixed-line ISPs watch slightly different content
  • 10. More on Infrastructural Support Regional activity levels are correlated with the access speed Solution: let’s install more distributed caches!!!
  • 11. Content Delivery: traditional approach Install more distributed caches Requires investments Increased carbon footprint
  • 12. Peer-assisted Content Delivery Content Delivery Network user user user user user user average of 5K users online every sec in the first day after release 5K duplicates Ask users for assistance
  • 13. P2P: Obstacles Bitrate Stratification Partial Participation ISP friendliness 1080p 720p 480p
  • 14. Dealing with Obstacles Five biggest ISPs account for over 80% of traffic Two main bitrate formats dominate in over 70% of sessions Traffic fragmentation by ISP and bitrate formats yields few large content swarms
  • 15. Traffic Savings and Swarm Capacity Traffic gain: - volume of traffic downloaded from content delivery nodes - total volume of traffic watched by the users potential traffic gains for popular content are immense despite constraints Swarm capacity: c G 1 Ts Tu - average number of users online
  • 16. A Simple Theoretical Model model the system as an infinite servers queue CDN user 1 user 2 user 3 intuition: the more users in a swarm the more savings
  • 17. Higher Demand means Higher Savings ci =ui riAverage number of peers online G(c)=1−( c(1+e c c −m (mΓ(m)−Γ(1+m,c))) m +1) −1 How much we can offload to peers Traffic gains are growing with the demand and the size of content request ratemean session duration G c 1 e c Particularly, if m=1:
  • 18. Theory VS Simulations Theory is in a good agreement with simulations
  • 19. Savings across Content Corpus Top-5% of the content corpus accounts for 80% of traffic Most of accesses happen in the first day after release Yes, it’s all about very popular content https://vimeo.com/99054874
  • 20. How about Unpopularity Content? Content Bundling Client Caching Pro-active pushing VS reactive pulling?
  • 21. Client Caching client caching can boost gains for up to 20% Improv. in a single swarm Improv. for the content corpus
  • 22. Carbon Footprint number of hops = 5-7 number of hops = 3 Traditional content delivery network Peer-assisted CDN Number of networking nodes powered to delivery a video in peer-assisted scenario is potentially smaller
  • 23. Potential Energy Savings Average distance between peers in a swarm with a given capacity Energy savings for a swarm with a given capacity peer-assisted content distribution may lead to energy savings
  • 24. Conclusions • there is substantial difference in accesses patterns between fixed- line ISPs, mobile ISPs with all-you-can-eat data and limited data- caps • this difference can be effectively exploited in shared mobile-fixed infrastructures •user engagement depends on the level of infrastructural support • with peer-assisted delivery savings grow with demands even despite obstacles • peer-assisted CDN can also be green
  • 25. Dmytro Karamshuk King's College London follow me on Twitter: @karamshuk Our website: http://bit.ly/cd-gain