Research on Content Delivery Networks (CDNs) offers a number of effective methods for caching of content replicas or forwarding requests. Clouds, however, present a new kind of distribution environment as each location can support multiple caching options varying in the level of persistence of stored content. This paper proposes a distributed caching technology specific to fog clouds which, by definition, consist of a high number of loosely controlled heterogeneous locations. To deal with the heterogeneity problem and, at the same time, avoid centralized control, this paper proposes a function that allows CDN applications to discover local caching facilities dynamically, at runtime. For simplicity, this paper analyzes the case when each location offers two caching options: VM-based for each app and location-global shared by all local apps. Analysis in this paper shows that the new method can reduce inter-cloud traffic by between 16 and 18 times while retaining less than 30% of total content in a local cache.

1. via Local Hardware Awareness Spaces
Marat Zhanikeev
maratishe@gmail.com
maratishe.github.io
2016/06/27@WEC@ICDCS@Nara
Fog Cloud Caching
PDF: bit.do/160627
at Network Edge
#LHAP #localhardware
#resourcediscovery
#caching #MiniCache
#fog #clouds #cdn
#networkedge

2. .
Cloudification and LHAP
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 2/21
...
2/21

3. .
LHAP : Terminology?
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 3/21
...
3/21

4. .
LHAP(1) Cloudification
WiFi
Scale/sizeofcloudifieditems
Timeline
Now
(2016)
Probably
should not
cloudify
Should
definitely
cloudify
Data
Centers
Racks IoV > VC
Desktop
Notebook
APs,
Beacons
Smartphone
Sensor
IoT
Delegated
networking
Network
core Network
edge
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 4/21
...
4/21

5. .
LHAP(2) Local Hardware Awareness
Local hardware
Xen (hypervisor)
VirtualMachine
User
Apps
Physical Machine (PM)
Tools…
VirtualMachine
App
Tools
Global
Network
HDD SSD
Control Layer
…
VirtualMachine
App
API Layer
Other
local
hardware
Resource
Discovery
API
Connection
Cloud
platform
Virtual
machines
Direct
hardware access
Local
Hardware
Awareness
Platform
(LHAP)
• LHAP [la:p] : Local
Hardware Awareness
Platform 04
• API Layer: resource
discovery, interfaces, APIs
for VMs/containers
• Control Layer:
concurrency control,
quotas, billing/accounting,
etc.
04 M.Zhanikeev+0 "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 5/21
...
5/21

6. .
LHAP(3) Push vs Pull Deploys
• if same provider for box + service, then pull is suitable
• extremely heterogeneous, open federations should go for register/
push
Cloud Visitation Platform
App App App …
Pull-Based
Installation
(of Apps)
End
User
Device
Provider3rd Party
Service
Local
services
One
Cloud
Cloud Visitation Platform
App App App …
Cloud/device
Owner
3rd Party
Service Federated
Clouds
Local
services
Federated
Cloud
Manager
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 6/21
...
6/21

7. .
LHAP(4) 3 Deploy Modes
1. 3rd party installs the neccesary
tools and ships (migrates) the
VM
2. VM comes bare, tools are
installed locally
3. 3rd party selects from a local
set of ready-made VM
+tools options
◦ good if you only want to run a
simple app, not needing a fuller
environment (a greybox?) 10
10 F.Manco+2 "Towards the super fluid cloud" ACM SIGCOMM (2014)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 7/21
...
7/21

8. .
LHAP(5) Feature Comparison
• MiniCache08 is the closest rival, but has many flaws by comparison
• LHAP offers several unique features, not found elsewhere
Resource
Discovery
Multi-
VM
Multi-
PM
Generics
(any
resource)
Generics
(VM type)
Impl.
form
Load
balancing
(quota,
queue, etc.)
Traditional NO N/A N/A N/A N/A N/A N/A
MiniCache NO YES NO NO
(storage only)
MiniOS
only
driver NO
LHAP
(proposed)
YES YES YES YES ANY Web
API
YES
08 S.Kuenzer+3 "Towards minimalistic, virtualized content caches with minicache" 13th HotMiddlebox (2013)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 8/21
...
8/21

9. .
LHAP(6) A "Simply Put" Taxonomy
CDN on Federated Clouds
(proposal)
P4P,
ISP-side
Caching
(static popular
content)
Interactivity/Updatefrequency
Popularity
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 9/21
...
9/21

10. .
Modeling
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 10/21
...
10/21

11. .
Service Model (1) Detailed
CDN
Main
many
Manager
Storage
Large
Federation,
fog cloudsVM
Cache 1 Cache 2
Manage
content
CDN Traffic
(End Users)
many
Cloud
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 11/21
...
11/21

12. .
Service Model (2) Simplified
many
Large/Core
Small/Fog
Cloud(s)VM
Cache 1 Cache 2
many
Cloud
Original
Content
Scale (core to edge)
Local
traffic
End Users
Network
Provider
Replica
(P4P, etc.)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 12/21
...
12/21

13. .
Hotspot-y Input (1) Theory
0 20 40 60 80 100
Decreasing order
0
0.35
0.7
1.05
1.4
1.75
2.1
2.45
2.8
log(value)
Class A
Class B
Class C
Class D
Class E
• Hotspot Distribution 07:
normal + popular + hot/
flash items
• modeled as Dirichlet parallel
streams with Bread-Stick (BS)
random unit
• key point : number of hot
items, since they cause
Flash Events
07 M.Zhanikeev+1 "Popularity-Based Modeling of Flash Events in Synthetic Packet Traces" IEICE CQken (2012)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 13/21
...
13/21

14. .
Hotspot-y Input (2) Actual Model
0 10 20 30 40 50
Random order of items
0
0.4
0.8
1.2
1.6
2
2.4
2.8
3.2
3.6
log(1+popularity)
Hot state
Flash state
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 14/21
...
14/21

15. .
Caching Logic
• common logic in CDN 02: keep only the top-N popular content
• LHAP feature: the large Cache 2 range for for on-site (shared across VMs)
caching
◦ lazy caching -- new content is downloaded by individual VMs (Cache 1) but end up
in Cache 2 as well
Popularity
Ordered list (decreasing popularity)
Cache 1 Cache 2
Main (remote)
storage
02 S.Sivasubramanian+3 "Analysis of Caching and Replication Strategies for Web Applications" IEEE Internet Computing (2007)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 15/21
...
15/21

16. .
Analysis
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 16/21
...
16/21

17. .
Results
0.04 0.08 0.12 0.16 0.2
Cache 1 volume (ratio of total content)
3.85
3.95
4.05
4.15
4.25
4.35
4.45
log(transfercount)
0.05/0.1 0.05/0.25 0.1/0.2 0.1/0.4 0.2/0.4 0.2/1.0
0
2
4
6
8
10
12
14
16
18
Ratioofinner/outerfiletransfers
Cache configuration (Cache 1 / Cache2 ratios)
3 * variance
band
Pre-saturation
Total
saturation
Cache 1 at 0.1
Traditional
Performance
(Cache 2 does not exist)
Fog Caching
Performance
Inner = outer line
• simple view : proposed method
near-saturates at 0.1-to-0.2 ratio of
Caches 1-to-2
• vertical scales are different because the
effect is huge!
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 17/21
...
17/21

18. .
Wrapup : the Bigger Picture
• current LHAP prototypes are developed as an add-on on top of XCP1.6 (yum
helps with dependencies)
• working on in-VM APIs as a step towards Docker containers
Large
Cloud
Small
Cloud
Small
Cloud
CDN
Manager
CDN
Local clients
• load balancing in
heterogeneous clouds
• how heterogenous?
how about small
store-and-stream
cloudlets running on
wirelessly grouped car
navigators? (vehicular groupconnect in
other papers)
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 18/21
...
18/21

19. .
That’s all, thank you ...
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 19/21
...
19/21

20. .
LHAP vs MiniCache (details)
Local
hardware
VirtualMachine
Cloud
Platform
(Xen)
App
App
App
…
Multitenant
environment
Physical Machine (PM)
Tools
API
Layer
Control
Layer
Local
Hardware
Awareness
Platform
(LHAP)
…
VirtualMachine
App
Tools
…
VirtualMachine
App
VirtualMachine
App
App
App
…
Global network
(to Internet)
In-box
network
…
MiniOS
App
SSD
Operating
System
VirtualMachine
App
App
App
…
Multitenancy
impossible
Physical Machine (PM)
Cloud
Platform
(Xen)
Operating
System
Global network
(to Internet)
HDD
Local
Network
Global network
(to Internet)
Physical Machine (PM)
Cloud
Platform
(Xen)
Operating
System
DtL:
Direct to Local
Local
hardware
SSD
HDD
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 20/21
...
20/21

21. .
LHAP Boxes
• LHAP box feels equally at ease with
resources on LAN and those running
on VMs within the box itself
• working on the beacon and WiFi
Direct versions for IoT as well
Physical Device
LHAP
VM
VM
Con.Con.Con.
SWITCH
OUT IN
Storage
Sensors
Hadoop
Isolation
Non-CVP
part
Physical Device
LHAP
VM
VM
Con.Con.Con.
HUB
WiFi
Wireless users
Wired
users
Wireless
AP
Storage
Sensors
…
WiFi
Wireless users
Wireless
AP
Physical Device
LHAP
VM
VM
Con.Con.Con.
Storage
Sensors
…
Beacon
WiFi AP
WiFi Client
P2P WiFi
M.Zhanikeev -- maratishe@gmail.com Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 21/21
...
21/21