Here is a practical usecase. Your ISP wants to install a probe at your home to facilitate end-to-end active probing in the wild. The traditional way to do it is to create a custom machine, populate it with probing tools, fit it all into a small device and lend the box to end users. The problem is that software updates as well as upgrades of tools themselves imposes a major maintenance cost. This paper shows that if the box is designed as a small cloud platform, then maintenance cost can be mostly done away with. Instead, Virtual Machines -- packed with all the necessary software -- can visit with your box and leave when the job is done. The platform is an abstract buildup on top of a generic cloud platform and adds the necessary APIs for a wide range of possible jobs, hence the term visitation platform.

1. Virtual

2. .
.
Pre-Story: The First HomeBox
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
2 /23
2/23

3. .
.
The First HomeBox
ISP
NOC
…
Bigger
ISP
Bigger
ISP
• Router
• QoS Broker
• Meter
• L2 VLAN
• Shaping
• Policing
ISP
Network
ADSL router
Inside home
02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
End
user
3 /23
3/23

4. .
.
HomeBox: Early Usecases
• e2e probing, packet capture, L2/L3 QoS Policy Edge
2 devices
in 1 box
Probing tasks
Data to ISP
(1) Flow
(2) Probing
Mirror
traffic
Home Gateway
Box
meter
Probes
switch/mirror
02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013)
Marat Zhanikeev -- maratishe@gmail.com
Probing
methods
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
4 /23
4/23

5. .
.
HomeBox: The Actual Box
Home
network
Touch screen
interface
1G Hub
Internet
Router
Meter
02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
5 /23
5/23

6. .
.
HomeBox: Lessons Learned
too expensive! 2 boxes, twice the price
2. high maintenance cost
1.
◦ device is at home, firmware updates?
3.
higher flexibility is needed
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
6 /23
6/23

7. .
.
Briefly on Clouds
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
7 /23
7/23

8. .
.
Cloud Platforms
• let's forget about
*aaS terminology and focus on practice
TIER 1: Data Centers and Physical Machines (PMs) they house
• TIER 2: Virtualization Platform which turns PMs into VMs
•
◦ VM management software is required
◦ large systems can work across multiple data centers
◦ potentially across providers in federated clouds 06
S
•
TIER 3: Apps running on top of TIER 2
◦ some apps are platforms like heroku 04 -- see next page
◦ heroku is used as the main example throughout the slides 06
06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013)
04 C.Kemp+1 "Professional Heroku Programming" Wiley (2013)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
8 /23
8/23

9. .
.
Clouds: Multitenant Platforms
•
•
•
one VM, multiple APPs
heroku is arguably one of the biggest examples 06
the platform itself is TIER3, but creates anther tier for application running on top
of the platform
◦ warning: not a separate/new tier!
◦ heroku simply packages and runs user apps, there is no added virtualization per
se
•
multitenancy is a great idea -- one VM, many apps
◦ the proposal is based on the same very idea
06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
9 /23
9/23

10. .
.
Main Problems in Clouds
1.
vertical integration is preferred by businesses
◦ heroku is entirely based on Amazon's cloud
◦ when Amazon cloud breaks, heroku breaks
◦ major prolonged failure in June 2013
2.
e2e concept is effectively lost in the virtualization mesh/mess
◦ end users are not taken into consideration
◦ services do not care and e2e networks between themselves and user communities
3. cloud today is an extremely
reliability
centralized system -- very low
◦ pushing cloud to edges might help --
Marat Zhanikeev -- maratishe@gmail.com
cloud offload?
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
10 /23
10/23

11. .
.
How HomeBox Can Help
• e2e performance probing 01
◦ many existing projects of similar nature 09 10
◦ HomeBox can scale -- its main advantage
•
social computing
•
HomeBox Virtual (next) is one way to implement Internet of Things (IoT)
◦ applications from several users can visit with
◦ visit means share the same location
each other
• offload CPU, storage, etc. to client boxes on edges -- ideally homes
01 1+myself "Active Network Measurement: Theory, Methods and Tools" ITU Association of Japan (2009)
09
"MLab: Measurement Lab" http://www.measurementlab.net/ (2009)
10
"TTM: Test Traffic Measurement Service" http://www.ripe.net.ttm (1999)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
11 /23
11/23

12. .
.
CVP: Cloud Visitation Platform
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
12 /23
12/23

13. .
.
CVP: The Concept
Tier 1 Tier 2
Cloud APPs
…
Cloud Management
Platform(s )
Location 1
Marat Zhanikeev -- maratishe@gmail.com
Location 2 …
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
Cloud Visitation
Platforms
CVP needs to implement all the tiers in one device
Tier 3
• simply,
13 /23
13/23

14. .
.
CVP: Am I the First?
• apparently,
Cisco also had a similar...
Marat Zhanikeev -- maratishe@gmail.com
though very foggy... idea
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
14 /23
14/23

15. .
.
CVP: 3 Tiers, 1 Box
•
TEAR1: the device needs to implement a virtualization platform
◦ convert one PM into several VMs (one CPU core per VM)
◦ CVP is unique by having interfaces here
◦ CVP starts and ends here!
•
•
TEAR2: VMs need to be made multitenant
◦ a heroku-like container approach
◦ containers are unique by having special
beneath
default APIs supported by CVPs
TEAR3: APPs can be anything supported by the container
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
15 /23
15/23

16. .
.
CVP as HomeBox Virtual
•
step 1: implement the device
as a small cloud
step 2: make it possible to
run cloud apps on your
device
• that's all!
App
App
App
…
API
Multitenancy
…
API
Cloud Visitation Platform APIs
Storage
Marat Zhanikeev -- maratishe@gmail.com
App
App
App
…
Container
•
Container
Physical Device
Cloud Visitation Platform
Interfaces
Sensors
Misc. Devices
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
…
…
16 /23
16/23

17. .
.
CVP: Interfaces
• CVP apps would like to use
local resources
• CVP implements them as
Interfaces
• quotas, control, parallel access,
scheduling
• special-purpose devices are
possible -- sensors,
routers, etc.
Marat Zhanikeev -- maratishe@gmail.com
wifi
Physical Device
Cloud Visitation Platform
App
App
App
…
API
App
App
App
…
Container
warning: a new
part!
Container
•
Multitenancy
…
API
Cloud Visitation Platform APIs
Storage
Interfaces
Sensors
Misc. Devices
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
…
…
17 /23
17/23

18. .
.
CVP: Container APIs
App
App
App
…
API
Container
App
App
App
…
Container
Physical Device
Cloud Visitation Platform
•
Multitenancy
…
• heroku has API-less containers
•
APIs are for hardware
functions
API
• APPs can use APIs to access
Interfaces
• CVP provides
Cloud Visitation Platform APIs
Storage
warning: a new
part!
Sensors
Marat Zhanikeev -- maratishe@gmail.com
Misc. Devices
…
…
local hardware
special
containers and supports
APIs
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
18 /23
18/23

19. .
.
Example Use: E2E Probing
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
19 /23
19/23

20. .
.
Example: E2E Probing on CVP
e2e
probing scenario in the
• back to the
first box
•
pull-based
design -- apps are pulled
from device provider
◦
note: pull-based installation
is more feasible -higher security
• apps know which destinations
to probe to
Global
Network
Device
Provider
Global
Services
Pull-Based
Requests,
Installation
probes, etc.
Cloud Visitation Platform
App
App
App
…
◦ schedule, start time, end time,
kinds of probes, end of life,
etc.
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
20 /23
20/23

21. .
.
Example: Implementation
•
probing tools08 implemented as apps, then containers in CVP
• simple public containers are used 12
• current CVP is simply Zen's XCP cloud platform
◦ presented CVP design is in development
◦ will be announced soon
08
"e2eprobe: collection of probing tools" https://github.com/maratishe/e2eprobe (2013)
12
"Example heroku-like framework" https://github.com/progrium/dokku/ (2012)
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
21 /23
21/23

22. .
.
Wrapup
•
home devices are implemented as CVP: Cloud Visitation Platforms
hardware functionality is abstracted via interfaces and APIs
• simple example: CVP makes e2e probing possible in a totally new
•
way
◦ low maintenance
◦ high scalability
◦ total openness
•
major note: reliability of devices is completely different --
•
into the future: anything can be CVP
virtualization = isolation
◦ switching equipment, wifi routers, sensors, robots, digital libraries, ....
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
22 /23
22/23

23. .
.
That’s all, thank you ...
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
23 /23
23/23

24. .
.
[01] 1+myself (2009)
Active Network Measurement: Theory, Methods and Tools
ITU Association of Japan
[02] myself+0 (2013)
A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge
COMPSACW
[03] myself+1 (2012)
Analytical Models for L2 versus L3 QoS Provisioning
IEICE PN研
[04] C.Kemp+1 (2013)
Professional Heroku Programming
Wiley
[05] C.Dovrolis+4 (2010)
Measurement Lab: Overview and an Invitation...
ACM Comp. Comm. Review
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
23 /23
23/23

25. .
.
[06] K.He+5 (2013)
Next stop, the cloud: understanding modern web service deployment...
IMC
[07] IETF (2008)
Management of Performance Measurement for NGN
ITU-T Y.2173
[08]
(2013)
e2eprobe: collection of probing tools
https://github.com/maratishe/e2eprobe
[09]
(2009)
MLab: Measurement Lab
http://www.measurementlab.net/
[10]
(1999)
TTM: Test Traffic Measurement Service
http://www.ripe.net.ttm
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
23 /23
23/23

26. .
.
[11]
(2007)
ntop
http://www.ntop.org
[12]
(2012)
Example heroku-like framework
https://github.com/progrium/dokku/
Marat Zhanikeev -- maratishe@gmail.com
E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221
23 /23
23/23