E2E Services using Cloud Visitation Platforms

.

.

Pre-Story: The First HomeBox

Marat Zhanikeev -- maratishe@gmail.com

E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221

2 /23
2/23

.

.

The First HomeBox
ISP
NOC

…

Bigger
ISP

Bigger
ISP

• Router
• QoS Broker
• Meter

• L2 VLAN
• Shaping
• Policing

ISP
Network
ADSL router

Inside home

02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013)


End
user

3 /23
3/23

.

.

HomeBox: Early Usecases
• e2e probing, packet capture, L2/L3 QoS Policy Edge
2 devices
in 1 box

Probing tasks
Data to ISP
(1) Flow
(2) Probing
Mirror
traﬃc

Home Gateway
Box

meter

Probes

switch/mirror


Probing
methods


4 /23
4/23

.

.

HomeBox: The Actual Box
Home
network

Touch screen
interface

1G Hub

Internet

Router

Meter



5 /23
5/23

.

.

HomeBox: Lessons Learned
too expensive! 2 boxes, twice the price
2. high maintenance cost
1.

◦ device is at home, firmware updates?

3.

higher flexibility is needed



6 /23
6/23

.

.

Briefly on Clouds



7 /23
7/23

.

.

Cloud Platforms
• let's forget about

*aaS terminology and focus on practice

TIER 1: Data Centers and Physical Machines (PMs) they house
• TIER 2: Virtualization Platform which turns PMs into VMs
•

◦ VM management software is required
◦ large systems can work across multiple data centers
◦ potentially across providers in federated clouds 06

S
•

TIER 3: Apps running on top of TIER 2

◦ some apps are platforms like heroku 04 -- see next page
◦ heroku is used as the main example throughout the slides 06

06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013)
04 C.Kemp+1 "Professional Heroku Programming" Wiley (2013)


8 /23
8/23

.

.

Clouds: Multitenant Platforms
•
•
•

one VM, multiple APPs
heroku is arguably one of the biggest examples 06
the platform itself is TIER3, but creates anther tier for application running on top
of the platform
◦ warning: not a separate/new tier!
◦ heroku simply packages and runs user apps, there is no added virtualization per
se

•

multitenancy is a great idea -- one VM, many apps
◦ the proposal is based on the same very idea

06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013)


9 /23
9/23

.

.

Main Problems in Clouds
1.

vertical integration is preferred by businesses
◦ heroku is entirely based on Amazon's cloud
◦ when Amazon cloud breaks, heroku breaks
◦ major prolonged failure in June 2013

2.

e2e concept is effectively lost in the virtualization mesh/mess
◦ end users are not taken into consideration
◦ services do not care and e2e networks between themselves and user communities

3. cloud today is an extremely
reliability

centralized system -- very low

◦ pushing cloud to edges might help --


cloud offload?


10 /23
10/23

.

.

How HomeBox Can Help
• e2e performance probing 01
◦ many existing projects of similar nature 09 10
◦ HomeBox can scale -- its main advantage
•

social computing

•

HomeBox Virtual (next) is one way to implement Internet of Things (IoT)

◦ applications from several users can visit with
◦ visit means share the same location

each other

• offload CPU, storage, etc. to client boxes on edges -- ideally homes

01 1+myself "Active Network Measurement: Theory, Methods and Tools" ITU Association of Japan (2009)
09

"MLab: Measurement Lab" http://www.measurementlab.net/ (2009)

10

"TTM: Test Traffic Measurement Service" http://www.ripe.net.ttm (1999)



11 /23
11/23

.

.

CVP: Cloud Visitation Platform



12 /23
12/23

.

.

CVP: The Concept

Tier 1 Tier 2

Cloud APPs

…

Cloud Management
Platform(s )
Location 1


Location 2 …


Cloud Visitation
Platforms

CVP needs to implement all the tiers in one device

Tier 3

• simply,

13 /23
13/23

.

.

CVP: Am I the First?
• apparently,

Cisco also had a similar...


though very foggy... idea


14 /23
14/23

.

.

CVP: 3 Tiers, 1 Box
•

TEAR1: the device needs to implement a virtualization platform
◦ convert one PM into several VMs (one CPU core per VM)
◦ CVP is unique by having interfaces here
◦ CVP starts and ends here!

•

•

TEAR2: VMs need to be made multitenant
◦ a heroku-like container approach
◦ containers are unique by having special
beneath

default APIs supported by CVPs

TEAR3: APPs can be anything supported by the container



15 /23
15/23

.

.

CVP as HomeBox Virtual

•

step 1: implement the device
as a small cloud
step 2: make it possible to
run cloud apps on your
device

• that's all!

App
App
App
…

API

Multitenancy
…

API

Cloud Visitation Platform APIs

Storage


App
App
App
…

Container

•

Container

Physical Device
Cloud Visitation Platform

Interfaces

Sensors

Misc. Devices


…

…

16 /23
16/23

.

.

CVP: Interfaces
• CVP apps would like to use

local resources

• CVP implements them as

Interfaces

• quotas, control, parallel access,

scheduling
• special-purpose devices are

possible -- sensors,
routers, etc.


wifi

Physical Device
App
App
App
…

API

App
App
App
…

Container

warning: a new
part!

Container

•

Multitenancy
…

API


Storage

Interfaces

Sensors

Misc. Devices


…

…

17 /23
17/23

.

.

CVP: Container APIs
App
App
App
…

API

Container

App
App
App
…

Container

Physical Device

•
Multitenancy
…

• heroku has API-less containers
•

APIs are for hardware

functions

API

• APPs can use APIs to access

Interfaces

• CVP provides


Storage

warning: a new
part!

Sensors


Misc. Devices

…

…

local hardware
special
containers and supports

APIs


18 /23
18/23

.

.

Example Use: E2E Probing



19 /23
19/23

.

.

Example: E2E Probing on CVP
e2e
probing scenario in the

• back to the

first box
•

pull-based
design -- apps are pulled
from device provider
◦

note: pull-based installation
is more feasible -higher security

• apps know which destinations

to probe to

Global
Network

Device
Provider

Global
Services

Pull-Based
Requests,
Installation
probes, etc.
App

App

App

…

◦ schedule, start time, end time,
kinds of probes, end of life,
etc.


20 /23
20/23

.

.

Example: Implementation
•

probing tools08 implemented as apps, then containers in CVP

• simple public containers are used 12
• current CVP is simply Zen's XCP cloud platform
◦ presented CVP design is in development
◦ will be announced soon

08

"e2eprobe: collection of probing tools" https://github.com/maratishe/e2eprobe (2013)

12

"Example heroku-like framework" https://github.com/progrium/dokku/ (2012)



21 /23
21/23

.

.

Wrapup
•

home devices are implemented as CVP: Cloud Visitation Platforms

hardware functionality is abstracted via interfaces and APIs
• simple example: CVP makes e2e probing possible in a totally new
•

way

◦ low maintenance
◦ high scalability
◦ total openness
•

major note: reliability of devices is completely different --

•

into the future: anything can be CVP

virtualization = isolation

◦ switching equipment, wifi routers, sensors, robots, digital libraries, ....



22 /23
22/23

.

.

That’s all, thank you ...



23 /23
23/23

.

.

[01] 1+myself (2009)
Active Network Measurement: Theory, Methods and Tools
ITU Association of Japan
[02] myself+0 (2013)
A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge
COMPSACW
[03] myself+1 (2012)
Analytical Models for L2 versus L3 QoS Provisioning
IEICE PN研
[04] C.Kemp+1 (2013)
Professional Heroku Programming
Wiley
[05] C.Dovrolis+4 (2010)
Measurement Lab: Overview and an Invitation...
ACM Comp. Comm. Review


23 /23
23/23

.

.

[06] K.He+5 (2013)
Next stop, the cloud: understanding modern web service deployment...
IMC
[07] IETF (2008)
Management of Performance Measurement for NGN
ITU-T Y.2173
[08]

(2013)
e2eprobe: collection of probing tools
https://github.com/maratishe/e2eprobe

[09]

(2009)
MLab: Measurement Lab
http://www.measurementlab.net/

[10]

(1999)
TTM: Test Traffic Measurement Service
http://www.ripe.net.ttm



23 /23
23/23

.

.

[11]

(2007)
ntop
http://www.ntop.org

[12]

(2012)
Example heroku-like framework
https://github.com/progrium/dokku/



23 /23
23/23

E2E Services using Cloud Visitation Platforms

More Related Content

What's hot

Viewers also liked

Similar to E2E Services using Cloud Visitation Platforms

More from Tokyo University of Science

Recently uploaded

E2E Services using Cloud Visitation Platforms