Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

E2E Services using Cloud Visitation Platforms

487 views

Published on

Here is a practical usecase. Your ISP wants to install a probe at your home to facilitate end-to-end active probing in the wild. The traditional way to do it is to create a custom machine, populate it with probing tools, fit it all into a small device and lend the box to end users. The problem is that software updates as well as upgrades of tools themselves imposes a major maintenance cost. This paper shows that if the box is designed as a small cloud platform, then maintenance cost can be mostly done away with. Instead, Virtual Machines -- packed with all the necessary software -- can visit with your box and leave when the job is done. The platform is an abstract buildup on top of a generic cloud platform and adds the necessary APIs for a wide range of possible jobs, hence the term visitation platform.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

E2E Services using Cloud Visitation Platforms

  1. 1. Virtual
  2. 2. . . Pre-Story: The First HomeBox Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 2 /23 2/23
  3. 3. . . The First HomeBox ISP NOC … Bigger ISP Bigger ISP • Router • QoS Broker • Meter • L2 VLAN • Shaping • Policing ISP Network ADSL router Inside home 02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 End user 3 /23 3/23
  4. 4. . . HomeBox: Early Usecases • e2e probing, packet capture, L2/L3 QoS Policy Edge 2 devices in 1 box Probing tasks Data to ISP (1) Flow (2) Probing Mirror traffic Home Gateway Box meter Probes switch/mirror 02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013) Marat Zhanikeev -- maratishe@gmail.com Probing methods E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 4 /23 4/23
  5. 5. . . HomeBox: The Actual Box Home network Touch screen interface 1G Hub Internet Router Meter 02 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" COMPSACW (2013) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 5 /23 5/23
  6. 6. . . HomeBox: Lessons Learned too expensive! 2 boxes, twice the price 2. high maintenance cost 1. ◦ device is at home, firmware updates? 3. higher flexibility is needed Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 6 /23 6/23
  7. 7. . . Briefly on Clouds Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 7 /23 7/23
  8. 8. . . Cloud Platforms • let's forget about *aaS terminology and focus on practice TIER 1: Data Centers and Physical Machines (PMs) they house • TIER 2: Virtualization Platform which turns PMs into VMs • ◦ VM management software is required ◦ large systems can work across multiple data centers ◦ potentially across providers in federated clouds 06 S • TIER 3: Apps running on top of TIER 2 ◦ some apps are platforms like heroku 04 -- see next page ◦ heroku is used as the main example throughout the slides 06 06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013) 04 C.Kemp+1 "Professional Heroku Programming" Wiley (2013) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 8 /23 8/23
  9. 9. . . Clouds: Multitenant Platforms • • • one VM, multiple APPs heroku is arguably one of the biggest examples 06 the platform itself is TIER3, but creates anther tier for application running on top of the platform ◦ warning: not a separate/new tier! ◦ heroku simply packages and runs user apps, there is no added virtualization per se • multitenancy is a great idea -- one VM, many apps ◦ the proposal is based on the same very idea 06 K.He+5 "Next stop, the cloud: understanding modern web service deployment..." IMC (2013) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 9 /23 9/23
  10. 10. . . Main Problems in Clouds 1. vertical integration is preferred by businesses ◦ heroku is entirely based on Amazon's cloud ◦ when Amazon cloud breaks, heroku breaks ◦ major prolonged failure in June 2013 2. e2e concept is effectively lost in the virtualization mesh/mess ◦ end users are not taken into consideration ◦ services do not care and e2e networks between themselves and user communities 3. cloud today is an extremely reliability centralized system -- very low ◦ pushing cloud to edges might help -- Marat Zhanikeev -- maratishe@gmail.com cloud offload? E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 10 /23 10/23
  11. 11. . . How HomeBox Can Help • e2e performance probing 01 ◦ many existing projects of similar nature 09 10 ◦ HomeBox can scale -- its main advantage • social computing • HomeBox Virtual (next) is one way to implement Internet of Things (IoT) ◦ applications from several users can visit with ◦ visit means share the same location each other • offload CPU, storage, etc. to client boxes on edges -- ideally homes 01 1+myself "Active Network Measurement: Theory, Methods and Tools" ITU Association of Japan (2009) 09 "MLab: Measurement Lab" http://www.measurementlab.net/ (2009) 10 "TTM: Test Traffic Measurement Service" http://www.ripe.net.ttm (1999) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 11 /23 11/23
  12. 12. . . CVP: Cloud Visitation Platform Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 12 /23 12/23
  13. 13. . . CVP: The Concept Tier 1 Tier 2 Cloud APPs … Cloud Management Platform(s ) Location 1 Marat Zhanikeev -- maratishe@gmail.com Location 2 … E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 Cloud Visitation Platforms CVP needs to implement all the tiers in one device Tier 3 • simply, 13 /23 13/23
  14. 14. . . CVP: Am I the First? • apparently, Cisco also had a similar... Marat Zhanikeev -- maratishe@gmail.com though very foggy... idea E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 14 /23 14/23
  15. 15. . . CVP: 3 Tiers, 1 Box • TEAR1: the device needs to implement a virtualization platform ◦ convert one PM into several VMs (one CPU core per VM) ◦ CVP is unique by having interfaces here ◦ CVP starts and ends here! • • TEAR2: VMs need to be made multitenant ◦ a heroku-like container approach ◦ containers are unique by having special beneath default APIs supported by CVPs TEAR3: APPs can be anything supported by the container Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 15 /23 15/23
  16. 16. . . CVP as HomeBox Virtual • step 1: implement the device as a small cloud step 2: make it possible to run cloud apps on your device • that's all! App App App … API Multitenancy … API Cloud Visitation Platform APIs Storage Marat Zhanikeev -- maratishe@gmail.com App App App … Container • Container Physical Device Cloud Visitation Platform Interfaces Sensors Misc. Devices E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 … … 16 /23 16/23
  17. 17. . . CVP: Interfaces • CVP apps would like to use local resources • CVP implements them as Interfaces • quotas, control, parallel access, scheduling • special-purpose devices are possible -- sensors, routers, etc. Marat Zhanikeev -- maratishe@gmail.com wifi Physical Device Cloud Visitation Platform App App App … API App App App … Container warning: a new part! Container • Multitenancy … API Cloud Visitation Platform APIs Storage Interfaces Sensors Misc. Devices E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 … … 17 /23 17/23
  18. 18. . . CVP: Container APIs App App App … API Container App App App … Container Physical Device Cloud Visitation Platform • Multitenancy … • heroku has API-less containers • APIs are for hardware functions API • APPs can use APIs to access Interfaces • CVP provides Cloud Visitation Platform APIs Storage warning: a new part! Sensors Marat Zhanikeev -- maratishe@gmail.com Misc. Devices … … local hardware special containers and supports APIs E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 18 /23 18/23
  19. 19. . . Example Use: E2E Probing Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 19 /23 19/23
  20. 20. . . Example: E2E Probing on CVP e2e probing scenario in the • back to the first box • pull-based design -- apps are pulled from device provider ◦ note: pull-based installation is more feasible -higher security • apps know which destinations to probe to Global Network Device Provider Global Services Pull-Based Requests, Installation probes, etc. Cloud Visitation Platform App App App … ◦ schedule, start time, end time, kinds of probes, end of life, etc. Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 20 /23 20/23
  21. 21. . . Example: Implementation • probing tools08 implemented as apps, then containers in CVP • simple public containers are used 12 • current CVP is simply Zen's XCP cloud platform ◦ presented CVP design is in development ◦ will be announced soon 08 "e2eprobe: collection of probing tools" https://github.com/maratishe/e2eprobe (2013) 12 "Example heroku-like framework" https://github.com/progrium/dokku/ (2012) Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 21 /23 21/23
  22. 22. . . Wrapup • home devices are implemented as CVP: Cloud Visitation Platforms hardware functionality is abstracted via interfaces and APIs • simple example: CVP makes e2e probing possible in a totally new • way ◦ low maintenance ◦ high scalability ◦ total openness • major note: reliability of devices is completely different -- • into the future: anything can be CVP virtualization = isolation ◦ switching equipment, wifi routers, sensors, robots, digital libraries, .... Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 22 /23 22/23
  23. 23. . . That’s all, thank you ... Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 23 /23 23/23
  24. 24. . . [01] 1+myself (2009) Active Network Measurement: Theory, Methods and Tools ITU Association of Japan [02] myself+0 (2013) A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge COMPSACW [03] myself+1 (2012) Analytical Models for L2 versus L3 QoS Provisioning IEICE PN研 [04] C.Kemp+1 (2013) Professional Heroku Programming Wiley [05] C.Dovrolis+4 (2010) Measurement Lab: Overview and an Invitation... ACM Comp. Comm. Review Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 23 /23 23/23
  25. 25. . . [06] K.He+5 (2013) Next stop, the cloud: understanding modern web service deployment... IMC [07] IETF (2008) Management of Performance Measurement for NGN ITU-T Y.2173 [08] (2013) e2eprobe: collection of probing tools https://github.com/maratishe/e2eprobe [09] (2009) MLab: Measurement Lab http://www.measurementlab.net/ [10] (1999) TTM: Test Traffic Measurement Service http://www.ripe.net.ttm Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 23 /23 23/23
  26. 26. . . [11] (2007) ntop http://www.ntop.org [12] (2012) Example heroku-like framework https://github.com/progrium/dokku/ Marat Zhanikeev -- maratishe@gmail.com E2E Services using Cloud Visitation Platforms -- http://tinyurl.com/marat140221 23 /23 23/23

×