Software-Defined Approach for QoS and Data Quality in Multi-Tenant Clouds

424 views

Published on

My presentation at The 2nd Portugal|UT Austin summer school in systems and networking and
EMJD-DC spring event 2016
June 3, 2016. Costa da Caparica, Portugal describing my thesis work

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
424
On SlideShare
0
From Embeds
0
Number of Embeds
163
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Software-Defined Approach for QoS and Data Quality in Multi-Tenant Clouds

  1. 1. Software-Defined Approach for QoS and Data Quality in Multi-Tenant Clouds The 2nd Portugal|UT Austin summer school in systems and networking and EMJD-DC spring event 2016 June 3, 2016. Costa da Caparica, Portugal. Pradeeban Kathiravelu+x* , Luís Veiga+x x Distributed Systems Group, INESC-ID Lisboa + Instituto Superior Técnico, Universidade de Lisboa, Portugal * Emory University, Atlanta, GA, USA. 1
  2. 2. ❖ Tenants assume various roles in the enterprise data center networks. ➢ Differentiated Quality of Service (QoS). ➢ Data quality assurance. ➢ Isolation guarantees. 2Introduction
  3. 3. ❖ Efficiency and Accuracy 3
  4. 4. WARNING: Work-in-Progress 4
  5. 5. WARNING: Work-in-Progress PhD Start: September, 2014 Expected Defence: September, 2018 5
  6. 6. ❖ Data storage and execution 6
  7. 7. ❖ Distributed vs. ❖ Centralized 7
  8. 8. ❖ Distributed Horizontal scalability 8
  9. 9. ❖ Centralized Management efficiency. Accuracy. 9
  10. 10. ❖ Distributed Software-Defined Networking ❖ Centralized 10
  11. 11. Software-Defined Networking System s 11
  12. 12. ❖ Global view of the entire data center network ❖ A logically centralized controller 12
  13. 13. 13
  14. 14. Our Approach ❖ Software-Defined Networking (SDN) ❖ SDN Northbound - Message-Oriented Middleware ❖ Scalable and Very Large Scale Data and Deployments ❖ Modular Architecture -> Reusable 14
  15. 15. 15
  16. 16. 1. Distributed Execution: QoS and Data Quality 2. SDN Systems: SDN with Message-Oriented Middleware 3. SDN Simulations and Emulations 16 Contributions & Research Directions =>
  17. 17. 1. Distributed Execution: QoS and Data Quality 2. SDN Systems: SDN with Message-Oriented Middleware 3. SDN Simulations and Emulations 17 Contributions & Research Directions =>
  18. 18. 18 ∂u∂u Multi-Tenanted Framework: Distributed Near Duplicate Detection for Big Data 23rd International Conference on Cooperative Information Systems (CoopIS 2015) 28-30 October 2015, Rhodes, Greece. CoopIS 2015 Pradeeban Kathiravelu, Helena Galhardas, Luís Veiga INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal [1.1]
  19. 19. 19
  20. 20. 20
  21. 21. 21 MEDIator: A Data Sharing Synchronization Platform for Heterogeneous Medical Image Archives [1.2]
  22. 22. 1. Distributed Execution: QoS and Data Quality 2. SDN Systems: SDN with Message-Oriented Middleware 3. SDN Simulations and Emulations 22 Contributions & Research Directions =>
  23. 23. 23 CHIEF: Controller Farm for Clouds of Software-Defined Community Networks [2.1]
  24. 24. 24 Building Blocks of Mayan: Componentizing the eScience Workflows Through Software-Defined Service Composition 23rd IEEE International Conference on Web Services June 27 - July 2, 2016, San Francisco, USA IEEE ICWS 2016 Pradeeban Kathiravelu+ , Tihana Galinac Grbac* , Luís Veiga+ + INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal * University of Rijeka, Croatia [2.2]
  25. 25. ❖ Adaptive execution of scientific workflows ❖ More efficient and diverse service composition ❖ Very large-scale and reliable. ➢ Find and consume the current best-fit ➢ Among the multiple implementations or deployments of the same service. 25
  26. 26. ❖ Each execution component in the workflow: Building Block of Mayan 26
  27. 27. 27
  28. 28. 28
  29. 29. 29
  30. 30. <Service3,(<Service1, Input1>, <Service2, Input2>)> 30
  31. 31. Speed up of a data warehousing workflow: ❖ Near duplicate detection -> Data cleaning -> Write to the warehouse ❖ Data sets from TCIA* and synthetic data * Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository, Journal of Digital Imaging, Volume 26, Number 6, December, 2013, pp 1045-1057. 31
  32. 32. 32
  33. 33. 33 Cassowary: Middleware Platform for Context-Aware Smart Buildings with Software-Defined Sensor Networks [2.3]
  34. 34. 1. Distributed Execution: QoS and Data Quality 2. SDN Systems: SDN with Message-Oriented Middleware 3. SDN Simulations and Emulations 34 Contributions & Research Directions =>
  35. 35. 35 SENDIM for Incremental Development of Cloud Networks: Simulation, Emulation & Deployment Integration Middleware [3.1]
  36. 36. Summary ❖ SDN and Message-Oriented Middleware ❖ Quality of Service and Data Quality ❖ Modular Architecture -> Reusability ❖ Building Blocks of Mayan 36
  37. 37. Conclusion ❖ We can scale smarter 37
  38. 38. Conclusion ❖ We can scale smarter ❖ We can manage better 38
  39. 39. Conclusion ❖ We can scale smarter ❖ We can manage better ❖ We can do more 39
  40. 40. Recent Publications 40
  41. 41. [1] Distributed Execution: QoS and Data Quality 1. Kathiravelu, P., Galhardas, H., & Veiga, L. (2015). ∂u∂u Multi-Tenanted Framework: Distributed Near Duplicate Detection for Big Data. In 23 rd International Conference on Cooperative Information Systems (CoopIS 2015) (Acceptance Rate: 20%). On the Move to Meaningful Internet Systems: OTM 2015 Conferences, pp. 237-256. Springer International Publishing, Oct. 2015. http://doi.org/10.1007/978-3-319-26148-5_14 2. Kathiravelu, P. & Sharma, A. (2015). MEDIator: A Data Sharing Synchronization Platform for Heterogeneous Medical Image Archives. In Workshop on Connected Health at Big Data Era (BigCHat'15) , co-located with 21 st ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2015). Aug. 2015. ACM. 6 pages. http: //doi.org/10.13140/RG.2.1.3709.4248 41
  42. 42. [2] SDN Systems: SDN with Message-Oriented Middleware 1. Kathiravelu, P., Grbac, T.G., & Veiga, L. (2016). Building Blocks of Mayan: Componentizing the eScience Workflows Through Software-Defined Service Composition. In 23rd IEEE International Conference on Web Services (ICWS 2016). June 2016. 8 pages. To appear. 2. Kathiravelu, P. & Veiga, L. (2016). CHIEF: Controller Farm for Clouds of Software-Defined Community Networks. In 3rd IEEE International Symposium on Software Defined Systems (SDS-2016). Apr. 2016. pp. 1 – 6. 42
  43. 43. 3. Kathiravelu, P., Sharifi, L., & Veiga, L. (2015). Cassowary: Middleware Platform for Context-Aware Smart Buildings with Software-Defined Sensor Networks. In 2nd Workshop on Middleware for Context-Aware Applications in the IoT (M4IOT 2015), co-located with ACM/USENIX/IFIP Middleware 2015. Dec. 2015. ACM. pp. 1 – 6. http://doi.org/10.1145/2836127.2836132 4. Kathiravelu, P., Grbac, T.G, & Veiga, L. (2016). A FIRM Approach to Software-Defined Service Composition. In MIPRO 2016 - 39th International Convention on Telecommunications & Information (CTI). 43
  44. 44. [3] SDN Simulations and Emulations 1. Kathiravelu, P. & Veiga, L. (2016). SENDIM for Incremental Development of Cloud Networks: Simulation, Emulation & Deployment Integration Middleware. In IEEE International Conference on Cloud Engineering (IC2E 2016). Apr. 2016. pp. 143 – 146. 44
  45. 45. Doctoral Symposiums 1. Kathiravelu, P. (2016). Software-Defined Networking-Based Enhancements to Data Quality and QoS in Multi- Tenanted Data Center Clouds. In IEEE International Conference on Cloud Engineering (IC2E 2016) Doctoral Symposium. Apr. 2016. pp. 201 – 203. 45
  46. 46. Acknowledgements ❖ Erasmus Mundus Joint Doctorate in Distributed Computing (EMJD-DC) ❖ Google Summer of Code ❖ Prof. Ashish Sharma, Emory University, USA ❖ Prof. Helena Galhardas, IST, Portugal ❖ Prof. Tihana Galinac Grbac, University of Rijeka, Croatia ❖ COST action 1304 Autonomous Control for a Reliable Internet of Services (ACROSS) ❖ The OpenDaylight Foundation ❖ Ed Warnicke, Cisco, OpenDaylight TSC 46
  47. 47. Thank you! 47
  48. 48. To discuss more about OpenDaylight: OpenDaylight Lisboa Meetups. :) http://www.meetup.com/OpenDaylight-Lisbon/ 48 Announcement ;)
  49. 49. Questions? ❖ We can scale smarter ❖ We can manage better ❖ We can do more kk.pradeeban@gmail.com 49

×