Pradeeban Kathiravelu
(INESC-ID/IST ULisboa, Portugal and UCLouvain, Belgium)
Supervised By: Prof. Lu s Veiga (INESC-ID/IST ULisboa)ıı
Prof. Marco Canini (KAUST)
Prof. Peter Van Roy (UCLouvain)
Software-Defined Inter-Cloud
Composition of Big Services
EMJD-DC Spring Event, Brussels
May 30, 2017
2/12
Introduction
● Big services with complex workloads.
– Geographically distributed big data.
– Resource availabilities at remote locations; for example,
● Distributed clouds.
● Volunteer computing.
● Edge computing.
● Service Level Agreements (SLAs) in multi-tenant clouds.
3/12
Challenges
● Big services in multi-tenant environments.
– Differentiated QoS in cloud networks.
● Can we discriminate the services with
redundancy in data and execution paths?
4/12
Motivation
● Componentize Big Services in the Internet.
● Efficient network-aware composition and execution
of big services.
5/12
Contributions
● An inter-cloud framework to componentize and compose
big services.
– Execute them as a network-aware distributed
service composition.
– Modelling, Scalability, and orchestration.
● Use the current best-fit execution path.
– Web services and microservices as the
building blocks of the big services.
6/12
Approach
● Network-level guarantees based on
application/service-level inputs.
– Synergy of services with network.
7/12
Mayan (Componentizing Big Services)
● A scalable resilient framework for inter-domain
big service execution.
8/12
Prototype Assessments
● Increased QoS and Speedup.
– Performance growth =
f(problem size, workflow as services).
● Network-aware scalability and distribution.
● Minimize communication and coordination overheads.
9/12
Conclusion● Summary
– Synergy of network and service level properties in big service
execution.
– Componentizing big services and execute as service compositions.
– Scalability and resilience for multi-tenant distributed clouds.
– A federated controller deployment to orchestrate inter-cloud networks.
● Future Work
– Leverage cloud providers for differentiated connectivity.
– Big Services to the Edge.
10/12
Publications (Since 2016 Spring Event)
Book Chapter
● Kathiravelu, P. & Veiga, L. (2017). SDN helps
other Vs in Big Data. Chapter of Big Data and
Software Defined Networks. Sep. 2017. 21 pages.
(Camera-ready copy submitted).
11/12
Conference Proceedings
● Kathiravelu, P. & Veiga, L. (2017). SD-CPS: Taming the Challenges of Cyber-Physical Systems with a Software-
Defined Approach. In The 4th International Conference on Software Defined Systems (SDS-2017). May 2017. 8
pages. To Appear.
● Kathiravelu, P. & Veiga, L. (2017). SDN Middlebox Architecture for Resilient Transfers. In 15th IFIP/IEEE International
Symposium on Integrated Network Management (IM 2017), May 2017. 4 pages. To Appear.
● Kathiravelu, P. & Veiga, L. (2016). Software-Defined Simulations for Continuous Development of Cloud and Data
Center Networks. In 24 th International Conference on Cooperative Information Systems (CoopIS 2016). On the
Move to Meaningful Internet Systems: OTM 2016 Conferences, pp. 3 – 23. Springer International Publishing, Oct.
2016.
● Kathiravelu, P., & Veiga, L. (2016). Selective Redundancy in Network-as-a-Service: Differentiated QoS in Multi-
tenant Clouds. In OTM Confederated International Conferences. On the Move to Meaningful Internet Systems (pp.
87-97). EI2N 2016. Springer, Cham.
● Kathiravelu, P. & Sharma, A. (2016). A Dynamic Data Warehousing Platform for Creating and Accessing Biomedical
Data Lakes. In 2nd International Workshop on Data Management and Analytics for Medicine and Healthcare
(DMAH'16), co-located with 42 nd International Conference on Very Large Data Bases. Sep. 2016. LNCS. pp. 101 –
120.
● Caixinha, D., Kathiravelu, P. & Veiga, L. (2016). ViTeNA: An SDN-Based Virtual Network Embedding Algorithm for
Multi-Tenant Data Centers. In 15 th IEEE International Symposium on Network Computing and Applications (NCA
2016), Oct. 2016. pp. 140 – 147.
12/12
Conference Proceedings
● Kathiravelu, P. & Veiga, L. (2017). SD-CPS: Taming the Challenges of Cyber-Physical Systems with a Software-
Defined Approach. In The 4th International Conference on Software Defined Systems (SDS-2017). May 2017. 8
pages. To Appear.
● Kathiravelu, P. & Veiga, L. (2017). SDN Middlebox Architecture for Resilient Transfers. In 15th IFIP/IEEE International
Symposium on Integrated Network Management (IM 2017), May 2017. 4 pages. To Appear.
● Kathiravelu, P. & Veiga, L. (2016). Software-Defined Simulations for Continuous Development of Cloud and Data
Center Networks. In 24 th International Conference on Cooperative Information Systems (CoopIS 2016). On the
Move to Meaningful Internet Systems: OTM 2016 Conferences, pp. 3 – 23. Springer International Publishing, Oct.
2016.
● Kathiravelu, P., & Veiga, L. (2016). Selective Redundancy in Network-as-a-Service: Differentiated QoS in Multi-
tenant Clouds. In OTM Confederated International Conferences. On the Move to Meaningful Internet Systems (pp.
87-97). EI2N 2016. Springer, Cham.
● Kathiravelu, P. & Sharma, A. (2016). A Dynamic Data Warehousing Platform for Creating and Accessing Biomedical
Data Lakes. In 2nd International Workshop on Data Management and Analytics for Medicine and Healthcare
(DMAH'16), co-located with 42 nd International Conference on Very Large Data Bases. Sep. 2016. LNCS. pp. 101 –
120.
● Caixinha, D., Kathiravelu, P. & Veiga, L. (2016). ViTeNA: An SDN-Based Virtual Network Embedding Algorithm for
Multi-Tenant Data Centers. In 15 th IEEE International Symposium on Network Computing and Applications (NCA
2016), Oct. 2016. pp. 140 – 147.
Thank you.
Questions?
13/12
Announcement!
● Please join the Erasmus Mundus Association
– em-a.eu

Software-Defined Inter-Cloud Composition of Big Services

  • 1.
    Pradeeban Kathiravelu (INESC-ID/IST ULisboa,Portugal and UCLouvain, Belgium) Supervised By: Prof. Lu s Veiga (INESC-ID/IST ULisboa)ıı Prof. Marco Canini (KAUST) Prof. Peter Van Roy (UCLouvain) Software-Defined Inter-Cloud Composition of Big Services EMJD-DC Spring Event, Brussels May 30, 2017
  • 2.
    2/12 Introduction ● Big serviceswith complex workloads. – Geographically distributed big data. – Resource availabilities at remote locations; for example, ● Distributed clouds. ● Volunteer computing. ● Edge computing. ● Service Level Agreements (SLAs) in multi-tenant clouds.
  • 3.
    3/12 Challenges ● Big servicesin multi-tenant environments. – Differentiated QoS in cloud networks. ● Can we discriminate the services with redundancy in data and execution paths?
  • 4.
    4/12 Motivation ● Componentize BigServices in the Internet. ● Efficient network-aware composition and execution of big services.
  • 5.
    5/12 Contributions ● An inter-cloudframework to componentize and compose big services. – Execute them as a network-aware distributed service composition. – Modelling, Scalability, and orchestration. ● Use the current best-fit execution path. – Web services and microservices as the building blocks of the big services.
  • 6.
    6/12 Approach ● Network-level guaranteesbased on application/service-level inputs. – Synergy of services with network.
  • 7.
    7/12 Mayan (Componentizing BigServices) ● A scalable resilient framework for inter-domain big service execution.
  • 8.
    8/12 Prototype Assessments ● IncreasedQoS and Speedup. – Performance growth = f(problem size, workflow as services). ● Network-aware scalability and distribution. ● Minimize communication and coordination overheads.
  • 9.
    9/12 Conclusion● Summary – Synergyof network and service level properties in big service execution. – Componentizing big services and execute as service compositions. – Scalability and resilience for multi-tenant distributed clouds. – A federated controller deployment to orchestrate inter-cloud networks. ● Future Work – Leverage cloud providers for differentiated connectivity. – Big Services to the Edge.
  • 10.
    10/12 Publications (Since 2016Spring Event) Book Chapter ● Kathiravelu, P. & Veiga, L. (2017). SDN helps other Vs in Big Data. Chapter of Big Data and Software Defined Networks. Sep. 2017. 21 pages. (Camera-ready copy submitted).
  • 11.
    11/12 Conference Proceedings ● Kathiravelu,P. & Veiga, L. (2017). SD-CPS: Taming the Challenges of Cyber-Physical Systems with a Software- Defined Approach. In The 4th International Conference on Software Defined Systems (SDS-2017). May 2017. 8 pages. To Appear. ● Kathiravelu, P. & Veiga, L. (2017). SDN Middlebox Architecture for Resilient Transfers. In 15th IFIP/IEEE International Symposium on Integrated Network Management (IM 2017), May 2017. 4 pages. To Appear. ● Kathiravelu, P. & Veiga, L. (2016). Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks. In 24 th International Conference on Cooperative Information Systems (CoopIS 2016). On the Move to Meaningful Internet Systems: OTM 2016 Conferences, pp. 3 – 23. Springer International Publishing, Oct. 2016. ● Kathiravelu, P., & Veiga, L. (2016). Selective Redundancy in Network-as-a-Service: Differentiated QoS in Multi- tenant Clouds. In OTM Confederated International Conferences. On the Move to Meaningful Internet Systems (pp. 87-97). EI2N 2016. Springer, Cham. ● Kathiravelu, P. & Sharma, A. (2016). A Dynamic Data Warehousing Platform for Creating and Accessing Biomedical Data Lakes. In 2nd International Workshop on Data Management and Analytics for Medicine and Healthcare (DMAH'16), co-located with 42 nd International Conference on Very Large Data Bases. Sep. 2016. LNCS. pp. 101 – 120. ● Caixinha, D., Kathiravelu, P. & Veiga, L. (2016). ViTeNA: An SDN-Based Virtual Network Embedding Algorithm for Multi-Tenant Data Centers. In 15 th IEEE International Symposium on Network Computing and Applications (NCA 2016), Oct. 2016. pp. 140 – 147.
  • 12.
    12/12 Conference Proceedings ● Kathiravelu,P. & Veiga, L. (2017). SD-CPS: Taming the Challenges of Cyber-Physical Systems with a Software- Defined Approach. In The 4th International Conference on Software Defined Systems (SDS-2017). May 2017. 8 pages. To Appear. ● Kathiravelu, P. & Veiga, L. (2017). SDN Middlebox Architecture for Resilient Transfers. In 15th IFIP/IEEE International Symposium on Integrated Network Management (IM 2017), May 2017. 4 pages. To Appear. ● Kathiravelu, P. & Veiga, L. (2016). Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks. In 24 th International Conference on Cooperative Information Systems (CoopIS 2016). On the Move to Meaningful Internet Systems: OTM 2016 Conferences, pp. 3 – 23. Springer International Publishing, Oct. 2016. ● Kathiravelu, P., & Veiga, L. (2016). Selective Redundancy in Network-as-a-Service: Differentiated QoS in Multi- tenant Clouds. In OTM Confederated International Conferences. On the Move to Meaningful Internet Systems (pp. 87-97). EI2N 2016. Springer, Cham. ● Kathiravelu, P. & Sharma, A. (2016). A Dynamic Data Warehousing Platform for Creating and Accessing Biomedical Data Lakes. In 2nd International Workshop on Data Management and Analytics for Medicine and Healthcare (DMAH'16), co-located with 42 nd International Conference on Very Large Data Bases. Sep. 2016. LNCS. pp. 101 – 120. ● Caixinha, D., Kathiravelu, P. & Veiga, L. (2016). ViTeNA: An SDN-Based Virtual Network Embedding Algorithm for Multi-Tenant Data Centers. In 15 th IEEE International Symposium on Network Computing and Applications (NCA 2016), Oct. 2016. pp. 140 – 147. Thank you. Questions?
  • 13.
    13/12 Announcement! ● Please jointhe Erasmus Mundus Association – em-a.eu