This document summarizes Dr. Anita Goel's presentation on cloud computing infrastructure at the Workshop on Big Data and Cloud Computing in India in 2016. The presentation included an introduction to cloud computing concepts like virtualization and software defined networking and storage. It discussed the need for cloud computing to improve processor and energy efficiency. It also defined cloud computing according to NIST and described common cloud service models. The remainder of the presentation outlined research directions in cloud computing architecture and control layers and listed several related publications by Dr. Goel and collaborators.

1. Dr. Anita Goel
Cloud Computing
Infrastructure
WBDCC 2016
Workshop on Big Data and Cloud Computing, India
Dyal Singh College
Department of Computer Science
University of Delhi, India

2. Presentation Outline
•Introduction to Cloud Computing
•Concept of Virtualization
•Software Defined Networking
•Software Defined Storage
•Research Directions
2

3. Need of Cloud Computing
•Processor Resource
• Multicore Processors - 20% hardware used 80% time
•Users and Energy
• Global access to files from different devices
• Machines underutilized; energy consumption full
•Business Needs
• On demand resource
• Scalability on demand
•Changing Nature of Applications 3

4. Computing Service
4
Computing as a Resource
Computing as a Service

5. Cloud Computing Definition (NIST)
•Cloud computing is a model for
•enabling ubiquitous, convenient, on-demand
network access to a shared pool of
•configurable computing resources (e.g., networks,
servers, storage, applications and services)
•that can be rapidly provisioned and released with
minimal management effort or service provider
interaction.
5
National Institute of Standards and Technology's (NIST)

6. NIST Cloud Reference Architecture
6
Robert B. Bohn, John Messina, Fang Liu, Jin Tong, Jian Mao, “NIST Cloud Computing Reference Architecture”, 2011 IEEE World Congress on Services

7. Infrastructure as a Service (IaaS)
8
Storage
Provides web based,
scalable storage
Allow hiring of storage
space on cloud storage
servers
Manages data
availability and security
Network
Provides resource
sharing - geographically
separate locations
Allows connection to
desired resources
Manages network -
VPN firewalls etc.
Compute
Provides processing
power as a resource
Allows provisioning of
machines
Manages multi-
tenancy issues

8. Concept of Virtualization
•Decoupling of hardware and software
•Abstract and create a layer of resources
•Uses Hypervisor for abstraction
•Abstracted resources can be
•Can be used, demanded
•Cannot be owned or configured
•Can be sliced, resized, combined, and distributed
9

9. Traditional Picture
10

10. Virtualization
Hardware
Virtual Machine Monitor (VMM) / Hypervisor
Guest OS
(Linux)
Guest OS
(NetBSD)
Guest OS
(Windows)
VM VM VM
App AppApp AppApp
11

11. Traditional OS
12

12. Pre VT-x and Post VT-x
14
VMM ring de-privileging of guest OS VMM executes in VMX root-mode
Guest OS aware its not at Ring 0 Guest OS de-privileging eliminated
Intel Virtualization Technology Processor Virtualization Extensions and Intel Trusted execution Technology
Pre VT-x Post VT-x

13. Binary
Translation
Paravirtualization
Page-table
Shadowing
IO-Device
Emulation
Interrupt
Virtualization
DMA Remap
VT-x & VT-d Working Together
Physical Memory I/O Devices
Logical
Processors
Virtual Machine Monitor (VMM)
Virtual
Machines
Hardware Virtualization
Mechanisms under VMM Control
VT-x
VT-d
Intel® Virtualization Transforms IT http://www.intel.com/content/www/us/en/virtualization/intel-virtualization-transforms-it.html

14. Openstack
Provide IaaS services for public and private clouds

15. Openstack (contd.)
•Relationship between components

16. SDN: Software Defined Network
18

17. Computer Industry
19
Software Defined Networks and the maturing of the Internet, Nick Mckeown

18. Network Industry
20
Software Defined Networks and the maturing of the Internet, Nick Mckeown

19. Towards OS for Networks
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
Operating
System
Operating
System
Operating
System
Operating
System
Operating
System
App App App
Closed
OpenFlow/SDN tutorial, Srini Seetharaman, Deutsche Telekom, Silicon Valley Innovation Center
21

20. Software Defined Networking
•Control plane physically separate from Forwarding
plane
•Single Control plane controls several Forwarding
devices
22

21. Towards OS for Networks..
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
App App App
Specialized Packet
Forwarding Hardware
Operating
System
Operating
System
Operating
System
Operating
System
Operating
System
App App App
Network Operating System
Control Programs
OpenFlow/SDN tutorial, Srini Seetharaman, Deutsche Telekom, Silicon Valley Innovation Center
23

22. Towards OS for Networks..
Simple Packet
Forwarding
Hardware
Simple Packet
Forwarding
Hardware
Simple Packet
Forwarding
Hardware
Simple Packet
Forwarding
Hardware Simple Packet
Forwarding
Hardware
Network Operating System
Control Programs
OpenFlow/SDN tutorial, Srini Seetharaman, Deutsche Telekom, Silicon Valley Innovation Center
24

23. OpenFlow
25
Data Path (Hardware)
Control Path OpenFlow
OpenFlow Controller
OpenFlow Protocol (SSL/TCP)
OpenFlow/SDN tutorial, Srini Seetharaman, Deutsche Telekom, Silicon Valley Innovation Center
OpenFlow is a communication protocol that gives access to the
forwarding plane of a network switch or router over the network.
Nick McKeown; et al. (April 2008). “OpenFlow: Enabling innovation in campus networks. ACM Communications Review

24. OpenFlow Protocol
NETWORK OPERATING SYSTEM
Bandwidth -
on - Demand
Dynamic
Optical
Bypass
Unified
Recovery
Unified
Control
Plane
Switch
Abstraction
Networking
Applications
VIRTUALIZATION (SLICING) PLANE
Underlying
Data
Plane
Switching
Traffic
Engineering
Application-
Aware QoS
Packet
Switch
Packet
Switch
Wavelength
Switch
Time-slot
Switch
Multi-layer
Switch
Packet & Circuit
Switch
Packet & Circuit
Switch
Software-Defined Network, Jason, Tsung-Cheng, HOU, Wanjiun Liao
SDN
NOX Beacon ONIX POX ONOS

25. SDN..
27

26. SDS: Software Defined Storage
28

27. Storage Devices
•Direct Attached Storage - DAS
•Network Attached Storage - NAS
• Expensive, Scaling Issues, NAS Islands
•Storage Area Network - SAN
• Expensive, Scaling Issues, Raid Recovery time
29

28. SDS
•Inspired by Software Defined Network
•Control Plane separate from Data Plane
•Uses Commodity Storage for Data Plane
•Uses Server for Control Plane
•Enabling Technology – Hadoop Distributed File
System (HDFS)
30

29. HDFS
31

30. What is Ceph?
•Open-Source Software
•Software Defined Storage System
•Unified Storage Solution
• Block storage, File storage, Object storage
•Cost effective – Runs on Commodity Hardware
• Provides enterprise - grade highly reliable storage
•Easy to consume - in Linux Kernel
•Integrated with OpenStack, Cinder, Ubuntu
32

31. Ceph: Architectural Philosophy
•Distributed Storage System
•High Performance System
•Reliable System - No single point of failure
•Massively Scalable - Exabyte levels
•1EB ~ 1000 PB ~ 1 million TB ~ 1billion GB
•Fault tolerant - Data Replication
•Self-manageable, wherever possible
33

32. 34
Key Features
•Decoupled data and metadata – Uses CRUSH
• Files striped onto predictably named objects
• CRUSH maps objects to storage devices
•Dynamic Distributed Metadata Management
• Dynamic subtree partitioning - Distributes metadata among MDSs
•Object-based storage
• OSDs handle migration, replication, failure detection and
recovery
Source: Weil OSDI

33. Ceph Architecture Overview
35
Ceph Storage Cluster
Underlying Commodity Hardware
Linux OS
Ceph Client Storage Services
File Block Object

34. Some Examples
36

35. Ceph with OpenStack
Copyright © 2014 by Inktank
37

36. Ceph with ARM Servers
38

37. Ceph Unique?
39http://www.mellanox.com/blog/2015/06/ceph-is-a-hot-storage-solution-but-why/#

38. Why Ceph is Hot
http://www.mellanox.com/blog/2015/06/ceph-is-a-hot-storage-solution-but-why/#
40
Feature Means Final Benefit
Open Source No license fees Lower cost
Software-defined
Different hardware for different
workloads
Broader use cases, higher efficiency
Use commodity hardware Lower cost, easier to evaluate
Scale-out
Manage many nodes as one
system
Easier to manage = lower operational
cost
Distributed capacity Multi-PB capacity for object & cloud
Distributed performance
Good performance from low cost
servers
Block + Object Store more types of data Broader use cases
Enterprise features
Data protection Don’t lose valuable data
Self-healing
Higher availability, easier
management
Data efficiency Lower cost
Caching/tiering Higher performance at lower cost

39. An architecture for SD Cloud
Computing environments
41
Software-Defined Cloud Computing: Architectural
Elements and Open Challenges
Rajkumar Buyya, Rodrigo N. Calheiros, Jungmin Son, Amir
Vahid Dastjerdi, and Young Yoony

40. Research Directions
•Design of Control layer – Compute, Storage
•Standardization of control layer
•Design of a new modular, easily modifiable – Compute
and Storage
•Creation of APIs for storage and compute architecture
•Development of Monitoring Tools providing maximum
coverage

41. Publications
• An Overview of Data Storage on the Cloud, P. Jain, A. Goel, S. Gupta
• In Proceedings of IEEE International Conference on Advanced Research in Engineering
and Technology, India, pp. 318-322, 2013.
• Object Storage as a Service, P. Jain, A. Goel, S. Gupta
• In Proceedings of International Journal of Innovations & Advancement in Computer
Science, Vol. 4, pp. 605-614, 2015.
• Monitoring Checklist for Ceph Object Storage Infrastructure, P. Jain, A. Goel, S.
Gupta
• In Proceedings of 5th IFIP International Conference on Computer Science and Its
Application, Saida, Algeria, pp. 611-623, 2015.
• Monitoring the Infrastructure of Riak CS, P. Jain, A. Goel, S. Gupta
• In Proceedings of 11th International Multi Conference on Information Processing,
Bangalore, India, pp.137-146, 2015.
• Requirement Checklist for Infrastructure Monitoring of Swift , P. Jain, A. Goel, S.
Gupta
• The 2015 International Conference On High Performance Computing & Simulation,
HPCS, Amsterdam, Netherlands

42. Publications..
• IaaS as a Service, A. Datt, A. Goel, SC Gupta
• In Proceedings of SARC-IRAJ International Conference, New Delhi, India, June 2013,
ISBN: 978-81-927147-6-9, pp. 18-23
• Comparing Infrastructure Monitoring with CloudStack Compute Services for
Cloud Computing Systems, A. Datt, A. Goel, SC Gupta
• In Proceedings of 10th International Workshop - Databases in Networked
International Systems, DNIS (2015) , Japan, LNCS 8999, Springer, 2015, pp. 195-212.
• Analysis of Infrastructure Monitoring Requirements for OpenStack Nova, A. Datt,
A. Goel, SC Gupta
• In Proceedings of Eleventh International Multi Conference on Communication
Networks, ICCN 2015, August 21-23, 2015, Bangalore, India, Volume 54, ISBN: 1877-
0509, pp. 127-136
• Monitoring list for Compute Infrastructure in Eucalyptus Cloud, A. Datt, A. Goel,
SC Gupta
• In Proceedings of The 24th IEEE International Conference on Enabling Technologies:
Infrastructure for Collaborative Enterprise, Cyprus, 2015, Pages: 69 - 71, WETICE

43. Publications..
• Infrastructure Monitoring of Compute Cloud, A. Datt, A. Goel, SC Gupta
• Published in Journal of Advances in Economics and Business Management (AEBM),
ISSN: 2394-1545, vol. 2, issue 5, pp. 439- 444
• Cloud Service Orchestration Based Architecture of OpenStack Nova and Swift, P.
Jain, A. Datt, A. Goel, S. Gupta
• 5th International Conference on Advances in Computing, Communications and
Informatics, Jaipur, India September 21-24, 2016
• Object storage in OpenStack and Installation Steps of Swift, P. Jain, A. Goel
• 3 hour Session in “Recent Trends in Big Data and Cloud Computing”, Indira Gandhi Delhi
Technical University for Women (IGDTUW), India, 19th December 2013.

44. Thank You
Contact: goel.anita@gmail.com