OpenStack@IIIT-HDharmesh Kakadia (@dharmeshkakadia)Shashank Sahni (@shredder12)
What we do● Run an Indian Languages Search Engine● Research  ○   Information Extraction  ○   Information Retrieval  ○   In...
Before OpenStack...
Before OpenStack    source: http://www.codeproject.com/KB/threads/hxgrid/image4.jpg
Problems● Provisioning  ○ Adhoc  ○ Time consuming  ○ Unmanaged● User Management  ○ No resource accounting  ○ Access Contro...
More Problems...● Cluster  ○   Terrible Resource Utilization  ○   New deployment => Too much time  ○   Data Redundancy  ○ ...
After OpenStack
OpenStack(KVM)●   7 Compute nodes    (8GB, quad-core)●   1 nova-volume(2 TB,    Raid-1)Swift● 3 storage nodes (2TB  each)O...
Provisioning● Pre-configured images to quickly get started.● VM of any capacity available at any time( 2  a.m. Sunday morn...
User Management● Resource restrictions using Quota● Project based collaboration and private  resources● Usage monitoring
StorageThis wasnt easy. We experimented with● nova-volume● Swift(diablo)● GlusterFS● Swift(Folsom)(current)
Storage● Hadoop compatible distributed storage● Glance image store● Desktop backup utility using CloudFuse● Data reliabili...
OpenStack in Academia● Research  ○ Inter cloud migration  ○ Inter cloud scheduling  ○ Performance Evaluation● Resource pro...
HadoopStack● Big Data processing on Demand● Entire ecosystem for Big Data - Hadoop  Family, Spark, Mahout, R● Multi-Cloud ...
HadoopStack
Conclusion● Using OpenStack● Working with and around OpenStack●   OpenStack is Awesome !!
Questions/Feedback ?
Upcoming SlideShare
Loading in...5
×

Open stack @ iiit hyderabad

1,157

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,157
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "Open stack @ iiit hyderabad "

  1. 1. OpenStack@IIIT-HDharmesh Kakadia (@dharmeshkakadia)Shashank Sahni (@shredder12)
  2. 2. What we do● Run an Indian Languages Search Engine● Research ○ Information Extraction ○ Information Retrieval ○ Information Access ○ Virtualization and Cloud● Users of ○ OpenStack ○ Hadoop ○ and lot of other FOSS
  3. 3. Before OpenStack...
  4. 4. Before OpenStack source: http://www.codeproject.com/KB/threads/hxgrid/image4.jpg
  5. 5. Problems● Provisioning ○ Adhoc ○ Time consuming ○ Unmanaged● User Management ○ No resource accounting ○ Access Control ○ Usage Restriction● Storage ○ Data reliability ○ Duplication
  6. 6. More Problems...● Cluster ○ Terrible Resource Utilization ○ New deployment => Too much time ○ Data Redundancy ○ Non-optimal deployments● Academic ○ No cloud platform for experimentation ○ Large Scale sandboxed resource provisioning for students.
  7. 7. After OpenStack
  8. 8. OpenStack(KVM)● 7 Compute nodes (8GB, quad-core)● 1 nova-volume(2 TB, Raid-1)Swift● 3 storage nodes (2TB each)OpenStack(LXC)● 16 Compute nodes (6GB, dual core)
  9. 9. Provisioning● Pre-configured images to quickly get started.● VM of any capacity available at any time( 2 a.m. Sunday morning)● Snapshots
  10. 10. User Management● Resource restrictions using Quota● Project based collaboration and private resources● Usage monitoring
  11. 11. StorageThis wasnt easy. We experimented with● nova-volume● Swift(diablo)● GlusterFS● Swift(Folsom)(current)
  12. 12. Storage● Hadoop compatible distributed storage● Glance image store● Desktop backup utility using CloudFuse● Data reliability● No more Data Fragmentation
  13. 13. OpenStack in Academia● Research ○ Inter cloud migration ○ Inter cloud scheduling ○ Performance Evaluation● Resource provisioning for course assignments and projects. ○ 3 courses ○ 350+ students ○ 20+ projects
  14. 14. HadoopStack● Big Data processing on Demand● Entire ecosystem for Big Data - Hadoop Family, Spark, Mahout, R● Multi-Cloud - OpenStack and AWS.
  15. 15. HadoopStack
  16. 16. Conclusion● Using OpenStack● Working with and around OpenStack● OpenStack is Awesome !!
  17. 17. Questions/Feedback ?

×