Academic Perseptive [ppt]


Published on

  • Be the first to comment

  • Be the first to like this

Academic Perseptive [ppt]

  1. 1. Cloud Computing Course Administration Vasudeva Varma
  2. 2. Background <ul><li>Cloud Computing research in IIIT Hyderabad </li></ul><ul><li>Hadoop in SIEL/Other places in IIIT Hyderabad </li></ul><ul><li>Previous edition of cloud computing course </li></ul><ul><li>Collaboration with Yahoo! </li></ul><ul><li>Collaboration with Amazon </li></ul><ul><li>Collaboration with others </li></ul><ul><ul><li>Google, Intel, Microsoft, ITsAP… </li></ul></ul>
  3. 3. Course Administration <ul><li>TAs: </li></ul><ul><ul><li>GRJ Srinivas </li></ul></ul><ul><ul><li>Padmini Priyadarshini   </li></ul></ul><ul><ul><li>… </li></ul></ul><ul><li>Reference Material </li></ul><ul><ul><li>No Text book </li></ul></ul><ul><ul><li>Relevant material ( or pointers to them ) will be provided on the course web site </li></ul></ul>
  4. 4. Course Administration <ul><li>Course website: </li></ul><ul><li>Course mailing list: </li></ul><ul><li>Two Mid Semester Exams (10%) each </li></ul><ul><li>End Semester Exam (20%)‏ </li></ul><ul><li>Assignments (30%)‏ </li></ul><ul><li>Project 40% </li></ul><ul><li>Rules </li></ul><ul><ul><li>Strict Plagiarism Policy– Punishment: F Grade </li></ul></ul><ul><ul><li>Be on-time for the class </li></ul></ul>
  5. 5. Course Outline <ul><li>Introduction to Cloud Computing </li></ul><ul><ul><li>Cloud introduction and overview Different clouds Risks Requirements Introduction Cloud computing architecture On Demand Computing Virtualization at the infrastructure level Security in Cloud computing environments CPU Virtualization - A discussion on Hypervisors Storage Virtualization - A discussion on SAN, ISCSI Network Virtualization - A discussion on VLAN </li></ul></ul><ul><ul><li>Cloud Computing Architecture - Amazon Case study Introduction to Amazon Cloud Computing services, Amazon EC2, Amazon S3 , Amazon DB, Queues and Cloud Front Practical Amazon </li></ul></ul>
  6. 6. Course outline… <ul><li>Introduction to Distributed Computing </li></ul><ul><ul><li>Fallacies of Distributed Computing Sources of failure in distributed computing Large Data sets and the handling issues Moore Law & relationship to storage, CPU speed, etc </li></ul></ul><ul><li>Introduction Map Reduce </li></ul><ul><ul><li>Discussion of Google Paper Discussion of BigTables, GFS, HDFS MapReduce - Hadoop Framework Map Reduce – Hadoop Framework examples Hadoop and related Projects, HBase, Pig, Mahut etc </li></ul></ul><ul><li>Current topics of CC @ IIIT-H </li></ul><ul><ul><ul><li>Scheduling </li></ul></ul></ul><ul><ul><ul><li>Test bed creation </li></ul></ul></ul><ul><ul><ul><li>Hardware aware middleware </li></ul></ul></ul>
  7. 7. Planned Guest Lectures <ul><li>Grid and Cloud Computing Group - Yahoo </li></ul><ul><li>Amazon Web Services – Amazon </li></ul><ul><li>Google App engine – Google </li></ul><ul><li>Cloud in the enterprise by Ramesh Logananthan, Progress software </li></ul><ul><li>Some others…? </li></ul>
  8. 8. Migration to Cloud Computing: An Academic and Research Perspective
  9. 9. What we do? <ul><li>Crawling, Parsing and Indexing the web - vertically and horizontally </li></ul><ul><li>Cross Lingual Information Retrieval </li></ul><ul><li>Digital Libraries - Book Search </li></ul><ul><li>Enterprise search </li></ul><ul><li>Information extraction from Semi-structured and un-structured data sources </li></ul><ul><li>Multi-document Summarization </li></ul><ul><li>Machine Translation </li></ul><ul><li>Speech Processing </li></ul>
  10. 10. Academic Research is getting more complex <ul><li>Nature of the tasks </li></ul><ul><ul><li>Even lab prototypes are at the web scale </li></ul></ul><ul><ul><li>Need to deal with large data </li></ul></ul><ul><ul><li>More experiments to validate research claims/assumptions </li></ul></ul><ul><li>Increase in overall Computing infrastructure costs </li></ul><ul><ul><li>Hardware </li></ul></ul><ul><ul><li>Bandwidth </li></ul></ul><ul><ul><li>Maintenance </li></ul></ul><ul><li>Common resources </li></ul><ul><ul><li>Local </li></ul></ul><ul><ul><li>Central </li></ul></ul><ul><ul><li>Global </li></ul></ul>
  11. 11. Motivation to Migrate to Cloud Computing <ul><li>Several projects need to process huge amount of data </li></ul><ul><li>Computational needs are far beyond capacity of a single machine </li></ul><ul><li>On single nodes programs can run for days (On cluster its a matter of hours)‏ </li></ul><ul><li>Less time for experiments => More experiments! </li></ul><ul><li>We needed a parallel programming framework that is </li></ul><ul><ul><li>Easy to program, Easy to learn, Easy to deploy, </li></ul></ul><ul><ul><li>Does most of the things 'automagically ’ </li></ul></ul>
  12. 12. Cloud Computing in the NEWS <ul><li>IBM, Google, UW partnership </li></ul><ul><li>Yahoo!, HP, Intel + 6 research organizations </li></ul><ul><li>Amazon </li></ul>
  13. 13. Market Oriented Cloud Architecture Application P2P (Skype), Web Apps (Facebook), SaaS (Google Aps, SaleForce), Software+Services (MS Online Services)‏ Hardware – Android Infrastructure EC2, Sun Grid Platform Google App Engine, Mosso Services : AWS, Mechanical Turk Storage : S3, Live Mesh, Mobile Me
  14. 14. Cloud Accelerates Innovation <ul><li>Expand the Innovation playground </li></ul><ul><li>Reduce the Time to market/conference  </li></ul><ul><li>When you work on a cloud, entry barriers look lower and smaller </li></ul>
  15. 15. Comparison of Cloud Computing Offerings
  16. 16. Cloud Computing market Place
  17. 17. Different Clouds <ul><li>Virtual Private Cloud (VPC)‏ </li></ul><ul><ul><li>An IT solution platform that integrates local and commercial cloud infrastructure under a single management </li></ul></ul><ul><li>Regional Clouds </li></ul><ul><ul><li>Geographical Cloud Computing - Response based scaling on a regional basis </li></ul></ul><ul><ul><li>Regional Scaling and Monitoring </li></ul></ul><ul><li>Offline Clouds </li></ul><ul><ul><li>What happens when your lose connectivity? </li></ul></ul><ul><ul><li>What happens when your infrastructure goes down? </li></ul></ul>
  18. 18. The next generation Cloud has many challenges to tackle <ul><li>Security </li></ul><ul><li>Scalability </li></ul><ul><li>Availability </li></ul><ul><li>Reliability </li></ul><ul><li>Cost Efficient </li></ul><ul><li>Data Intensive </li></ul><ul><li>Personalization </li></ul><ul><li>Mobility </li></ul><ul><li>Latency </li></ul><ul><li>Manageability </li></ul>
  19. 19. Challenges – At the Service Level <ul><li>How to translate business concept requirements to infrastructure requirements? </li></ul><ul><ul><li>Define a Service Definition Language? </li></ul></ul><ul><ul><li>Must be able to handle rollback on deployment failures </li></ul></ul><ul><li>How to determine the mapping of high level service requirements and metrics (e.g., response time) to infrastructure level requirements and metrics (e.g., CPU utilization)‏ </li></ul><ul><li>Support multiple levels of QoS </li></ul>
  20. 20. Management Challenges <ul><li>Support policy based management across Clouds </li></ul><ul><ul><li>Dynamically automatically hire additional 'power‘ from a another cloud </li></ul></ul><ul><ul><li>Enable intra-site and inter-site workload optimization </li></ul></ul><ul><li>Protect Service Level Agreements </li></ul><ul><ul><li>Detect violations (SLA monitoring)‏ </li></ul></ul><ul><ul><li>Provide for dynamic relocation of resources </li></ul></ul><ul><ul><li>Provide accountability </li></ul></ul><ul><li>Bill for services used, even across Clouds </li></ul><ul><ul><li>Different billing and accounting systems may be used. </li></ul></ul>
  21. 21. Challenges at the Infrastructure level <ul><li>Provide for relocation of resources without boundaries </li></ul><ul><ul><li>Live migration across subnet boundaries </li></ul></ul><ul><ul><li>Migration to a different physical host without shared storage </li></ul></ul><ul><li>Speculative Execution – Heterogeneous infrastructure </li></ul><ul><li>Provide standardized interfaces for lifecycle management to Virtualized Execution Environment </li></ul><ul><li>Analyze end-to-end performance in a virtualized environment to understand bottlenecks </li></ul><ul><li>Be able to handle surges in 3-5 orders of magnitude in service requests </li></ul>RESERVOIR @ NOTUR 2008
  22. 22. Some more questions and challenges <ul><li>The Long tail of Web services </li></ul><ul><li>Accelerating academic skills and research (CC Research Beds)‏ </li></ul><ul><li>Cloud OS – EyeOS, AIR (Adobe), Open-Laszlo </li></ul><ul><li>UI Challenges – as rich experience as workstations? </li></ul><ul><li>Multi-platform, multi-language and multi-platform </li></ul><ul><li>Need for new programming paradigms? </li></ul>
  23. 23. We know about … Outsourcing Are we now getting into … Right-sourcing Cloud Sourcing? If so, who will be emerging as superpower?
  24. 24. Key Message: One cloud <ul><li>&quot;I think there is a world market for about five computers&quot; — Remark attributed to Thomas J. Watson (Chairman of the Board of International Business Machines) – 1943 </li></ul><ul><li>“… In a sense, says Yahoo Research Chief PrabhakarRaghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …” </li></ul><ul><ul><li>From , by Steven Baker - </li></ul></ul><ul><li>“… The World Wide Web is becoming one vast, programmable machine. As NYU's Clay Shirky likes to say, Watson was off by four …” – Nicholas Carr </li></ul><ul><li>From </li></ul>
  25. 25. Thank You <>