Hariintro exebit 2014

395 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
395
On SlideShare
0
From Embeds
0
Number of Embeds
46
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Hariintro exebit 2014

  1. 1. Cloud computing workshop@Exebit 2014 by Students@doslab, Dept. CSE, IIT Madras Mar 15, 2014 DOS lab, IIT Madras This work by Harisankar H is licensed under a Creative Commons Attribution 4.0 International License.
  2. 2. Big Data • “100 hours of video are uploaded to YouTube every minute” • “Average daily facebook likes: 4.5 billion” – “Size of user data stored by facebook: more than 300 petabytes” • 307200 terabytes • Data analytics brings huge profits DOS lab, IIT Madras
  3. 3. Public clouds • On-demand and elastic – Using 1000 machines for 1 hour costs same as using 1 machine for 1000 hours • Enables low budget large scale computing
  4. 4. Challenges in Big Data analytics • Processing in 1 machine insufficient – Need 1000s of servers for quick answers • Distributed computing! • Handling of server failures an issue for long running tasks • Programming model should be simple DOS lab, IIT Madras
  5. 5. Topics covered • Techniques for Big Data analytics 1. Hadoop MapReduce and Pig 2. In-memory processing using Spark 3. Processing big graphs 4. Addressing remaining challenges 30 mins each DOS lab, IIT Madras
  6. 6. Desired outcome • Give a flavour of different Big Data technologies – Enable students to identify areas of interest • Enable selection of project topics – Working with students having similar interests DOS lab, IIT Madras
  7. 7. Companion website • Slides and additional materials will be uploaded in the companion website • Please give your feedback in the website http://cloudtechiitm2014.wordpress.com DOS lab, IIT Madras
  8. 8. Sources Images from: • http://upload.wikimedia.org/wikipedia/commons/7/75/Puzzly_puzzled.svg • http://openclipart.org/image/300px/svg_to_png/18412/motudo_WeightLifting.png • http://www.coloandcloud.com/wp-content/uploads/2011/12/Aug-2010-Aerial-Photo-of-Microsoft-data- center-in-Quincy-WA-1024x489.jpg • http://docs.aws.amazon.com/AWSSdkDocsPHP/latest/DeveloperGuide/images/php-spot-recent-ami- 1.png Some statistics from: • http://www.baselinemag.com/analytics-big-data/slideshows/surprising-statistics-about-big-data.html • www.youtube.com/yt/press/statistics.html • http://expandedramblings.com/index.php/by-the-numbers-17-amazing-facebook-stats/#.UyP64D-SzIc

×