How can we take advantage of Cloud computing & big data?

2,797 views

Published on

How can we take advantage of Cloud computing & big data?. Jordi Torres. Mobile Business & Apps Design master degree at UPC Talent School of Professional and Executive Development. Barcelona, February 2013

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,797
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
103
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

How can we take advantage of Cloud computing & big data?

  1. 1. MOBILE BUSINESS & APPS DESIGN MASTER DEGREEHOW CAN WE TAKE ADVANTAGE OF  CLOUD COMPUTING & BIG DATA? Jordi Torres UPC-BSC, February - 2013
  2. 2. CONTENT1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
  3. 3. Foto: DesignedInBarcelona.com YESTERDAY’S BUSINESS
  4. 4. TODAY’S BUSINESS
  5. 5. OR NOT?
  6. 6. IS MUSIC A BUSINESS?
  7. 7. Exemple de Josep Valor (IESE), 2011 BON JOVI 1986 2010 The best-selling The most downloades
  8. 8. Exemple de Josep Valor (IESE), 2011Sold: 28.000.000 BON JOVI
  9. 9. Exemple de Josep Valor (IESE), 2011Sold: 28.000.000Sold: BON JOVI?
  10. 10. Exemple de Josep Valor (IESE), 2011 BON JOVI Revenues: 30.000.000$ Revenues: 70.000.000$ Concerts tour 2010
  11. 11. Exemple de Josep Valor (IESE), 2011 BON JOVI The business model changed! Revenues: 30.000.000$ Revenues: 70.000.000$ Concerts tour 2010
  12. 12. THE BUSINESS MODEL The businessmodel changed!music: Itunes, spotifybooks: Amazoneducation: e-learning UOC, MIT Courtesy: Dani Urgell – CISCOtravels: eDreamsRetail: Zara... Desintermediation from physical movement to the movement of information
  13. 13. WHERE DATA ARE STORED?
  14. 14. Source: Apple.com. 2011 WHERE DATA ARE STORED?
  15. 15. INTO CLOUD COMPUTING!
  16. 16. CLOUD COMPUTINGIt’s here to stay
  17. 17. CLOUD FORECAST IaaSSaaS According to IDC, by  Gartner is predicting  that the IaaS market to  2015, about 24% of all  grow by 47.8% through  new business software  2015.  purchases will be of  service‐enabled software  with SaaS delivery being  13.1% of worldwide  software spending. Source: http://softwarestrategiesblog.com/2012/01/17/roundup-of-cloud-computing-forecasts-and-market-estimates-2012/
  18. 18. CLOUD FORECAST Workload processed in the CloudSource: CISCOhttp://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns1175/Cloud_Index_White_Paper.pdf
  19. 19. CONTENT1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
  20. 20. HOW DO WE GET HERE? Pilot ACE, UK.1950
  21. 21. EVERY 15 YEARS …A major technological jump in IT TIC That has redefined IT and industry in general 1950 2012
  22. 22. MAINFRAMES Mainframes1950 1965 1980 1995 2010 2025
  23. 23. PERSONAL COMPUTERS Personal Computers Mainframes1950 1965 1980 1995 2010 2025
  24. 24. INTERNET Internet Personal Computers Mainframes1950 1965 1980 1995 2010 2025
  25. 25. INDUSTRIALIZATION OF IT Huge Data Centers Internet Personal Computers Mainframes1950 1965 1980 1995 2010 2025
  26. 26. Source: http://www.facebook.com/media/ set/?set=a.190842620965185.47008.140375289345252 HUGE DATA CENTERS 40 Mw28.000 m2
  27. 27. Foto: Google HUGE DATA CENTERS
  28. 28. Foto: Google HUGE DATA CENTERS > football pitch x 4
  29. 29. HUGE DATA CENTERSFoto: cortesía BSC Industrializaton of IT: has arrived!
  30. 30. Source: http://www.google.com/about/datacenters/gallery/images
  31. 31. Source: http://www.google.com/about/datacenters/gallery/images
  32. 32. Source: http://www.google.com/about/datacenters/gallery/images
  33. 33. CONTENT1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
  34. 34. IT AS A SERVICE Cloud Computing represents a major change in IT service architecture, delivery and consumptionFoto: J.T.
  35. 35. IT AS A SERVICEAmazon Data Center Foto: Tutorial SC2011 - Robert Grossman(*) IaaS
  36. 36. IT AS A SERVICEMore flexible IT, which can adapt tobusinesses and where costs can be predicted Ubiquitous access Pay per use Rapid elasticity On-demand self-service ....
  37. 37. EXAMPLE: WORKLOAD
  38. 38. SYSTEM CAPACITY CapacityResources Demand Time
  39. 39. RESOURCES NOT USED Capacity Resources not usedResources Demand Time
  40. 40. WASTE OF RESOURCES Capacity €€€€€€€€€€€€€€€€€€€€€€€€€€€€€ €€€€€€€€€€€€€€€€€€€€€€€€€€€€€ €€€€€€€€€€€€€€€€€€€€€€€€€€€€€ €€€€€ €€€€€€€€€€€€ €€€€€Resources €€€€ €€€€€€€€€€ €€€€ €€€ €€€€€€€€ €€€ €€ €€€€€€ €€€ € €€€€ €€ €€€ € Demand Time
  41. 41. CUSTOMER BEHAVIOR CapacityResources Demand 1 2 3 Time (days)
  42. 42. CUSTOMER BEHAVIOR CapacityResources Demand 1 2 3 Time (days)
  43. 43. CLOUD COMPUTING ELASTICITYResources Capacity Demand Time
  44. 44. AGILITY FOR SUPPLYING vs in‐house data centerFotos: cortesía BSC
  45. 45. TYPES OF CLOUDS Software as a Service (SaaS) Plataforma as a Service (PaaS)Infraestructura as a Service (IaaS)
  46. 46. TYPES OF CLOUDSTradicional IaaS PaaS SaaS Apps Apps Apps Apps Frameworks Frameworks Frameworks Frameworks VM VM VM VM Server Server Server Server models of service delivery
  47. 47. INFRAESTRUCTURE AS A SERVICE1 computer in a rackfor 120 hours 120 computers in three racks for 1 hour Idea : Tutorial SC2011 - Robert Grossman
  48. 48. Ex IaaS: Amazon Web ServicesTo create an AWS account go to http://aws.amazon.comTo launch an instance go to
  49. 49. GET STARTED WITH EC2Follow the Wizard
  50. 50. CONNECT TO INSTANCEe.g. SSH
  51. 51. TERMINATE INSTANCEAs soon as your instance starts to boot, youre billed foreach hour or partial hour that you keep the instance running(even if the instance is idle).When youve decided that you no longer need the instance,you can terminate it.
  52. 52. CLOUD COMPUTING INHIBITORS Lack of Security Privacy Standards Data  Data  RegulatoryIntegrity Recovery VendorControl ... Maturity
  53. 53. CLOUD COMPUTING TODAY Enterprise resources Data+ Programs + Hardware CLOUDelectronic devices with identification/computing/storage/communication capabilities User Sep 2011
  54. 54. CLOUD COMPUTING TODAY Enterprise resources Data+ Programs + Hardware PRIVATE CLOUD PUBLIC CLOUDelectronic devices with identification/computing/storage/communication capabilities User
  55. 55. HYBRID CLOUDWorkload
  56. 56. HYBRID CLOUDcapacity Workload
  57. 57. HYBRID CLOUDcapacity
  58. 58. HYBRID CLOUDExternal Provider
  59. 59. EVERYTHING AS A SERVICE IaaS PaaS SaaS DRaaS X aaS SUaaS …BDaaS
  60. 60. Foto: DesignedInBarcelona.com CLOUD CAN DRIVE BUSINESS INNOVATION Taking cost out of company Improve business processes and operational effectiveness Using the cloud to enable new business models
  61. 61. on stage companies Hundreds of SUMMARYSource: Security Guidance for Critical Areas of Focus in CloudComputing , April 2009. Cloud Security Alliance.
  62. 62. CONTENT1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
  63. 63. TODAY
  64. 64. http://www.searchenginejournal.com/the-growth-of-social-media-an-infographic/32788 EVERYBODY CONNECTED 100% of students on Facbook 4th year ESO secondary school:
  65. 65. A MOBILE FUTUREhttp://money.cnn.com/2011/02/09/technology/smartphones_eclipse_pcs/index.htm
  66. 66. INTERNET OF THINGSNot only will we have mobile devices, but also http://www.urbiotica.com
  67. 67. http://download.intel.com/newsroom/kits/embedded/pdfs/ECG_WhitePaper.pdfINTERNET OF THINGS
  68. 68. OPEN DATA
  69. 69. BIG DATA? Do you need a definition?  is data that becomes large enough that it cannot be processed using conventional methods.  enough for you? :-) Deluge of data created daily social networks, Source:http://www.datacenterknowledge.com/archives/20 11/06/28/digital-universe-to-add-1-8-zettabytes-in- 2011/?utm-source=feedburner&utm-medium=feed&utm- mobile phones, campaign=Feed:+DataCenterKnowledge+%28Data sensors, science, …
  70. 70. “CHULETA”1 Gigabyte (GB) = 1.000.000.000 byte1 Terabyte (TB) = 1.000 Gigabyte (GB)1 Petabyte (PB) = 1.000.000 Gigabyte (GB)1 Exabyte (EB) = 1.000.000.000 Gigabyte (GB)1 Zettabyte (ZB) = 1.000.000.000.000 (GB)
  71. 71. DEFINING BIG DATAA more complete definition of Big Data is one that combines three attributes of data: Source: IBM Book – Understanding Big Data
  72. 72. DEFINING BIG DATA Volume:  Large Volumes of data  Terabytes, Petabytes, …  Data that cannot be stored in conventional RDBMS Variety  Source data is diverse – Web Logs, Application Logs, Machine generated data, Social network data, etc.  Doesnt fall into neat relational structures – Unstructured, Semi-structured Velocity  Streaming data, Complex Event Processing data  Velocity of incoming data and Speed of responding to it
  73. 73. WHY IS BIG DATA IMPORTANT 40% projected growth in global data generated per year vs 5% projected growth in global IT spending 60% Potential increase in retailers operating margins possible with big data(*) Source: Big Data: The next frontier for innovation, competition and productivity – Mckinsey Global Institute, July 2011
  74. 74. WHY IS BIG DATA IMPORTANT Data is more important than ever, but the exponential growth of data has overwhelmed most companys ability to manage (and monetize it). Big Data Challenges  Processing such large data sets  Storing and Managing  Analyzing  …
  75. 75. Storage affordableassume 100MB/sec
  76. 76. But scanning disks…assume 100MB/sec
  77. 77. But scanning disks…assume 100MB/secmore than 5 hours
  78. 78. SOLUTION: MASSIVE PARALLELISM assume 20.000 disks:scanning 2 TB takes 1 second Source: http://www.google.com/about/datacenters/gallery/images/_2000/IDI_018.jpg
  79. 79. DATA PROCESSING CHALLENGES assume 20.000 disks: scanning 2 TB takes 1 secondRethinking data processing is required: MapReduce, … Source: http://www.google.com/about/datacenters/gallery/images/_2000/IDI_018.jpg
  80. 80. DATA STORAGE CHALLENGESNew Storage technologies are required HHD 100 cheaper than RAM But 1000 times slower RAM vs HHD Solid- state drive (SSD) Not volatile Present solutions: Storage Class Memory (SCM) Research: 80
  81. 81. DATA MANAGEMENT CHALLENGES Relational DB can’t support everything: NoSQL, …Source: gigaom.com/cloud/big‐data‐and‐nosql‐march‐to‐the‐enterprise/
  82. 82. DATA MANAGEMENT Solution: the so called “NoSQL systems”BASE property is sometimes attributed to them (Basically Available, Soft state, Eventual consistency) Example eventual consistency: Facebook! 82
  83. 83. Data deluge, is it enough?
  84. 84. “Data = Information”?
  85. 85. The information is non actionable knowledgeprediction using data models
  86. 86. 4 OBTAINING VALUE FROM DATA For this we have Data Mining- techniques Data + • Association • ClassificationValue Volume • Clustering Information • Prediction • ...+ The majority of algorithms function Knowledge - well in thousands of registers, however at the moment they are impractical for thousands of milions. 86
  87. 87. CONTENT1. New Business models2. How do we get here?3. What is Cloud Computing?4. What is Big Data?5. An opportunity for you
  88. 88. AN OPPORTUNITY
  89. 89. AN OPPORTUNITYIT applications and services over the years Applications Hundreds of thousands of applications Tens of thousands of applications Thousands of applications Hundreds of applications 1950 1965 1980 1995 2010 2025
  90. 90. AN OPPORTUNITYwell see millions of newapplications and servicesbuilt on top of these disruptive Applications Millions oftechnologies applications Hundreds of thousands of applications Tens of thousands of applications Thousands of applications Hundreds of applications 1950 1965 1980 1995 2010 2025
  91. 91. Users IT users growthAN OPPORTUNITY ? Hundreds of Millions of users Millions of users Thousands of users 1950 1965 1980 1995 2010 2025
  92. 92. IT users growthAN OPPORTUNITY of TrillionsUsers “things” Billions Hundreds of Millions of users of users Millions of users Thousands of users thanks to these millions of applications well see billions of users and trillions of “things” connected 1950 1965 1980 1995 2010 2025
  93. 93. BIG DATA TALENT
  94. 94. BIG DATA TALENT
  95. 95. CONCLUSION We have toprepare our businesses for the explosion of the cloud in a world of mobile technology and social networks, dominated by theboom of available information and all in a sustainable way.
  96. 96. Autonomic Systems and e‐Business Platforms research line at BSC/UPC www.smartcityexpo.com www.bsc.es/eBusiness
  97. 97. Thank you for your attention Questions? www.JordiTorres.eu Barcelona @JordiTorresBCN13-15 November 2012 www.smartcityexpo.com

×