Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Ramunas Urbonas. The Journey

3,145 views

Published on

#BigDataBY

Published in: Software
  • Be the first to comment

  • Be the first to like this

Ramunas Urbonas. The Journey

  1. 1. The JOURNEY Adform explores Hadoop
  2. 2. Ramunas Urbonas @ Adform
  3. 3. Developer first
  4. 4. Development as a journey
  5. 5. High perspective talk
  6. 6. 3 aspects
  7. 7. The JOURNEY Direction / Planning / Equipment
  8. 8. It starts with a goal
  9. 9. Vision
  10. 10. Born of need
  11. 11. Maintenance costs
  12. 12. Time to market
  13. 13. Licensing costs
  14. 14. Hadoop
  15. 15. main data storage alternative reporting
  16. 16. Attack your vision
  17. 17. why storage?
  18. 18. HDFS
  19. 19. Distributed
  20. 20. x 3
  21. 21. Auto-balancing
  22. 22. Can store big files
  23. 23. Resilient
  24. 24. 50% 3%
  25. 25. Files vs Database
  26. 26. Multiple engines on same data
  27. 27. that brings us to...
  28. 28. Alternative reporting
  29. 29. Rich eco-system
  30. 30. HDFS map-reduce hive pig hbase yarn & mr2 spark shark impala druid etc
  31. 31. Different purpose
  32. 32. Different SLAs
  33. 33. Emerging tools
  34. 34. Big community
  35. 35. Beta products
  36. 36. UI
  37. 37. Automation
  38. 38. Confident in vision
  39. 39. main data storage alternative reporting
  40. 40. Building vision vs Maintaining
  41. 41. When left unattended
  42. 42. Narrow focus
  43. 43. Keep it fresh
  44. 44. The JOURNEY Direction / Planning / Equipment
  45. 45. Travelling light
  46. 46. Climbing a mountain
  47. 47. Even harder for Adform
  48. 48. Linux courses
  49. 49. Java
  50. 50. Java backend administration
  51. 51. Memory management
  52. 52. Profiling
  53. 53. Garbage collection
  54. 54. Know Hadoop principles
  55. 55. More climbing ahead
  56. 56. Test everything
  57. 57. Consultants
  58. 58. Abstract
  59. 59. Technical calls
  60. 60. Time consuming
  61. 61. How > What
  62. 62. POC vs Production
  63. 63. The JOURNEY Direction / Planning / Equipment
  64. 64. Commodity hardware
  65. 65. “Commodity hardware”
  66. 66. No SSD / Raids
  67. 67. Desktop cluster?
  68. 68. Our cluster - leftovers
  69. 69. 6-7 years old
  70. 70. Still server machines
  71. 71. Electricity
  72. 72. Burning fuses
  73. 73. Outdated notion?
  74. 74. Tricky question
  75. 75. Best sport shoes?
  76. 76. Basketball?
  77. 77. Football / Jogging / Climbing
  78. 78. Common hardware
  79. 79. 8Gb vs 300Gb
  80. 80. Our bottlenecks
  81. 81. Common bottlenecks
  82. 82. The JOURNEY Continues...
  83. 83. Releasing products
  84. 84. Data imports
  85. 85. Growing team
  86. 86. Upgrading cluster
  87. 87. Impala / Shark
  88. 88. More business areas
  89. 89. Clear vision Plan your learning Careful hardware decissions Thanks!

×