Structure Data 2014: INVERTING 80/20: BEYOND BESPOKE BIG DATA, Ari Gesher

782 views

Published on

Presentation from Ari Gesher, Engineering Ambassador, Palantir Technologies
#gigaomlive
More at http://events.gigaom.com/structuredata-2014/

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
782
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
18
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Structure Data 2014: INVERTING 80/20: BEYOND BESPOKE BIG DATA, Ari Gesher

  1. 1. Wednesday, March 26, 14
  2. 2. INVERTING 80/20: BEYOND BESPOKE BIG DATA Ari Gesher Palantir Technologies Wednesday, March 26, 14 SLIDES BY 3/14 at NOON - TBD.....
  3. 3. INVERTING 80/20 Beyond Bespoke Big Data (or how operating systems change everything) mailto: agesher@palantir.com twitter: @alephbass Ari Gesher, Engineering Ambassador Wednesday, March 26, 14 ! •! Hiring, hiring, hiring - the only way to have this problem (and it’s a good one to have) is to have a hiring machine that’s kicking ass. ! •! Design for growth - make sure your systems (IT, food, etc) can handle exponential growth.  Build small, but design scalable ! •! Be most worried about long-lead time resources: hiring, leadership, and real estate ! •! Culture: how it changes, how to preserve it ! •! Discard your old biases - project managers enable scale, but process hinders at small scale
  4. 4. Wednesday, March 26, 14 Artillery tables, calculated by people called ‘computers’
  5. 5. Wednesday, March 26, 14 Eniac, 1945
  6. 6. Wednesday, March 26, 14
  7. 7. OS/360 becomes THE computer Wednesday, March 26, 14
  8. 8. Yak Shavers, Inc BEFORE OPERATING SYSTEMS Wednesday, March 26, 14
  9. 9. Yak Shavers, Inc BEFORE OPERATING SYSTEMS • Programmers had to write the minutiae of hardware, error codes, etc Wednesday, March 26, 14
  10. 10. Yak Shavers, Inc BEFORE OPERATING SYSTEMS • Programmers had to write the minutiae of hardware, error codes, etc • Writing directly for the hardware of a single computer Wednesday, March 26, 14
  11. 11. Yak Shavers, Inc BEFORE OPERATING SYSTEMS • Programmers had to write the minutiae of hardware, error codes, etc • Writing directly for the hardware of a single computer • Programmers started with nothing but primitive functionality Wednesday, March 26, 14
  12. 12. Yak Shavers, Inc BEFORE OPERATING SYSTEMS • Programmers had to write the minutiae of hardware, error codes, etc • Writing directly for the hardware of a single computer • Programmers started with nothing but primitive functionality • Very little of the effort went into building the actual intent of the software Wednesday, March 26, 14
  13. 13. yak shaving, n Wednesday, March 26, 14
  14. 14. yak shaving, n 1. Any apparently useless activity which, by allowing you to overcome intermediate difficulties, allows you to solve a larger problem. Wednesday, March 26, 14
  15. 15. yak shaving Any apparently useless activity which, by allowing you to overcome intermediate difficulties, allows you to solve a larger problem. Wednesday, March 26, 14
  16. 16. Yaks keep hair AFTER OPERATING SYSTEMS Wednesday, March 26, 14
  17. 17. Yaks keep hair AFTER OPERATING SYSTEMS • OS API is a clean abstraction, hardware agnostic Wednesday, March 26, 14
  18. 18. Yaks keep hair AFTER OPERATING SYSTEMS • OS API is a clean abstraction, hardware agnostic • Hardware can change and code still works Wednesday, March 26, 14
  19. 19. Yaks keep hair AFTER OPERATING SYSTEMS • OS API is a clean abstraction, hardware agnostic • Hardware can change and code still works • Common functionality (GUI, networking, files) shared by all programs Wednesday, March 26, 14
  20. 20. Yaks keep hair AFTER OPERATING SYSTEMS • OS API is a clean abstraction, hardware agnostic • Hardware can change and code still works • Common functionality (GUI, networking, files) shared by all programs • Majority of effort goes into primary purpose Wednesday, March 26, 14
  21. 21. THE RIGHT ABSTRACTION Wednesday, March 26, 14
  22. 22. Wednesday, March 26, 14
  23. 23. Wednesday, March 26, 14
  24. 24. Wednesday, March 26, 14
  25. 25. abstraction creates efficiency Wednesday, March 26, 14
  26. 26. abstraction creates SAFETY Wednesday, March 26, 14
  27. 27. abstraction creates innovation Wednesday, March 26, 14
  28. 28. big data, n 1. Data sets that are too large and complex to manipulate or interrogate with standard methods or tools (OED, 2013). 2. A set of technologies and tools designed to address large-scale data analysis problems. 3. A IT buzzword from the early teens of the 21st century. Wednesday, March 26, 14
  29. 29. Wednesday, March 26, 14
  30. 30. Wednesday, March 26, 14
  31. 31. OPERATING SYSTEM ABSTRACTIONS Wednesday, March 26, 14
  32. 32. OPERATING SYSTEM ABSTRACTIONS • Device Drivers Wednesday, March 26, 14
  33. 33. OPERATING SYSTEM ABSTRACTIONS • Device Drivers • Virtual Machine Wednesday, March 26, 14
  34. 34. OPERATING SYSTEM ABSTRACTIONS • Device Drivers • Virtual Machine • File system Wednesday, March 26, 14
  35. 35. OPERATING SYSTEM ABSTRACTIONS • Device Drivers • Virtual Machine • File system • Permissions / Access Controls Wednesday, March 26, 14
  36. 36. OPERATING SYSTEM ABSTRACTIONS • Device Drivers • Virtual Machine • File system • Permissions / Access Controls • Networking Wednesday, March 26, 14
  37. 37. OPERATING SYSTEM ABSTRACTIONS • Device Drivers • Virtual Machine • File system • Permissions / Access Controls • Networking • GUI Toolkits / UI Frameworks Wednesday, March 26, 14
  38. 38. Yaks keep hair BIG DATA ABSTRACTIONS Wednesday, March 26, 14
  39. 39. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines Wednesday, March 26, 14
  40. 40. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines • Virtual object model / Composition Rules Wednesday, March 26, 14
  41. 41. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines • Virtual object model / Composition Rules • Object revisioning Wednesday, March 26, 14
  42. 42. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines • Virtual object model / Composition Rules • Object revisioning • Permissions / Access Control Wednesday, March 26, 14
  43. 43. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines • Virtual object model / Composition Rules • Object revisioning • Permissions / Access Control • Data Exchange / Translation Wednesday, March 26, 14
  44. 44. Yaks keep hair BIG DATA ABSTRACTIONS • Data Integration Standards / Pipelines • Virtual object model / Composition Rules • Object revisioning • Permissions / Access Control • Data Exchange / Translation • Interactive, integrated, extensible visualization & analysis environment Wednesday, March 26, 14
  45. 45. Wednesday, March 26, 14
  46. 46. Wednesday, March 26, 14
  47. 47. Wednesday, March 26, 14
  48. 48. Wednesday, March 26, 14
  49. 49. Wednesday, March 26, 14 MOVIE ON NEXT SLIDE - NO AUDIO
  50. 50. Wednesday, March 26, 14 MOVIE FILE _ NO AUDIO
  51. 51. Wednesday, March 26, 14 MOVIE FILE _ NO AUDIO
  52. 52. FAMILIAR Wednesday, March 26, 14 MOVIE FILE _ NO AUDIO
  53. 53. INTERACTIVE Wednesday, March 26, 14 MOVIE FILE _ NO AUDIO
  54. 54. EXPRESSIVE Wednesday, March 26, 14 MOVIE FILE _ NO AUDIO
  55. 55. Questions? agesher@palantir.com Wednesday, March 26, 14
  56. 56. Wednesday, March 26, 14

×