The document discusses strategies for managing exponential growth within organizations, emphasizing the importance of scalable systems and effective hiring practices. It outlines the evolution of computing from manual programming to modern operating system abstractions that enhance efficiency and innovation. Additionally, it defines big data and its associated technologies, highlighting the need for data integration and visualization environments.

1. Wednesday, March 26, 14

2. INVERTING 80/20: BEYOND BESPOKE
BIG DATA
Ari Gesher
Palantir Technologies
Wednesday, March 26, 14
SLIDES BY 3/14 at NOON - TBD.....

3. INVERTING 80/20
Beyond Bespoke Big Data
(or how operating systems change everything)
mailto: agesher@palantir.com
twitter: @alephbass
Ari Gesher, Engineering Ambassador
Wednesday, March 26, 14
! •! Hiring, hiring, hiring - the only way to have this problem (and it’s a good one to have) is to have a hiring machine that’s kicking ass.
! •! Design for growth - make sure your systems (IT, food, etc) can handle exponential growth. Build small, but design scalable
! •! Be most worried about long-lead time resources: hiring, leadership, and real estate
! •! Culture: how it changes, how to preserve it
! •! Discard your old biases - project managers enable scale, but process hinders at small scale

4. Wednesday, March 26, 14
Artillery tables, calculated by people called ‘computers’

5. Wednesday, March 26, 14
Eniac, 1945

6. Wednesday, March 26, 14

7. OS/360 becomes
THE computer
Wednesday, March 26, 14

8. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
Wednesday, March 26, 14

9. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
Wednesday, March 26, 14

10. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
Wednesday, March 26, 14

11. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
• Programmers started with nothing but primitive functionality
Wednesday, March 26, 14

12. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
• Programmers started with nothing but primitive functionality
• Very little of the effort went into building the actual intent of the
software
Wednesday, March 26, 14

13. yak shaving, n
Wednesday, March 26, 14

14. yak shaving, n
1. Any apparently useless activity which, by
allowing you to overcome intermediate
difficulties, allows you to solve a
larger problem.
Wednesday, March 26, 14

15. yak shaving
Any apparently useless activity which, by allowing
you to overcome intermediate difficulties, allows
you to solve a larger problem.
Wednesday, March 26, 14

16. Yaks keep hair
AFTER OPERATING SYSTEMS
Wednesday, March 26, 14

17. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
Wednesday, March 26, 14

18. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
Wednesday, March 26, 14

19. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
• Common functionality (GUI, networking, files) shared by all programs
Wednesday, March 26, 14

20. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
• Common functionality (GUI, networking, files) shared by all programs
• Majority of effort goes into primary purpose
Wednesday, March 26, 14

21. THE RIGHT ABSTRACTION
Wednesday, March 26, 14

22. Wednesday, March 26, 14

23. Wednesday, March 26, 14

24. Wednesday, March 26, 14

25. abstraction creates
efficiency
Wednesday, March 26, 14

26. abstraction creates
SAFETY
Wednesday, March 26, 14

27. abstraction creates
innovation
Wednesday, March 26, 14

28. big data, n
1. Data sets that are too large and complex to
manipulate or interrogate with standard
methods or tools (OED, 2013).
2. A set of technologies and tools designed to
address large-scale data analysis problems.
3. A IT buzzword from the early teens of the
21st century.
Wednesday, March 26, 14

29. Wednesday, March 26, 14

30. Wednesday, March 26, 14

31. OPERATING SYSTEM ABSTRACTIONS
Wednesday, March 26, 14

32. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
Wednesday, March 26, 14

33. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
• Virtual Machine
Wednesday, March 26, 14

34. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
• Virtual Machine
• File system
Wednesday, March 26, 14

35. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
• Virtual Machine
• File system
• Permissions / Access Controls
Wednesday, March 26, 14

36. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
• Virtual Machine
• File system
• Permissions / Access Controls
• Networking
Wednesday, March 26, 14

37. OPERATING SYSTEM ABSTRACTIONS
• Device Drivers
• Virtual Machine
• File system
• Permissions / Access Controls
• Networking
• GUI Toolkits / UI Frameworks
Wednesday, March 26, 14

38. Yaks keep hair
BIG DATA ABSTRACTIONS
Wednesday, March 26, 14

39. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
Wednesday, March 26, 14

40. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
• Virtual object model / Composition Rules
Wednesday, March 26, 14

41. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
• Virtual object model / Composition Rules
• Object revisioning
Wednesday, March 26, 14

42. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
• Virtual object model / Composition Rules
• Object revisioning
• Permissions / Access Control
Wednesday, March 26, 14

43. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
• Virtual object model / Composition Rules
• Object revisioning
• Permissions / Access Control
• Data Exchange / Translation
Wednesday, March 26, 14

44. Yaks keep hair
BIG DATA ABSTRACTIONS
• Data Integration Standards / Pipelines
• Virtual object model / Composition Rules
• Object revisioning
• Permissions / Access Control
• Data Exchange / Translation
• Interactive, integrated, extensible visualization & analysis environment
Wednesday, March 26, 14

45. Wednesday, March 26, 14

46. Wednesday, March 26, 14

47. Wednesday, March 26, 14

48. Wednesday, March 26, 14

49. Wednesday, March 26, 14
MOVIE ON NEXT SLIDE - NO AUDIO

50. Wednesday, March 26, 14
MOVIE FILE _ NO AUDIO

51. Wednesday, March 26, 14
MOVIE FILE _ NO AUDIO

52. FAMILIAR
Wednesday, March 26, 14
MOVIE FILE _ NO AUDIO

53. INTERACTIVE
Wednesday, March 26, 14
MOVIE FILE _ NO AUDIO

54. EXPRESSIVE
Wednesday, March 26, 14
MOVIE FILE _ NO AUDIO

55. Questions?
agesher@palantir.com
Wednesday, March 26, 14

56. Wednesday, March 26, 14