This document summarizes an introduction to data analysis in Python using Wakari. It discusses why Python is a good language for data analysis, highlighting key Python packages like NumPy, Pandas, Matplotlib and IPython. It also introduces Wakari, a browser-based Python environment for collaborative data analysis and reproducible research. Wakari allows sharing of code, notebooks and data through a web link. The document recommends several talks at the PyData conference on efficient computing, machine learning and interactive plotting.

1. Intro to Python Data Analysis in
Wakari
Karissa McKelvey
Software Developer
Continuum Analytics
@karissamck
November 8, 2013
PyData NYC

2. $ WHOAMI
karissamck.com
@karissamck

3. truthy.indiana.edu

4. More Tweets, Mote Votes

5. MY GOALS
Get you excited about data analysis in Wakari
Walk through some basic analysis packages
and wakari workflows
Kick-start your journey

6. WHO ARE YOU?

14. Putting Science back in Comp Sci
• Much of the software stack is for systems
programming --- C++, Java, .NET, ObjC, web
- Complex numbers?
- Vectorized primitives?
• Software stack for scientists is not as helpful
as it should be
• Fortran is still where many scientists end up

16. Why Python?

17. High Performance with BIG DATA

18. Packages for data analysis and visualization

19. Syntax – Gets out of your way

20. Community Driven

21. Ready for web applications, too.

23. • “Python is good for data cleanup, R for
statistical models”
“Which is the better Data Analysis language? R or Python?” Quora.
http://www.quora.com/Data-Analysis/Which-is-the-better-Data-analysis-language-R-or-Python

24. • “Python is good for data cleanup, R for
statistical models”
• “R is quirky and weird but the statisticians love
it and there really isn’t any compelling reason
to switch”
“Which is the better Data Analysis language? R or Python?” Quora.
http://www.quora.com/Data-Analysis/Which-is-the-better-Data-analysis-language-R-or-Python

25. • “Python is good for data cleanup, R for
statistical models”
• “R is quirky and weird but the statisticians love
it and there really isn’t any compelling reason
to switch”
• “You’re running an MCMC simulation on a
laptop? Perhaps you should write it in
C++/FORTRAN”
“Which is the better Data Analysis language? R or Python?” Quora.
http://www.quora.com/Data-Analysis/Which-is-the-better-Data-analysis-language-R-or-Python

26. “You’re running an MCMC simulation on
a laptop? Perhaps you should write it in
C++/FORTRAN”
Ready for DATA, and then some

27. Numba: just-in-time compiler to LLVM
through @decorators
numba.pydata.org

28. Numba: just-in-time compiler to LLVM
through @decorators*
numba.pydata.org
*aka, fast. easy.

30. Basic packages for data analysis and visualization

31. NumPy: The foundation of the
Python Data Analysis stack

32. NumPy: Array-oriented

36. Pandas: Builds upon NumPy

37. Matplotlib: 2D plotting library

38. IPython: Interactive Python
(+ in the Web)
tab completion
magic %-commands
Inline plots

39. Anaconda: pulls it all together

41. wakari.io
Browser-based Python & Linux environment

42. IPython Notebook
Scientific Packages
Terminal
Share files, IPython notebooks, and plots with pay-as-you-go compute

43. Sharing in Wakari
• Packages IPython
notebooks, files, folders, data, and
environment
• Get a link
• Share that link.

44. Reproducible Research

46. “A rule of thumb among biotechnology venture
capitalists is that half of published research
cannot be replicated”

47. How do we replicate research today?

48. collaborate on
How do we replicate research today?

49. collaborate on
How do we replicate research today?
data analysis

50. How do we collaborate today?

51. How do we collaborate today?

52. How do we collaborate today?

53. How do we collaborate today?

54. ????????

55. How do we replicate research today?

56. wakari.io
Browser-based Python & Linux environment

57. Enterprise or Cloud
Online at wakari.io or install locally for access to your hardware and data

58. wakari.io
Browser-based Python & Linux environment

59. Coming Soon

60. Project-based interaction
user
Projects starting at 10$/month with unlimited team members

61. Interactive Plotting
Next-generation collaborative data manipulation, analysis, and presentation

62. Talks to see
• Jack Vanderplas (Washington)
– Efficient computing with Numpy
• 29th Floor combo 3pm (Right now, next door!)
• Julia Evans (N/A)
– A practical introduction to IPython Notebook &
pandas
• Here, 4:45pm.

63. Talks to see
• Sarah Guido (Michigan)
– A Beginner’s Guide to Machine Learning with
scikit-learn
• Imram Haque (Counsyl)
– Beyond the dict
• Peter Wang (Continuum)
– Bokeh Workshop

64. Special Thanks
Ben Zaitlin
Mark Florisson
Clayton Davis
Bryan Van de Ven
Travis Oliphant

65. Karissa McKelvey
@karissamck