Travis Oliphant gives a review of the SciPy India 2009 conference.

1. SciPy India
November 20, 2009

3. Trivandrum, Kerala, India

7. Organizers and Sponsors

14. Tutorials

17. My Story of SciPy

18. In the beginning....

19. was Guido.... http://python-history.blogspot.com/2009/01/brief-timeline-of-python.html
Version Date
0.9.0 Feb. 1991
0.9.4 Dec. 1991
0.9.6 Apr. 1992
0.9.8 Jan. 1993
1.0.0 Jan. 1994
1.2 Apr. 1995
1.4 Oct. 1996
1.5.2 Apr. 1999

20. Jim Fulton
Created first Matrix object
Released it to the net in 1994
Started getting feedback on Matrix-SIG
Convinced Guido to change some syntax
a[0,1] instead of a[(0,1)]
a[::2] instead of only a[:]
Ellipsis operator
Complex numbers

21. Jim Hugunin

22. Konrad Hinsen
Contributed complex
numbers to Python
Created ScientificPython (a
collection of packages for doing a
variety of things --- 26 Jul 1999)
Extremely helpful on mailing
list in early discussions.
Wrote tutorial to Numeric C-
API

23. Paul Dubois
Took over as lead NumPy
developer when Jim Hugunin
went on to write Jython.
Funded first documentation
for Numeric Python.
Created Computing in
Science and Engineering special
edition devoted to Python.

24. David Ascher
Wrote initial
documentation for Numeric
Python with funding from
LLNL.
Active on mailing lists and
in discussions until about
2001.
Became CEO of Mozilla
Messaging

25. How did I end up involved with NumPy
and SciPy?

26. Early beginnings (1971 - 1989)
N
N (N + 1)
k=
2
k=1

27. Maxwell’s Equations (1990 -
∂B
×E = −
·D = ρ
∂t ??
∂D
×H = J+
∂t
·B = 0

28. Electrical Engineering ... so I could get a real job!
Electromagnetics
Probability Theory Signal Processing

29. Master’s Degree

30. Transition to Biomedical Engineering 1996

31. Magnetic Resonance Elastography 1997
Richard Ehman
Armando Manduca
Raja Muthupillai
2
ρ0 (2πf ) Ui (a, f ) = [Cijkl (a, f ) Uk,l (a, f )],j

32. Finding Derivatives of 5-d data
UX (a, f ) UY (a, f )
UZ (a, f )

33. Finding Derivatives of 5-d data
Ξ= ×U
ΞX (a, f ) ΞY (a, f )
ΞZ (a, f )

34. Found Python and Numeric in 1997
I was a pretty proficient MATLAB user, but it was not memory efficient enough.
Loved the expressive syntax of Python
Loved the fact that slicing didn’t make copies
Loved the existing multiple data-types
Loved how much more flexible it was to
extend than MATLAB was
Loved that I could read the source code and
extend it

35. First problem: Efficient Data Input
“It’s All About the Data”
Reference Counting Essay
TableIO http://www.python.org/doc/essays/refcnt/
April 1998 May 1998
Michael A. Miller Guido van Rossum
NumPyIO
June 1998

36. Early pieces of SciPy
fftw wrappers cephesmodule
June 1998 November 1998
stats.py
December 1998
Gary
Strangman

37. 1999 : Early SciPy emerges
Discussions on the matrix-sig from 1997 to 1999 wanting a complete data analysis
environment: Paul Berrett, Joe Harrington, Perry Greenfield, Paul Dubois, Konrad
Hinsen, and others. Activity in 1998, led to increased interest in 1999.
In response on 15 Jan, 1999, I posted to matrix-sig a list of routines I felt needed to
be present and began wrapping / writing in earnest. On 6 April 1999, I
announced I would be creating this uber-package which eventually became SciPy
Gaussian quadrature 5 Jan 1999
cephes 1.0 30 Jan 1999
sigtools 0.40 23 Feb 1999
Numeric docs March 1999
cephes 1.1 9 Mar 1999
Plotting??
multipack 0.3 13 Apr 1999
Helper routines 14 Apr 1999
Gist
XPLOT
multipack 0.6 (leastsq, ode, 29 Apr 1999
fsolve, quad) DISLIN
sparse plan described 30 May 1999 Gnuplot
multipack 0.7 14 Jun 1999
Helping with f2py
SparsePy 0.1 5 Nov 1999
cephes 1.2 (vectorize) 29 Dec 1999

38. Early helpers in 1999
Hosting of first Multipack CVS repository (June 1999)
Amazing makefiles
Interface to FITPACK
Wrote f2py as he watched my brute-force approach (July 1999)
Pearu Peterson
(IPP) Early IPython interactive environment (27 Apr 1999)
Matlab file reader (24 Apr 1999)
Janko Hauser
Created windows binaries of multipack, cephesmodule,
fftw, and signaltools (June 1999 while still in high school!)
Robert Kern

39. Early 2000 : Numeric needs
• Memory mapped arrays
• Rank-0 arrays or scalars
• Handling indirect and masked indexing
• More attributes to N-d arrays

40. 2000-2001

41. SciPy 2001
Founded in 2001 with Travis Vaught
stats.py
Eric Jones
weave
cluster
Pearu Peterson GA
linalg
interpolate
f2py

42. Finally... Plotting
John Hunter
2001

43. IPython (building on IPP)
Fernando Perez
Dec 10, 2001

44. Research
Teaching

45. SciPy work at BYU from students
Iterative solvers
Special Function
tests
Some additions to
Numeric
No time for Numeric overhaul contemplated in early 2000!

46. STSCI leads out with Numarray
Perry Greenfield
J. Todd Miller
Rick White
Paul Barrett

47. Numarray released in 2003
• too slow for small arrays
• incomplete implementation for ufuncs
• minimal Numeric code re-use
• lots of very nice things, though (e.g. memory
maps, fast code for large arrays, better
sorting algorithms)

48. Split in the community
Numeric
SciPy
Numarray
ndimage
others

49. ndimage

50. started January 2005
NumPy
Version 1.0 October 2006
Special Thanks to:
Chuck Harris
Robert Kern
David Cooke

51. NumPy in Python
Q: When is NumPy going to be part of the
core Python?
A: Data structure is in Python as PEP 3118

53. Transition to Industry in 2007

54. Many essential contributors now...
• Chuck Harris
• David Cournapeau
• Pauli Virtanen
• Stefan van der Walt
• Jarrod Millman
• Dag Sverre Seljebotn
• Matthew Brett
• Anne Archibald
• Josef Perktold
• many, many others... (forgive me)

55. Applications of Python / SciPy

56. MRI simulator and MRI reconstruction

57. Ultrasound Signal Processing

58. Elastography
reconstruction
Ehman, et.al.

59. Simple FMRI reconstruction
from
http://www.fmrib.ox.ac.uk/fmri_intro/brief.html

60. Scanning Impedance Imaging

61. A little about Enthought...

62. Fluid Characterization -- Microrheology

63. Oil & Gas Shell
Stochastic Seismic Analysis Pore Pressure Analysis
Electromagnetic Analysis Seismic Visualization

64. VMS – Virtual Mixing System
• Design Drawings
• Computational Fluid Dynamics
• Parallel Simulation
• Data Visualization

65. High Speed Signal
Integrity Testing

66. Enthought Python Distribution (EPD)

67. Enthought Tool Suite

68. Programming Language Book Market
* Courtesy O’reilly Publishing. Used with permission.

69. SciPy
• A package ...
• A series of conferences
– SciPy US (9th at end of June 2010)
– SciPy Europe (3rd one in July 2010)
– SciPy India
• A community
– scikits
– external packages
– web-page wiki
– documentation efforts

70. SciPy Unique Visits – 2009 (~400K total)
(first half of)
Universities Labs
Location Visits Location Visits
MIT 2965 NASA 2378
Harvard 1553 LANL 508
Stanford 1534 LLNL 420
Cambridge 1214 LBNL 368
CalTech 1121 ORNL 205
Cornell 1109 Brookhaven 172
U Wash 1011 Argonne 158
Berkeley 958 PNL 100
Oxford 811
Univ. BC 795

71. SciPy Unique Visits – 2009 (~400K total)
(first half of)
Tech Sampling Industrial Sampling
Location Visits Location Visits
Seagate 1018 Boeing 286
Intel 390 Caterpillar 205
Microsoft 246 Airbus 158
HP 241 P&G 51
IBM 146 Rolls Royce 30
Google 85
Freescale 64

72. SciPy Unique Visits – 2009 (~400K total)
(first half of)
Financial Sampling Oil Sampling
Location Visits Location Visits
DE Shaw 693 Shell 160
Citadel 373 Stat Oil 155
JP Morgan 340 Schlumberger 110
Softbank 315 Exxon 76
Goldman Sachs 273 ConocoPhillips 27
AQR Capital 171 Aramco 27
Susquehanna 159
UBS 160
Tradelink 129
Deutsche Bank 78
Merrill Lynch 77
CitiGroup 62
Morgan Stanley 40
Renaissance 20

73. In 2009
North America

74. In 2009
Europe

75. In 2009
India

76. Thank You!!!
• Prabhu Ramachandran
• Jarrod Millman
• Vimal Josef (SPACE)
• FOSSEE Team
• National Missionon Education
• Kerala State IT Mission
• SIG-FOSS of CSI
• Asokan Pichai
• All Speakers at Conference
• All Attendees at Conference

77. Scientific Python Classes
http://www.enthought.com/training
Feb 22-26
May 17-21 Python for Scientists and Engineers (3 days)
Advanced Modules (2 days)
Aug 23-27 Take both together to receive a discount