Upcoming SlideShare
×

# SciPy India 2009

6,601 views

Published on

Travis Oliphant gives a review of the SciPy India 2009 conference.

Published in: Technology, Education
0 Likes
Statistics
Notes
• Full Name
Comment goes here.

Are you sure you want to Yes No
• Be the first to comment

• Be the first to like this

Views
Total views
6,601
On SlideShare
0
From Embeds
0
Number of Embeds
38
Actions
Shares
0
96
0
Likes
0
Embeds 0
No embeds

No notes for slide

### SciPy India 2009

1. SciPy India November 20, 2009
2. Trivandrum, Kerala, India
4. Tutorials
5. My Story of SciPy
6. In the beginning....
7. was Guido.... http://python-history.blogspot.com/2009/01/brief-timeline-of-python.html Version Date 0.9.0 Feb. 1991 0.9.4 Dec. 1991 0.9.6 Apr. 1992 0.9.8 Jan. 1993 1.0.0 Jan. 1994 1.2 Apr. 1995 1.4 Oct. 1996 1.5.2 Apr. 1999
8. Jim Fulton Created ﬁrst Matrix object Released it to the net in 1994 Started getting feedback on Matrix-SIG Convinced Guido to change some syntax a[0,1] instead of a[(0,1)] a[::2] instead of only a[:] Ellipsis operator Complex numbers
9. Jim Hugunin
10. Konrad Hinsen Contributed complex numbers to Python Created ScientiﬁcPython (a collection of packages for doing a variety of things --- 26 Jul 1999) Extremely helpful on mailing list in early discussions. Wrote tutorial to Numeric C- API
11. Paul Dubois Took over as lead NumPy developer when Jim Hugunin went on to write Jython. Funded ﬁrst documentation for Numeric Python. Created Computing in Science and Engineering special edition devoted to Python.
12. David Ascher Wrote initial documentation for Numeric Python with funding from LLNL. Active on mailing lists and in discussions until about 2001. Became CEO of Mozilla Messaging
13. How did I end up involved with NumPy and SciPy?
14. Early beginnings (1971 - 1989) N N (N + 1) k= 2 k=1
15. Maxwell’s Equations (1990 - ∂B ×E = − ·D = ρ ∂t ?? ∂D ×H = J+ ∂t ·B = 0
16. Electrical Engineering ... so I could get a real job! Electromagnetics Probability Theory Signal Processing
17. Master’s Degree
18. Transition to Biomedical Engineering 1996
19. Magnetic Resonance Elastography 1997 Richard Ehman Armando Manduca Raja Muthupillai 2 ρ0 (2πf ) Ui (a, f ) = [Cijkl (a, f ) Uk,l (a, f )],j
20. Finding Derivatives of 5-d data UX (a, f ) UY (a, f ) UZ (a, f )
21. Finding Derivatives of 5-d data Ξ= ×U ΞX (a, f ) ΞY (a, f ) ΞZ (a, f )
22. Found Python and Numeric in 1997 I was a pretty proficient MATLAB user, but it was not memory efficient enough. Loved the expressive syntax of Python Loved the fact that slicing didn’t make copies Loved the existing multiple data-types Loved how much more ﬂexible it was to extend than MATLAB was Loved that I could read the source code and extend it
23. First problem: Efficient Data Input “It’s All About the Data” Reference Counting Essay TableIO http://www.python.org/doc/essays/refcnt/ April 1998 May 1998 Michael A. Miller Guido van Rossum NumPyIO June 1998
24. Early pieces of SciPy fftw wrappers cephesmodule June 1998 November 1998 stats.py December 1998 Gary Strangman
25. 1999 : Early SciPy emerges Discussions on the matrix-sig from 1997 to 1999 wanting a complete data analysis environment: Paul Berrett, Joe Harrington, Perry Greenfield, Paul Dubois, Konrad Hinsen, and others. Activity in 1998, led to increased interest in 1999. In response on 15 Jan, 1999, I posted to matrix-sig a list of routines I felt needed to be present and began wrapping / writing in earnest. On 6 April 1999, I announced I would be creating this uber-package which eventually became SciPy Gaussian quadrature 5 Jan 1999 cephes 1.0 30 Jan 1999 sigtools 0.40 23 Feb 1999 Numeric docs March 1999 cephes 1.1 9 Mar 1999 Plotting?? multipack 0.3 13 Apr 1999 Helper routines 14 Apr 1999 Gist XPLOT multipack 0.6 (leastsq, ode, 29 Apr 1999 fsolve, quad) DISLIN sparse plan described 30 May 1999 Gnuplot multipack 0.7 14 Jun 1999 Helping with f2py SparsePy 0.1 5 Nov 1999 cephes 1.2 (vectorize) 29 Dec 1999
26. Early helpers in 1999 Hosting of first Multipack CVS repository (June 1999) Amazing makefiles Interface to FITPACK Wrote f2py as he watched my brute-force approach (July 1999) Pearu Peterson (IPP) Early IPython interactive environment (27 Apr 1999) Matlab file reader (24 Apr 1999) Janko Hauser Created windows binaries of multipack, cephesmodule, fftw, and signaltools (June 1999 while still in high school!) Robert Kern
27. Early 2000 : Numeric needs • Memory mapped arrays • Rank-0 arrays or scalars • Handling indirect and masked indexing • More attributes to N-d arrays
28. 2000-2001
29. SciPy 2001 Founded in 2001 with Travis Vaught stats.py Eric Jones weave cluster Pearu Peterson GA linalg interpolate f2py
30. Finally... Plotting John Hunter 2001
31. IPython (building on IPP) Fernando Perez Dec 10, 2001
32. Research Teaching
33. SciPy work at BYU from students Iterative solvers Special Function tests Some additions to Numeric No time for Numeric overhaul contemplated in early 2000!
34. STSCI leads out with Numarray Perry Greenﬁeld J. Todd Miller Rick White Paul Barrett
35. Numarray released in 2003 • too slow for small arrays • incomplete implementation for ufuncs • minimal Numeric code re-use • lots of very nice things, though (e.g. memory maps, fast code for large arrays, better sorting algorithms)
36. Split in the community Numeric SciPy Numarray ndimage others
37. ndimage
38. started January 2005 NumPy Version 1.0 October 2006 Special Thanks to: Chuck Harris Robert Kern David Cooke
39. NumPy in Python Q: When is NumPy going to be part of the core Python? A: Data structure is in Python as PEP 3118
40. Transition to Industry in 2007
41. Many essential contributors now... • Chuck Harris • David Cournapeau • Pauli Virtanen • Stefan van der Walt • Jarrod Millman • Dag Sverre Seljebotn • Matthew Brett • Anne Archibald • Josef Perktold • many, many others... (forgive me)
42. Applications of Python / SciPy
43. MRI simulator and MRI reconstruction
44. Ultrasound Signal Processing
45. Elastography reconstruction Ehman, et.al.
46. Simple FMRI reconstruction from http://www.fmrib.ox.ac.uk/fmri_intro/brief.html
47. Scanning Impedance Imaging
49. Fluid Characterization -- Microrheology
50. Oil & Gas Shell Stochastic Seismic Analysis Pore Pressure Analysis Electromagnetic Analysis Seismic Visualization
51. VMS – Virtual Mixing System • Design Drawings • Computational Fluid Dynamics • Parallel Simulation • Data Visualization
52. High Speed Signal Integrity Testing
53. Enthought Python Distribution (EPD)
54. Enthought Tool Suite
55. Programming Language Book Market * Courtesy O’reilly Publishing. Used with permission.
56. SciPy • A package ... • A series of conferences – SciPy US (9th at end of June 2010) – SciPy Europe (3rd one in July 2010) – SciPy India • A community – scikits – external packages – web-page wiki – documentation efforts
57. SciPy Unique Visits – 2009 (~400K total) (first half of) Universities Labs Location Visits Location Visits MIT 2965 NASA 2378 Harvard 1553 LANL 508 Stanford 1534 LLNL 420 Cambridge 1214 LBNL 368 CalTech 1121 ORNL 205 Cornell 1109 Brookhaven 172 U Wash 1011 Argonne 158 Berkeley 958 PNL 100 Oxford 811 Univ. BC 795
58. SciPy Unique Visits – 2009 (~400K total) (first half of) Tech Sampling Industrial Sampling Location Visits Location Visits Seagate 1018 Boeing 286 Intel 390 Caterpillar 205 Microsoft 246 Airbus 158 HP 241 P&G 51 IBM 146 Rolls Royce 30 Google 85 Freescale 64
59. SciPy Unique Visits – 2009 (~400K total) (first half of) Financial Sampling Oil Sampling Location Visits Location Visits DE Shaw 693 Shell 160 Citadel 373 Stat Oil 155 JP Morgan 340 Schlumberger 110 Softbank 315 Exxon 76 Goldman Sachs 273 ConocoPhillips 27 AQR Capital 171 Aramco 27 Susquehanna 159 UBS 160 Tradelink 129 Deutsche Bank 78 Merrill Lynch 77 CitiGroup 62 Morgan Stanley 40 Renaissance 20
60. In 2009 North America
61. In 2009 Europe
62. In 2009 India
63. Thank You!!! • Prabhu Ramachandran • Jarrod Millman • Vimal Josef (SPACE) • FOSSEE Team • National Missionon Education • Kerala State IT Mission • SIG-FOSS of CSI • Asokan Pichai • All Speakers at Conference • All Attendees at Conference
64. Scientific Python Classes http://www.enthought.com/training Feb 22-26 May 17-21 Python for Scientists and Engineers (3 days) Advanced Modules (2 days) Aug 23-27 Take both together to receive a discount