SlideShare a Scribd company logo
1 of 19
Download to read offline
Esri International User Conference | San Diego, CA
Technical Workshops | Tuesday, July 12th


Python: Integrating Standard and
Third-Party Libraries
Jason Scheirer
Other Sessions
•   Building Tools with Python (Technical Workshop)

     -   Thursday 10:15AM 9

•   Getting Started With Map Algebra Using the Raster Calculator and Python (Demo Theater Presentation)

     -   Wednesday 10:00AM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Python - Analyzing your GPS tracking data (Demo Theater Presentation)

     -   Thursday 11:00AM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Python - Automating Geodatabase Administration (Tech Workshop 20 Minute)

     -   Thursday 11:05AM 23 B

•   Python - Creating an ArcGIS Script Tool (Demo Theater Presentation)

     -   Tuesday 4:00PM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Python - Getting Started (Technical Workshop)

     -   Tuesday 1:30PM 2
     -   Thursday 8:30AM 2
Other Sessions (continued)
•   Python - Getting to know the Python Window (Demo Theater Presentation)

     -   Tuesday 10:00AM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Python - Improving the Performance of your Script Tools (Tech Workshop 20 Minute)

     -   Tuesday 8:30AM 6 A

•   Python - Raster Analysis (Technical Workshop)

     -   Tuesday 3:15PM 6 C
     -   Wednesday 3:15PM 5 A/B

•   Python - Scripting for Map Automation (Technical Workshop)

     -   Tuesday 10:15AM 9
     -   Wednesday 3:15PM 9

•   Python - Spatial Analysis (Intermediate) (Technical Workshop)

     -   Tuesday 3:15PM 1 A/B
     -   Thursday 10:15AM 2
Other Sessions (yes, there are more)
•   Python - The Ease and Power of Cursors (Demo Theater Presentation)

     -   Tuesday 11:30AM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Python Scripts - Using A Template (Demo Theater Presentation)

     -   Tuesday 11:00AM Exhibit Hall C (Spatial Analysis Demo Theater)

•   Road Ahead - Python Scripting Abilities

     -   Thursday 4:05PM 6 B
Python in ArcGIS
 •   Implementing geoprocessing script tools
      -   Creating an ArcGIS Script Tool (Tuesday 4:00PM)
      -   Building Tools with Python (Thursday 10:15AM)

 •   Automating workflows
      -   Gluing together other GP tools

      -   Scheduled tasks

 •   Integrating ArcGIS with other systems, other systems
     into ArcGIS
      -   Data interop: import/export
      -   Automating ArcGIS processes from other applications
      -   Preparing data from ArcGIS for consumption by other applications
Built-in Libraries
Batteries Included
 •   Libraries for many common tasks come with the
     language
     -   File formats: XML (DOM, SAX, ElementTree), JSON, CSV, .ZIP
         (zipfile)
     -   Networking: HTTP (urllib, urllib2), TCP/UDP (socket)
     -   Parallelism: threading, multiprocessing, subprocess
     -   Command line applications: optparse
     -   Paths, directories, files: sys, os, os.path
     -   User Interfaces: tkinter
     -   Data structures and algorithms: collections, itertools,
         heapq, struct, many more
     -   Date/time (time, datetime)
     -   Calling C++/C (ctypes)
Read the Docs!
•   Help file: ArcGIS 10.0 | Python 2.6 | Python Manuals
Read the Docs!
•   What’s installed: ArcGIS 10.0 | Python 2.6 | Module Docs
More Help

•   PyMOTW (Python Module of the Week)
    -   http://www.doughellmann.com/PyMOTW/
    -   Also available as a book
Example


            •   Summary Statistics in R
                -   Uses a third-party module for reading spatial data: maptools
                -   Only accepts shapefiles!
            •   Going to use two different system libraries:
                -   subprocess (Open/monitor other programs)
                -   re (Regular Expressions)



CopyFeatures to temporary Shapefile    Run R Script   Clean up temp file   Parse R Script’s Output




                                                                              Statistics!
Demo
But don’t reinvent the wheel!


  •   wget: Popular utility to download resources over
      HTTP/FTP
  •   Do I need it?
       -   urllib2 can download simple URLs
  •   But I need to follow links
       -   Don’t write a web spider in Python, use the –r option on
           wget
       -   Use subprocess, like in the previous example
Third-Party Libraries
The Cheese Shop
  •   http://pypi.python.org/pypi
  •   The official place for 3rd party Python modules
Some Interesting Modules
  •   PDF writing – reportlab
  •   Image manipulation – PIL
  •   (Messy) HTML – beautifulsoup
  •   Advanced graphing/plotting – matplotlib
  •   Advanced date/time handling – dateutil
  •   Excel
      -   Read – xlrd
      -   Write – xlwt
  •   Consuming .Net
      -   http://pythonnet.sourceforge.net/
  •   .docx Read/write – docx
      -   https://github.com/mikemaccana/python-docx
      -   This brings us to…
There’s No Installer!


  •   Find python.exe in your install, add it to %PATH%.
      Scripts too.
  •   Try pip:
       -   http://python-distribute.org/
  •   Or on the command line:
       -   python.exe setup.py install
  •   Look for it on an unofficial Python library builds site:
       -   http://www.lfd.uci.edu/~gohlke/pythonlibs/
Conclusion


  •   A lot of what you need is already there
  •   Amazing documentation at your fingertips, more online
  •   There are built-in ways of interfacing with non-Python
      utilities (great for using script tools to integrate into
      ArcGIS)
  •   There’s a HUGE ecosystem out there that probably
      already has what you need
Esri International User Conference 2011: Python: Integrating Standard and Third-Party Libraries

More Related Content

What's hot

Protocol libraries the right way
Protocol libraries the right wayProtocol libraries the right way
Protocol libraries the right wayLeo Zhou
 
Buzzwords Numba Presentation
Buzzwords Numba PresentationBuzzwords Numba Presentation
Buzzwords Numba Presentationkammeyer
 
Scientific Plotting in Python
Scientific Plotting in PythonScientific Plotting in Python
Scientific Plotting in PythonJack Parmer
 
Python VS GO
Python VS GOPython VS GO
Python VS GOOfir Nir
 
Object Detection with Tensorflow
Object Detection with TensorflowObject Detection with Tensorflow
Object Detection with TensorflowElifTech
 
Numba: Flexible analytics written in Python with machine-code speeds and avo...
Numba:  Flexible analytics written in Python with machine-code speeds and avo...Numba:  Flexible analytics written in Python with machine-code speeds and avo...
Numba: Flexible analytics written in Python with machine-code speeds and avo...PyData
 
Map Analytics in Starcraft II
Map Analytics in Starcraft IIMap Analytics in Starcraft II
Map Analytics in Starcraft IIgy8
 
Go: Beyond the Basics
Go: Beyond the BasicsGo: Beyond the Basics
Go: Beyond the BasicsJoey Gibson
 
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...Intel® Software
 

What's hot (10)

Protocol libraries the right way
Protocol libraries the right wayProtocol libraries the right way
Protocol libraries the right way
 
Buzzwords Numba Presentation
Buzzwords Numba PresentationBuzzwords Numba Presentation
Buzzwords Numba Presentation
 
Scientific Plotting in Python
Scientific Plotting in PythonScientific Plotting in Python
Scientific Plotting in Python
 
Python VS GO
Python VS GOPython VS GO
Python VS GO
 
Object Detection with Tensorflow
Object Detection with TensorflowObject Detection with Tensorflow
Object Detection with Tensorflow
 
Numba: Flexible analytics written in Python with machine-code speeds and avo...
Numba:  Flexible analytics written in Python with machine-code speeds and avo...Numba:  Flexible analytics written in Python with machine-code speeds and avo...
Numba: Flexible analytics written in Python with machine-code speeds and avo...
 
Map Analytics in Starcraft II
Map Analytics in Starcraft IIMap Analytics in Starcraft II
Map Analytics in Starcraft II
 
Go: Beyond the Basics
Go: Beyond the BasicsGo: Beyond the Basics
Go: Beyond the Basics
 
FleetDB
FleetDBFleetDB
FleetDB
 
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...
Accelerate Your Python* Code through Profiling, Tuning, and Compilation Part ...
 

Similar to Esri International User Conference 2011: Python: Integrating Standard and Third-Party Libraries

Esri South Africa Python for Everyone
Esri South Africa Python for EveryoneEsri South Africa Python for Everyone
Esri South Africa Python for EveryoneEsri South Africa
 
Reproducibility and automation of machine learning process
Reproducibility and automation of machine learning processReproducibility and automation of machine learning process
Reproducibility and automation of machine learning processDenis Dus
 
How to write a well-behaved Python command line application
How to write a well-behaved Python command line applicationHow to write a well-behaved Python command line application
How to write a well-behaved Python command line applicationgjcross
 
Python and GIS: Improving Your Workflow
Python and GIS: Improving Your WorkflowPython and GIS: Improving Your Workflow
Python and GIS: Improving Your WorkflowJohn Reiser
 
Overview of Modern Graph Analysis Tools
Overview of Modern Graph Analysis ToolsOverview of Modern Graph Analysis Tools
Overview of Modern Graph Analysis ToolsKeiichiro Ono
 
from ai.backend import python @ pycontw2018
from ai.backend import python @ pycontw2018from ai.backend import python @ pycontw2018
from ai.backend import python @ pycontw2018Chun-Yu Tseng
 
Cytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsCytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsKeiichiro Ono
 
Python For Audio Signal Processing ( PDFDrive ).pdf
Python For Audio Signal Processing ( PDFDrive ).pdfPython For Audio Signal Processing ( PDFDrive ).pdf
Python For Audio Signal Processing ( PDFDrive ).pdfshaikriyaz89
 
Monitoraggio del Traffico di Rete Usando Python ed ntop
Monitoraggio del Traffico di Rete Usando Python ed ntopMonitoraggio del Traffico di Rete Usando Python ed ntop
Monitoraggio del Traffico di Rete Usando Python ed ntopPyCon Italia
 
Analysing GitHub commits with R
Analysing GitHub commits with RAnalysing GitHub commits with R
Analysing GitHub commits with RBarbara Fusinska
 
Python in geospatial analysis
Python in geospatial analysisPython in geospatial analysis
Python in geospatial analysisSakthivel R
 
How to integrate python into a scala stack
How to integrate python into a scala stackHow to integrate python into a scala stack
How to integrate python into a scala stackFliptop
 
Travis Oliphant "Python for Speed, Scale, and Science"
Travis Oliphant "Python for Speed, Scale, and Science"Travis Oliphant "Python for Speed, Scale, and Science"
Travis Oliphant "Python for Speed, Scale, and Science"Fwdays
 
Practical automation for beginners
Practical automation for beginnersPractical automation for beginners
Practical automation for beginnersSeoweon Yoo
 
Matplotlib presentation 20 apr2013 final
Matplotlib presentation 20 apr2013   finalMatplotlib presentation 20 apr2013   final
Matplotlib presentation 20 apr2013 finalpythonsd
 
Presto as a Service - Tips for operation and monitoring
Presto as a Service - Tips for operation and monitoringPresto as a Service - Tips for operation and monitoring
Presto as a Service - Tips for operation and monitoringTaro L. Saito
 
HiPEAC 2019 Tutorial - Maestro RTOS
HiPEAC 2019 Tutorial - Maestro RTOSHiPEAC 2019 Tutorial - Maestro RTOS
HiPEAC 2019 Tutorial - Maestro RTOSTulipp. Eu
 
Monitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance AnalysisMonitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance AnalysisBrendan Gregg
 

Similar to Esri International User Conference 2011: Python: Integrating Standard and Third-Party Libraries (20)

Esri South Africa Python for Everyone
Esri South Africa Python for EveryoneEsri South Africa Python for Everyone
Esri South Africa Python for Everyone
 
Reproducibility and automation of machine learning process
Reproducibility and automation of machine learning processReproducibility and automation of machine learning process
Reproducibility and automation of machine learning process
 
Python ml
Python mlPython ml
Python ml
 
How to write a well-behaved Python command line application
How to write a well-behaved Python command line applicationHow to write a well-behaved Python command line application
How to write a well-behaved Python command line application
 
Python and GIS: Improving Your Workflow
Python and GIS: Improving Your WorkflowPython and GIS: Improving Your Workflow
Python and GIS: Improving Your Workflow
 
Overview of Modern Graph Analysis Tools
Overview of Modern Graph Analysis ToolsOverview of Modern Graph Analysis Tools
Overview of Modern Graph Analysis Tools
 
from ai.backend import python @ pycontw2018
from ai.backend import python @ pycontw2018from ai.backend import python @ pycontw2018
from ai.backend import python @ pycontw2018
 
PyData Boston 2013
PyData Boston 2013PyData Boston 2013
PyData Boston 2013
 
Cytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsCytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis Tools
 
Python For Audio Signal Processing ( PDFDrive ).pdf
Python For Audio Signal Processing ( PDFDrive ).pdfPython For Audio Signal Processing ( PDFDrive ).pdf
Python For Audio Signal Processing ( PDFDrive ).pdf
 
Monitoraggio del Traffico di Rete Usando Python ed ntop
Monitoraggio del Traffico di Rete Usando Python ed ntopMonitoraggio del Traffico di Rete Usando Python ed ntop
Monitoraggio del Traffico di Rete Usando Python ed ntop
 
Analysing GitHub commits with R
Analysing GitHub commits with RAnalysing GitHub commits with R
Analysing GitHub commits with R
 
Python in geospatial analysis
Python in geospatial analysisPython in geospatial analysis
Python in geospatial analysis
 
How to integrate python into a scala stack
How to integrate python into a scala stackHow to integrate python into a scala stack
How to integrate python into a scala stack
 
Travis Oliphant "Python for Speed, Scale, and Science"
Travis Oliphant "Python for Speed, Scale, and Science"Travis Oliphant "Python for Speed, Scale, and Science"
Travis Oliphant "Python for Speed, Scale, and Science"
 
Practical automation for beginners
Practical automation for beginnersPractical automation for beginners
Practical automation for beginners
 
Matplotlib presentation 20 apr2013 final
Matplotlib presentation 20 apr2013   finalMatplotlib presentation 20 apr2013   final
Matplotlib presentation 20 apr2013 final
 
Presto as a Service - Tips for operation and monitoring
Presto as a Service - Tips for operation and monitoringPresto as a Service - Tips for operation and monitoring
Presto as a Service - Tips for operation and monitoring
 
HiPEAC 2019 Tutorial - Maestro RTOS
HiPEAC 2019 Tutorial - Maestro RTOSHiPEAC 2019 Tutorial - Maestro RTOS
HiPEAC 2019 Tutorial - Maestro RTOS
 
Monitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance AnalysisMonitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance Analysis
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 

Recently uploaded (20)

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 

Esri International User Conference 2011: Python: Integrating Standard and Third-Party Libraries

  • 1. Esri International User Conference | San Diego, CA Technical Workshops | Tuesday, July 12th Python: Integrating Standard and Third-Party Libraries Jason Scheirer
  • 2. Other Sessions • Building Tools with Python (Technical Workshop) - Thursday 10:15AM 9 • Getting Started With Map Algebra Using the Raster Calculator and Python (Demo Theater Presentation) - Wednesday 10:00AM Exhibit Hall C (Spatial Analysis Demo Theater) • Python - Analyzing your GPS tracking data (Demo Theater Presentation) - Thursday 11:00AM Exhibit Hall C (Spatial Analysis Demo Theater) • Python - Automating Geodatabase Administration (Tech Workshop 20 Minute) - Thursday 11:05AM 23 B • Python - Creating an ArcGIS Script Tool (Demo Theater Presentation) - Tuesday 4:00PM Exhibit Hall C (Spatial Analysis Demo Theater) • Python - Getting Started (Technical Workshop) - Tuesday 1:30PM 2 - Thursday 8:30AM 2
  • 3. Other Sessions (continued) • Python - Getting to know the Python Window (Demo Theater Presentation) - Tuesday 10:00AM Exhibit Hall C (Spatial Analysis Demo Theater) • Python - Improving the Performance of your Script Tools (Tech Workshop 20 Minute) - Tuesday 8:30AM 6 A • Python - Raster Analysis (Technical Workshop) - Tuesday 3:15PM 6 C - Wednesday 3:15PM 5 A/B • Python - Scripting for Map Automation (Technical Workshop) - Tuesday 10:15AM 9 - Wednesday 3:15PM 9 • Python - Spatial Analysis (Intermediate) (Technical Workshop) - Tuesday 3:15PM 1 A/B - Thursday 10:15AM 2
  • 4. Other Sessions (yes, there are more) • Python - The Ease and Power of Cursors (Demo Theater Presentation) - Tuesday 11:30AM Exhibit Hall C (Spatial Analysis Demo Theater) • Python Scripts - Using A Template (Demo Theater Presentation) - Tuesday 11:00AM Exhibit Hall C (Spatial Analysis Demo Theater) • Road Ahead - Python Scripting Abilities - Thursday 4:05PM 6 B
  • 5. Python in ArcGIS • Implementing geoprocessing script tools - Creating an ArcGIS Script Tool (Tuesday 4:00PM) - Building Tools with Python (Thursday 10:15AM) • Automating workflows - Gluing together other GP tools - Scheduled tasks • Integrating ArcGIS with other systems, other systems into ArcGIS - Data interop: import/export - Automating ArcGIS processes from other applications - Preparing data from ArcGIS for consumption by other applications
  • 7. Batteries Included • Libraries for many common tasks come with the language - File formats: XML (DOM, SAX, ElementTree), JSON, CSV, .ZIP (zipfile) - Networking: HTTP (urllib, urllib2), TCP/UDP (socket) - Parallelism: threading, multiprocessing, subprocess - Command line applications: optparse - Paths, directories, files: sys, os, os.path - User Interfaces: tkinter - Data structures and algorithms: collections, itertools, heapq, struct, many more - Date/time (time, datetime) - Calling C++/C (ctypes)
  • 8. Read the Docs! • Help file: ArcGIS 10.0 | Python 2.6 | Python Manuals
  • 9. Read the Docs! • What’s installed: ArcGIS 10.0 | Python 2.6 | Module Docs
  • 10. More Help • PyMOTW (Python Module of the Week) - http://www.doughellmann.com/PyMOTW/ - Also available as a book
  • 11. Example • Summary Statistics in R - Uses a third-party module for reading spatial data: maptools - Only accepts shapefiles! • Going to use two different system libraries: - subprocess (Open/monitor other programs) - re (Regular Expressions) CopyFeatures to temporary Shapefile Run R Script Clean up temp file Parse R Script’s Output Statistics!
  • 12. Demo
  • 13. But don’t reinvent the wheel! • wget: Popular utility to download resources over HTTP/FTP • Do I need it? - urllib2 can download simple URLs • But I need to follow links - Don’t write a web spider in Python, use the –r option on wget - Use subprocess, like in the previous example
  • 15. The Cheese Shop • http://pypi.python.org/pypi • The official place for 3rd party Python modules
  • 16. Some Interesting Modules • PDF writing – reportlab • Image manipulation – PIL • (Messy) HTML – beautifulsoup • Advanced graphing/plotting – matplotlib • Advanced date/time handling – dateutil • Excel - Read – xlrd - Write – xlwt • Consuming .Net - http://pythonnet.sourceforge.net/ • .docx Read/write – docx - https://github.com/mikemaccana/python-docx - This brings us to…
  • 17. There’s No Installer! • Find python.exe in your install, add it to %PATH%. Scripts too. • Try pip: - http://python-distribute.org/ • Or on the command line: - python.exe setup.py install • Look for it on an unofficial Python library builds site: - http://www.lfd.uci.edu/~gohlke/pythonlibs/
  • 18. Conclusion • A lot of what you need is already there • Amazing documentation at your fingertips, more online • There are built-in ways of interfacing with non-Python utilities (great for using script tools to integrate into ArcGIS) • There’s a HUGE ecosystem out there that probably already has what you need