SlideShare a Scribd company logo
1 of 15
Geodata Processing and
Webservices with
Python and Azure
André Zehnder
Stephan Heuel
Who we are
André Zehnder
andre.zehnder@ebp.ch
25.06.2019 © EBP | 2
Stephan Heuel
stephan.heuel@ebp.ch
EBP Switzerland, www.ebp.ch
Services
Software
(plan, build, run)
Data science
(spatial, temporal)
IT consulting
Business domains
Mobility
Infrastructure
Environment
25.06.2019 © EBP | 4| Titel der Präsentation
It is all about space and time…
25.06.2019 © EBP | 5| Titel der Präsentation
Isochrone
 Line of equal time
 Simultaneous ocurrence
 Marks area of accessibility within
a time limit
Concept of isochrones
Let’s get a quick overview
25.06.2019 © EBP | 6
AVswissTLM
OSM
Ruleset for
walkability
Web-
API
Isochrone
Command
-line
Cost surface
(Raster)
How to get a cost surface
25.06.2019 © EBP | 7
How to get a cost surface
 Focus on walkability for pedestrians
 Integration of various data sources
 Key element: Set of rules
 Mixture of Python & FME
 Rasterio
 Numpy
 fmeobjects
25.06.2019 © EBP | 8
…
Type Rank Cost [s/100m]
Pavement 1 90
Footpath 1 90
Street 4 120
Bridge 2 200
Main_road 4 320
Railway_track 5 9000
River 7 -1
construction_site 5 -1
building_private 6 -1
building_public 6 300
25.06.2019
© EBP | 9
| Titel der Präsentation
How to compute
isochrones
How to compute isochrones
 Implemented with
 scikit-fmm (skfmm):
 scipy
 Numpy
 Based on Fast Marching method
 Accumulative cost distance
 Alternatives
 ArcGIS: Cost Distance
 QGIS: Accumulated cost
25.06.2019 © EBP | 10
Source: desktop.arcgis.com
skfmm.travel_time(phi, speed)
POI Cost surface Cost distance
(for isochrones)
Let’s compute some more isochrones…
11EBP | Walkalytics – Pedestrian Routing Done Right
A perfect task to parellelize
 Thousands of POIs to compute
 Suited for MapReduce approach
 Map: Compute individual isochrones
 Reduce: Combine to one raster
 Options for parallelization
 Multithreading: multiprocessing
 Asynchronous computing: asyncio
 Cluster computing: Hadoop, Spark
 Multiple shells: GNU parallel
25.06.2019 © EBP | 12
Shell 1
Shell 2
Shell 3
cat input/servicePoint.csv
| parallel --pipe -N4
python costdistance.py
cat input/servicePoint.csv
| python costdistance.py
How to run in the cloud: Azure/AWS/Digital Ocean
25.06.2019 © EBP | 13
Source: dotnettricks.com/learn/azure
 Azure Storage: BLOB-
storage for input data and
cost models
 Azure VM: Linux machine
to process cost surface
 Azure Web-App: On-demand processing of isochrones
Scalable & load-balancing
WSGI-Framework (Flask)
 Azure API Management: Gateway between API-call and
Web-App
Authentification
Logging, statistics
Web deployment & API
25.06.2019 © EBP | 14
dev.walkalytics.comSee code on github.com/ernstbaslerpartner/walkalytics-clients
Thank you!
andre.zehnder@ebp.ch
25.06.2019 © EBP | 15
stephan.heuel@ebp.ch

More Related Content

What's hot

What's hot (20)

Machine Learning in Real-Time
Machine Learning in Real-TimeMachine Learning in Real-Time
Machine Learning in Real-Time
 
geo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourggeo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourg
 
Cps swarm cps-cluster-smart cyber-physical systems collaboration and clusteri...
Cps swarm cps-cluster-smart cyber-physical systems collaboration and clusteri...Cps swarm cps-cluster-smart cyber-physical systems collaboration and clusteri...
Cps swarm cps-cluster-smart cyber-physical systems collaboration and clusteri...
 
C lindoor
C lindoorC lindoor
C lindoor
 
05 exploitation platforms in support of agriculture monitoring erwin goor v...
05 exploitation platforms in support of agriculture monitoring   erwin goor v...05 exploitation platforms in support of agriculture monitoring   erwin goor v...
05 exploitation platforms in support of agriculture monitoring erwin goor v...
 
Daho.am meetup kubernetes evolution @abi
Daho.am meetup   kubernetes evolution @abiDaho.am meetup   kubernetes evolution @abi
Daho.am meetup kubernetes evolution @abi
 
Trivadis TechEvent 2017 Skills für die Reise in die Cloud by Daniel Steiger
Trivadis TechEvent 2017 Skills für die Reise in die Cloud by Daniel SteigerTrivadis TechEvent 2017 Skills für die Reise in die Cloud by Daniel Steiger
Trivadis TechEvent 2017 Skills für die Reise in die Cloud by Daniel Steiger
 
"Showcase Skiing Area" IoT Presentation - Splunk Partner Executive Summit: 18...
"Showcase Skiing Area" IoT Presentation - Splunk Partner Executive Summit: 18..."Showcase Skiing Area" IoT Presentation - Splunk Partner Executive Summit: 18...
"Showcase Skiing Area" IoT Presentation - Splunk Partner Executive Summit: 18...
 
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
 
Esri and Airbus Defense & Space
Esri and Airbus Defense & SpaceEsri and Airbus Defense & Space
Esri and Airbus Defense & Space
 
Designing Swarms of Cyber-Physical Systems: The H2020 CPSwarm Project
Designing Swarms of Cyber-Physical Systems: The H2020 CPSwarm ProjectDesigning Swarms of Cyber-Physical Systems: The H2020 CPSwarm Project
Designing Swarms of Cyber-Physical Systems: The H2020 CPSwarm Project
 
INTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISINTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GIS
 
What's New in the ArcGIS Platform - Smart Education - Higher - AC18
What's New in the ArcGIS Platform - Smart Education - Higher - AC18What's New in the ArcGIS Platform - Smart Education - Higher - AC18
What's New in the ArcGIS Platform - Smart Education - Higher - AC18
 
FME and the BGS in 2016/2017
FME and the BGS in 2016/2017FME and the BGS in 2016/2017
FME and the BGS in 2016/2017
 
Working of car parking system
Working of car parking systemWorking of car parking system
Working of car parking system
 
How to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR DataHow to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR Data
 
2017 GIS in Emergency Management Track: Stepping Into the Map: Utilizing Aug...
2017 GIS in Emergency Management Track:  Stepping Into the Map: Utilizing Aug...2017 GIS in Emergency Management Track:  Stepping Into the Map: Utilizing Aug...
2017 GIS in Emergency Management Track: Stepping Into the Map: Utilizing Aug...
 
CEPH DAY BERLIN - CEPH IMPLEMENTATIONS FOR THE MEERKAT RADIO TELESCOPE
CEPH DAY BERLIN - CEPH IMPLEMENTATIONS FOR THE MEERKAT RADIO TELESCOPECEPH DAY BERLIN - CEPH IMPLEMENTATIONS FOR THE MEERKAT RADIO TELESCOPE
CEPH DAY BERLIN - CEPH IMPLEMENTATIONS FOR THE MEERKAT RADIO TELESCOPE
 
2017 Collaberation Across Boundaries (GISCO) Track: A Look at Some Low-Cost,...
2017 Collaberation Across Boundaries (GISCO) Track:  A Look at Some Low-Cost,...2017 Collaberation Across Boundaries (GISCO) Track:  A Look at Some Low-Cost,...
2017 Collaberation Across Boundaries (GISCO) Track: A Look at Some Low-Cost,...
 
Science Media & Data Visualization - XOOMS (English)
Science Media & Data Visualization - XOOMS (English)Science Media & Data Visualization - XOOMS (English)
Science Media & Data Visualization - XOOMS (English)
 

Similar to Geodata Processing and Webservices with Python and Azure

Team 06 mobile app for open land use
Team 06 mobile app for open land useTeam 06 mobile app for open land use
Team 06 mobile app for open land use
plan4all
 
HPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud TechnologiesHPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud Technologies
Inderjeet Singh
 
OpsRamp Summer 2019 Platform Update
OpsRamp Summer 2019 Platform UpdateOpsRamp Summer 2019 Platform Update
OpsRamp Summer 2019 Platform Update
OpsRamp
 

Similar to Geodata Processing and Webservices with Python and Azure (20)

BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4
BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4
BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4
 
Ogc API features -pilottirajapinnat AU/SU-teemoista, Sampo Savolainen ja Lass...
Ogc API features -pilottirajapinnat AU/SU-teemoista, Sampo Savolainen ja Lass...Ogc API features -pilottirajapinnat AU/SU-teemoista, Sampo Savolainen ja Lass...
Ogc API features -pilottirajapinnat AU/SU-teemoista, Sampo Savolainen ja Lass...
 
Team 06 mobile app for open land use
Team 06 mobile app for open land useTeam 06 mobile app for open land use
Team 06 mobile app for open land use
 
HPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud TechnologiesHPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud Technologies
 
Using Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-TimeUsing Spatial Data Streams In Real-Time
Using Spatial Data Streams In Real-Time
 
Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)
 
PEPS: CNES Sentinel Satellite Image Analysis, On-Premises and in the Cloud wi...
PEPS: CNES Sentinel Satellite Image Analysis, On-Premises and in the Cloud wi...PEPS: CNES Sentinel Satellite Image Analysis, On-Premises and in the Cloud wi...
PEPS: CNES Sentinel Satellite Image Analysis, On-Premises and in the Cloud wi...
 
D017212027
D017212027D017212027
D017212027
 
A Novel Approach for Workload Optimization and Improving Security in Cloud Co...
A Novel Approach for Workload Optimization and Improving Security in Cloud Co...A Novel Approach for Workload Optimization and Improving Security in Cloud Co...
A Novel Approach for Workload Optimization and Improving Security in Cloud Co...
 
Spark-MPI: Approaching the Fifth Paradigm with Nikolay Malitsky
Spark-MPI: Approaching the Fifth Paradigm with Nikolay MalitskySpark-MPI: Approaching the Fifth Paradigm with Nikolay Malitsky
Spark-MPI: Approaching the Fifth Paradigm with Nikolay Malitsky
 
CZECH REPUBLIC IN THE EOSC ARENA
CZECH REPUBLIC IN THE EOSC ARENACZECH REPUBLIC IN THE EOSC ARENA
CZECH REPUBLIC IN THE EOSC ARENA
 
OpsRamp Summer 2019 Platform Update
OpsRamp Summer 2019 Platform UpdateOpsRamp Summer 2019 Platform Update
OpsRamp Summer 2019 Platform Update
 
GRC - CANARIE Green IT 2009
GRC - CANARIE Green IT 2009GRC - CANARIE Green IT 2009
GRC - CANARIE Green IT 2009
 
AI Pipeline Optimization using Kubeflow
AI Pipeline Optimization using KubeflowAI Pipeline Optimization using Kubeflow
AI Pipeline Optimization using Kubeflow
 
Cloud computing application for water resources based on open source software...
Cloud computing application for water resources based on open source software...Cloud computing application for water resources based on open source software...
Cloud computing application for water resources based on open source software...
 
Vol 10 No 1 - February 2014
Vol 10 No 1 - February 2014Vol 10 No 1 - February 2014
Vol 10 No 1 - February 2014
 
Final apu13 phil-rogers-keynote-21
Final apu13 phil-rogers-keynote-21Final apu13 phil-rogers-keynote-21
Final apu13 phil-rogers-keynote-21
 
CORE final workshop introduction
CORE final workshop introductionCORE final workshop introduction
CORE final workshop introduction
 
09 Improving Open Land-Use Map with crowdsourcing
09 Improving Open Land-Use Map with crowdsourcing09 Improving Open Land-Use Map with crowdsourcing
09 Improving Open Land-Use Map with crowdsourcing
 
20230601_FinOps_Meetup_Switzerland.pdf
20230601_FinOps_Meetup_Switzerland.pdf20230601_FinOps_Meetup_Switzerland.pdf
20230601_FinOps_Meetup_Switzerland.pdf
 

Recently uploaded

Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
amitlee9823
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
only4webmaster01
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
amitlee9823
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night StandCall Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 

Recently uploaded (20)

Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 
hybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptxhybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptx
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night StandCall Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
 
Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 

Geodata Processing and Webservices with Python and Azure

  • 1. Geodata Processing and Webservices with Python and Azure André Zehnder Stephan Heuel
  • 2. Who we are André Zehnder andre.zehnder@ebp.ch 25.06.2019 © EBP | 2 Stephan Heuel stephan.heuel@ebp.ch
  • 3. EBP Switzerland, www.ebp.ch Services Software (plan, build, run) Data science (spatial, temporal) IT consulting Business domains Mobility Infrastructure Environment
  • 4. 25.06.2019 © EBP | 4| Titel der Präsentation It is all about space and time…
  • 5. 25.06.2019 © EBP | 5| Titel der Präsentation Isochrone  Line of equal time  Simultaneous ocurrence  Marks area of accessibility within a time limit Concept of isochrones
  • 6. Let’s get a quick overview 25.06.2019 © EBP | 6 AVswissTLM OSM Ruleset for walkability Web- API Isochrone Command -line Cost surface (Raster)
  • 7. How to get a cost surface 25.06.2019 © EBP | 7
  • 8. How to get a cost surface  Focus on walkability for pedestrians  Integration of various data sources  Key element: Set of rules  Mixture of Python & FME  Rasterio  Numpy  fmeobjects 25.06.2019 © EBP | 8 … Type Rank Cost [s/100m] Pavement 1 90 Footpath 1 90 Street 4 120 Bridge 2 200 Main_road 4 320 Railway_track 5 9000 River 7 -1 construction_site 5 -1 building_private 6 -1 building_public 6 300
  • 9. 25.06.2019 © EBP | 9 | Titel der Präsentation How to compute isochrones
  • 10. How to compute isochrones  Implemented with  scikit-fmm (skfmm):  scipy  Numpy  Based on Fast Marching method  Accumulative cost distance  Alternatives  ArcGIS: Cost Distance  QGIS: Accumulated cost 25.06.2019 © EBP | 10 Source: desktop.arcgis.com skfmm.travel_time(phi, speed) POI Cost surface Cost distance (for isochrones)
  • 11. Let’s compute some more isochrones… 11EBP | Walkalytics – Pedestrian Routing Done Right
  • 12. A perfect task to parellelize  Thousands of POIs to compute  Suited for MapReduce approach  Map: Compute individual isochrones  Reduce: Combine to one raster  Options for parallelization  Multithreading: multiprocessing  Asynchronous computing: asyncio  Cluster computing: Hadoop, Spark  Multiple shells: GNU parallel 25.06.2019 © EBP | 12 Shell 1 Shell 2 Shell 3 cat input/servicePoint.csv | parallel --pipe -N4 python costdistance.py cat input/servicePoint.csv | python costdistance.py
  • 13. How to run in the cloud: Azure/AWS/Digital Ocean 25.06.2019 © EBP | 13 Source: dotnettricks.com/learn/azure  Azure Storage: BLOB- storage for input data and cost models  Azure VM: Linux machine to process cost surface  Azure Web-App: On-demand processing of isochrones Scalable & load-balancing WSGI-Framework (Flask)  Azure API Management: Gateway between API-call and Web-App Authentification Logging, statistics
  • 14. Web deployment & API 25.06.2019 © EBP | 14 dev.walkalytics.comSee code on github.com/ernstbaslerpartner/walkalytics-clients
  • 15. Thank you! andre.zehnder@ebp.ch 25.06.2019 © EBP | 15 stephan.heuel@ebp.ch

Editor's Notes

  1. Unit: [s/100m] SH: Hier fehlt eine Legende. Die Einheit [s/100m] würde ich für die Darstellung nicht verwenden, die haben wir nur aus numerischen Gründen so gewählt. Besser ist [km/h]. – muss man halt umrechnen: 80 [s/100m] = 4.5 [km/h] In der Präsentation Bike-Analysis-2018-11-27.pptx in diesem Ordner findest Du (für Velos) auf Folie 8 eine beispielhafte Darstellung eines Kostenrasters bzw. Kostenoberfläche.
  2. Model each square-meter according to the walkability OSM: Pedestrian Crossings Only OSM + 5m pixel raster: 1h OSM & AV + 1m pixel raster: 1.5 days
  3. Lines of equal time python costdistance/lib/run_walkalytics.py -cp cosodel_website_azure --animate -e 4327 geoPython,7.43708,46.94855 --fill-buildings --max-min 21 >/dev/null --break-values 0,4,8,12,16,20,21 --stats statpop_bbtot
  4. Accumulated cost distance (diagonal: 1.41), cheapest movement variant (vertical, horizontal, diagonal) per node is selected CostDistance-Tool in ArcGIS, computed with «Fast marching method» in scikit-fmm Phi: line feature as a scalar function Speed: Array of speeds at each point Dx: spacing factor
  5. A single shell process per POI https://adamdrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html
  6. Flask, Falcon, Bottle are interchangeable WSGI: Web Server Gateway Interface -> Link between Python code and API call API Management: Forward API-request to Web-App + Authorization (access key) + Logging AWS S3 -> Alternative to Azure torage AWS EC2 -> Alternative to Azure VM AWS Lambda -> Alternative to Azure Functions Azure API Management
  7. Flask -> Alternative to Falcon AWS S3 -> Alternative to Azure torage AWS EC2 -> Alternative to Azure VM AWS Lambda -> Alternative to Azure Functions Azure API Management