SlideShare a Scribd company logo
3-GIS Confidential and proprietary.
Benchmarking tree approaches on street data
Fabion Kauker - fkauker@3-gis.com
EURO30 Dublin, Ireland 2019
Problem definition & Questions
• We want to find topologies on data that relates to possible routes for
the creation of infrastructure.
• Many methods exist, but which are most advantageous and for what
applications?
• Can we use street data as a starting point?
• What would the software look like and how could it be used?
Data and representations
● Many formats
○ SHP, TAB, csv, geoJSON …
● Many tools
○ ESRI, QGIS, MapInfo …
● Many sources
○ OSM, open address, municipal, commercial
Key Geometry
Point → (lat, lon)
LineString → [(lat_1, lon_1),..., (lat_n,lon_n)]
Polygon → [(lat_1, lon_1),..., (lat_1,lon_1)]
Geometry to Graph
Karduni, A., Kermanshah, A., & Derrible, S. (2016). A protocol to convert spatial polyline data to network
formats and applications to world urban road networks
1. https://github.com/fhk/test_data
2. https://observablehq.com/@d3/force-directed-graph
(1) (2)
Baking a graph
Given that we have some geometry we
want to derive the graph structure.
Where:
vertex/node == Point or LineString
endpoint
and
edge/arc == LineString endpoint to
LineString endpoint
Directional vs. Undirected
degree 2 nodes = degree 1 nodes
Why Homebaked v. Open Source?
Python
networkx
graph-tool
Baked in algos
Edge and node access
Connected components
Used for path computation
Representations:
adjacency list or matrix
Compute origin destination
matrix/lookup
Simple assembly
Let’s just round to a level of accuracy
Currently using 6 decimal places on
lat lon coordinates
Stringify the coordinates
Assign unique ids
Should probably convert to
euclidean, or use a projection ...
Implications of rounding...
https://en.wikipedia.org/wiki/Decimal_degrees
Given a graph we want to utilize modelling
approaches...
Pre-compute intermediate inputs
Create formulation or data input
Run model
Parse solution
1) http://people.csail.mit.edu/ludwigs/papers/icml15_graphsparsity.pdf
2) http://people.csail.mit.edu/ludwigs/papers/dimacs14_fastpcst.pdf
3) https://github.com/fraenkel-lab/pcst_fast
4) https://cran.r-project.org/web/packages/tbart/index.html
5) https://pubsonline.informs.org/doi/abs/10.1287/opre.16.5.955
6) Goldman AJ (1971) Optimal center location in simple networks. Transp Sci 5:212–221
7) https://pdfs.semanticscholar.org/2094/882d425fe9b3f668eaafbcf8ac0bba478b5f.pdf
8) Ljubić et al. (2005). Solving the Prize-Collecting {Steiner} Tree Problem to Optimality
Network flow MIP
(adapted from Ljubić et al)
Assignment MIP
Tietz-Bart p-median
Hegde et al. Prize Collecting
Steiner Tree (PCST)
Graph to MIP
Flow
source
sinkFlow conservation
constraints
Arc and node
based variables
Assignment
Path and
candidate/demand
variables
candidate demand
Note: be sure to try out fstrings in python 3.6+
Why compare apples and oranges?
Create shared and accessible
benchmarks
Create an extensible framework for
development
Create a web deployable library
Explore combinations and search
techniques
Document caveats
Create extensibility
Explore User Experience (UX)
Develop understanding in industry
How was benchmarking done?
https://github.com/fhk/test_data
1. Source data
2. Process data
3. Wrap “link_src” lib
4. Solve and time
5. Process time
6. Process results
7. Create visualization
Solver: CPLEX
Time limit 1800 seconds
Benchmarks
Benchmarks
PCST fast on Denmark
Demo
How?
GeoJSON
Web Server
Python
flask
networkx
graph-tool
R t-bart
pcst_fast
docplex
fiona
{url}/v1/{method}
methods:
pcst
pmed
spamp
nfmp
Transform GeoJSON to
graph
Create model input
data
Construct
formulation/algorithm
Run algorithm/solver
Extract/match solution
Output GeoJSON
Browser
js
Mapbox-gl
Mapbox-gl-draw
Ajax
turf
Questions?
Github - https://github.com/fhk/link_src & https://github.com/fhk/test_data
Contribute models
Further learning
Solver tuning
Huertic implementation
Tiers
RL approaches
Publication to PhD
Come solve industry problems - roles at 3-GIS
Contact:
fkauker@3-gis.com

More Related Content

What's hot

Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Mumbai B.Sc.IT Study
 
Trb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rstTrb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rst
Robert Tung
 
Data visualization using R
Data visualization using RData visualization using R
Data visualization using R
Ummiya Mohammedi
 
Data visualization with R
Data visualization with RData visualization with R
Data visualization with R
Biswajeet Dasmajumdar
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
University of Colorado at Boulder
 
Spatial is Not Special ?
Spatial is Not Special ?Spatial is Not Special ?
Spatial is Not Special ?
Maurizio Napolitano
 
Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3
Safe Software
 
Big data in GIS Environment
Big data in GIS Environment Big data in GIS Environment
Big data in GIS Environment
Shivaprakash Yaragal
 
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Anita Graser
 
Arrow and Visual Model
Arrow and Visual ModelArrow and Visual Model
Arrow and Visual Model
Martheana Kencanawati
 
A Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotterA Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotter
University of Michigan Taubman Health Sciences Library
 
20131216 Stat Journal
20131216 Stat Journal20131216 Stat Journal
20131216 Stat Journal
Med_KU
 
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Matthias Hinz
 
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHubEuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
Martin Christen
 
3D printing of digital elevation models
3D printing of digital elevation models3D printing of digital elevation models
3D printing of digital elevation models
Javier Gonzalez Gonzalez
 
Aag 2017
Aag 2017Aag 2017
Aag 2017
Michael DeMers
 
Postal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench ApplicationsPostal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench Applications
Safe Software
 
GIS and Map Tiles
GIS and Map TilesGIS and Map Tiles
GIS and Map Tiles
Petr Pridal
 
Graph of UK train stations
Graph of UK train stationsGraph of UK train stations
Graph of UK train stations
Daniyar Mukhanov
 
Exploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography EducationExploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography Education
Michael DeMers
 

What's hot (20)

Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
 
Trb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rstTrb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rst
 
Data visualization using R
Data visualization using RData visualization using R
Data visualization using R
 
Data visualization with R
Data visualization with RData visualization with R
Data visualization with R
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
 
Spatial is Not Special ?
Spatial is Not Special ?Spatial is Not Special ?
Spatial is Not Special ?
 
Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3
 
Big data in GIS Environment
Big data in GIS Environment Big data in GIS Environment
Big data in GIS Environment
 
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
 
Arrow and Visual Model
Arrow and Visual ModelArrow and Visual Model
Arrow and Visual Model
 
A Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotterA Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotter
 
20131216 Stat Journal
20131216 Stat Journal20131216 Stat Journal
20131216 Stat Journal
 
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
 
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHubEuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
 
3D printing of digital elevation models
3D printing of digital elevation models3D printing of digital elevation models
3D printing of digital elevation models
 
Aag 2017
Aag 2017Aag 2017
Aag 2017
 
Postal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench ApplicationsPostal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench Applications
 
GIS and Map Tiles
GIS and Map TilesGIS and Map Tiles
GIS and Map Tiles
 
Graph of UK train stations
Graph of UK train stationsGraph of UK train stations
Graph of UK train stations
 
Exploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography EducationExploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography Education
 

Similar to Euro30 2019 - Benchmarking tree approaches on street data

The Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsThe Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing Systems
Neo4j
 
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019  - Flexible Network Design Utilizing Non Strict Modeling ApproachesInforms 2019  - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
Fabion Kauker
 
How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1
wang yaohui
 
Spark summit europe 2015 magellan
Spark summit europe 2015 magellanSpark summit europe 2015 magellan
Spark summit europe 2015 magellan
Ram Sriharsha
 
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
csandit
 
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONSBIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
cscpconf
 
PointNet
PointNetPointNet
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram SriharshaMagellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
Spark Summit
 
Portfolio
PortfolioPortfolio
Portfolio
Ivan Khomyakov
 
On the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-proceduresOn the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-procedures
Armando Guevara
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
PayamBarnaghi
 
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdfMODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
Université Mohamed SeddiK Ben yahia-JIJEL
 
EDBT 2015: Summer School Overview
EDBT 2015: Summer School OverviewEDBT 2015: Summer School Overview
EDBT 2015: Summer School Overview
dgarijo
 
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Punit Sharnagat
 
mini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptxmini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptx
tusharpawar803067
 
Representation Learning on Complex Graphs
Representation Learning on Complex GraphsRepresentation Learning on Complex Graphs
Representation Learning on Complex Graphs
eXascale Infolab
 
Spatial Data processing with Hadoop
Spatial Data processing with HadoopSpatial Data processing with Hadoop
Spatial Data processing with Hadoop
VisionGEOMATIQUE2014
 
Visualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographicsVisualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographics
Dr Muhammad Adnan
 
Shortest path estimation for graph
Shortest path estimation for graphShortest path estimation for graph
Shortest path estimation for graph
ijdms
 
Streaming HYpothesis REasoning
Streaming HYpothesis REasoningStreaming HYpothesis REasoning
Streaming HYpothesis REasoning
William Smith
 

Similar to Euro30 2019 - Benchmarking tree approaches on street data (20)

The Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsThe Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing Systems
 
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019  - Flexible Network Design Utilizing Non Strict Modeling ApproachesInforms 2019  - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
 
How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1
 
Spark summit europe 2015 magellan
Spark summit europe 2015 magellanSpark summit europe 2015 magellan
Spark summit europe 2015 magellan
 
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
 
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONSBIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
 
PointNet
PointNetPointNet
PointNet
 
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram SriharshaMagellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
 
Portfolio
PortfolioPortfolio
Portfolio
 
On the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-proceduresOn the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-procedures
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
 
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdfMODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
 
EDBT 2015: Summer School Overview
EDBT 2015: Summer School OverviewEDBT 2015: Summer School Overview
EDBT 2015: Summer School Overview
 
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
 
mini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptxmini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptx
 
Representation Learning on Complex Graphs
Representation Learning on Complex GraphsRepresentation Learning on Complex Graphs
Representation Learning on Complex Graphs
 
Spatial Data processing with Hadoop
Spatial Data processing with HadoopSpatial Data processing with Hadoop
Spatial Data processing with Hadoop
 
Visualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographicsVisualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographics
 
Shortest path estimation for graph
Shortest path estimation for graphShortest path estimation for graph
Shortest path estimation for graph
 
Streaming HYpothesis REasoning
Streaming HYpothesis REasoningStreaming HYpothesis REasoning
Streaming HYpothesis REasoning
 

Recently uploaded

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 

Recently uploaded (20)

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 

Euro30 2019 - Benchmarking tree approaches on street data

  • 1. 3-GIS Confidential and proprietary. Benchmarking tree approaches on street data Fabion Kauker - fkauker@3-gis.com EURO30 Dublin, Ireland 2019
  • 2. Problem definition & Questions • We want to find topologies on data that relates to possible routes for the creation of infrastructure. • Many methods exist, but which are most advantageous and for what applications? • Can we use street data as a starting point? • What would the software look like and how could it be used?
  • 3. Data and representations ● Many formats ○ SHP, TAB, csv, geoJSON … ● Many tools ○ ESRI, QGIS, MapInfo … ● Many sources ○ OSM, open address, municipal, commercial Key Geometry Point → (lat, lon) LineString → [(lat_1, lon_1),..., (lat_n,lon_n)] Polygon → [(lat_1, lon_1),..., (lat_1,lon_1)]
  • 4. Geometry to Graph Karduni, A., Kermanshah, A., & Derrible, S. (2016). A protocol to convert spatial polyline data to network formats and applications to world urban road networks 1. https://github.com/fhk/test_data 2. https://observablehq.com/@d3/force-directed-graph (1) (2)
  • 5. Baking a graph Given that we have some geometry we want to derive the graph structure. Where: vertex/node == Point or LineString endpoint and edge/arc == LineString endpoint to LineString endpoint Directional vs. Undirected degree 2 nodes = degree 1 nodes Why Homebaked v. Open Source? Python networkx graph-tool Baked in algos Edge and node access Connected components Used for path computation Representations: adjacency list or matrix Compute origin destination matrix/lookup Simple assembly Let’s just round to a level of accuracy Currently using 6 decimal places on lat lon coordinates Stringify the coordinates Assign unique ids Should probably convert to euclidean, or use a projection ...
  • 7. Given a graph we want to utilize modelling approaches... Pre-compute intermediate inputs Create formulation or data input Run model Parse solution 1) http://people.csail.mit.edu/ludwigs/papers/icml15_graphsparsity.pdf 2) http://people.csail.mit.edu/ludwigs/papers/dimacs14_fastpcst.pdf 3) https://github.com/fraenkel-lab/pcst_fast 4) https://cran.r-project.org/web/packages/tbart/index.html 5) https://pubsonline.informs.org/doi/abs/10.1287/opre.16.5.955 6) Goldman AJ (1971) Optimal center location in simple networks. Transp Sci 5:212–221 7) https://pdfs.semanticscholar.org/2094/882d425fe9b3f668eaafbcf8ac0bba478b5f.pdf 8) Ljubić et al. (2005). Solving the Prize-Collecting {Steiner} Tree Problem to Optimality Network flow MIP (adapted from Ljubić et al) Assignment MIP Tietz-Bart p-median Hegde et al. Prize Collecting Steiner Tree (PCST)
  • 8. Graph to MIP Flow source sinkFlow conservation constraints Arc and node based variables Assignment Path and candidate/demand variables candidate demand Note: be sure to try out fstrings in python 3.6+
  • 9. Why compare apples and oranges? Create shared and accessible benchmarks Create an extensible framework for development Create a web deployable library Explore combinations and search techniques Document caveats Create extensibility Explore User Experience (UX) Develop understanding in industry
  • 10. How was benchmarking done? https://github.com/fhk/test_data 1. Source data 2. Process data 3. Wrap “link_src” lib 4. Solve and time 5. Process time 6. Process results 7. Create visualization Solver: CPLEX Time limit 1800 seconds
  • 13. PCST fast on Denmark
  • 14. Demo
  • 15. How? GeoJSON Web Server Python flask networkx graph-tool R t-bart pcst_fast docplex fiona {url}/v1/{method} methods: pcst pmed spamp nfmp Transform GeoJSON to graph Create model input data Construct formulation/algorithm Run algorithm/solver Extract/match solution Output GeoJSON Browser js Mapbox-gl Mapbox-gl-draw Ajax turf
  • 16. Questions? Github - https://github.com/fhk/link_src & https://github.com/fhk/test_data Contribute models Further learning Solver tuning Huertic implementation Tiers RL approaches Publication to PhD Come solve industry problems - roles at 3-GIS Contact: fkauker@3-gis.com