SlideShare a Scribd company logo
Introduction to Data
Collection & General
Transit Feed
Specification
University of Thessaly,2015
GreenYourMove Project
With the contribution of the LIFE programme of the European Union - LIFE14 ENV/GR/000611
The Big picture
2
How are GTFS produced?
3
Contents of this presentation
 Definitions and Terminology of:
 Stop, Routes, Trips, Layers/Shapefiles, CRS, layer features, csv files
 OpenStreetMap
 General Transit Feed Specification(GTFS)
 QuantumGIS(QGIS) & OpenLayers Plugin
 PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter
 shp2GTFS
 Basic usage of:
 QGIS
 PostgreSQL & PostGIS
 shp2GTFS
 Conclusion and final results
4
Definitions and Terminology
 Stop: An object that is defined by a geographic point on Earth and a name/ID, and is usually
served/contained in public transit route.
 Route: A sequence of stops that are served by a specific vehicle one after another. Information
in a route are geospatial objects with IDs and are time-independent .
 Trips: Trips are time-dependent executions of routes and they are grouped according to which
route they belong to.
 Layer/Shapefile: These are two concepts that are interconnected. A shapefile is a data format
for GIS systems, which describes vector features, such as points, lines and polygons. When they
are used in QGIS they are represented as layers on the map.
 CRS: Coordinate Reference System is a system used to locate geographical entities. We will
mostly use WGS84 and WGS84/Pseudo Mercator.
 QGIS: In QGIS we will create layers, which will contain points and lines and fall under the
generic category of layer features.
 CSV file: Means Comma-Seperated Values file and is a text file in which every line represents a
data record. Each record consists of one or more fields, seperated by commas.
5
Definitions and Terminology
OpenStreetMap – website https://www.openstreetmap.org/
Definition: As stated on their website: “OpenStreetMap is a free geographic data.
OpenStreetMap built by volunteers largely from scratch and released with an
open-content license.”
Why do we need it?
It provides us with datasets about the road network. In most of the cases the raw
data from OpenStreetMap needs to be edited in some way in order to use in an
application.
6
Definitions and Terminology
General Transit Feed Specification(GTFS) – website
https://developers.google.com/transit/gtfs/
Definition: As stated on their website: “The General Transit Feed Specification
(GTFS) defines a common format for public transportation schedules and
associated geographic information.”
Why do we need it?
Because it will be the data format we will use to represent the transit network. It is
the mainstream approach when it comes to schedule-based datasets. Its
development is supported by big organizations and the number of data available
in this form is really bigger than in any other form.
7
Definitions and Terminology
QuantumGIS(QGIS) – website http://www.qgis.org/
Definition: It is an open-source Geographic Information System(GIS) that is used
for viewing, editing and analyzing geographic data.
Why do we need it?
We use QGIS for data collection. By exploiting the schedule-based nature of a
transit network, we create layers which contain all the geographical information of
a route. Taking for granted that we somehow know the longitude, latitude and id
of a station in a route, we can create a layer containing stops of a route. Next, we
use QGIS to create another layer with the data of the actual path the vehicle
follows. The output file format are shapefiles. When we open shapefiles with a GIS
system they are represented as layers.
8
Definitions and Terminology
PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter -
http://www.postgresql.org/ , http://postgis.net/
Definition: PostgreSQL is an open-source, object-relational database system, while
PostGIS is an extension for that database which adds support for geographic
objects and allows to run queries for geographic related content in SQL. DBF
Loader Exporter is a simple tool for loading files into the database.
Why do we need them?
It is where we store our data. Furthermore, it allows to run queries to analyze and
edit our data. In combination with Python’s modules they are the two main tools
that we used in our script shp2GTFS.
9
Definitions and Terminology
shp2GTFS – not available on website yet.
Definition: It is a Python-based script we created that enables us to
transform shapefiles to a GTFS feed with less effort than any suggested
approach that we are aware of.
Why do we need it?
Because we need to convert the data we gathered with QGIS to GTFS
feeds. There were no tools available online that would enable us to
combine the simplicity of gathering data with QGIS and transform the
produced layers/shapefiles to a GTFS feed.
10
Basic Usage - QGIS
11
The interface:
Basic Toolbar, contains
most of the tools we
need
and will use
In this box we can see the layers have opened on our canvas.
Lon,Lat & CRS information
Canvas
Basic Usage - QGIS
From the basic toolbar we will need:
12
Add feature
(Point or Line)
Used to open a map
layer(plugin)
Select and deselect a
feature
Basic Usage - QGIS
About the Plugin and the creation of a layer
13
Basic Usage - QGIS
Note that:
 When we create and save a shapefile to a folder in our computer, there
are several files created with it. We only care about the shapefile, but
we want to keep the other files too, because they contain information
about CRS, encoding, etc. Opening and editing the shapefile only is
enough and other files change accordingly.
 We are always have to open and work on a OpenStreetMap map layer
and not use other services like Bing Maps or Google Maps.
14
Basic Usage – PostgreSQL - PostGIS
We use the software through a graphic user interface called pgAdmin 3.
15
pgAdmin’s icon:
Basic Usage – PostgreSQL - PostGIS
16
In order to load files onto the
Database we use the a plugin:
After entering username, password
and database name we can connect
and load shapefiles onto the database.
Basic Usage – PostgreSQL - PostGIS
*Note that:
When installing the database software we enter username and password.
We used same username and password for all of the PCs we used.
Also before using the loader software you should add to “Path” System
Variable the path to the location of the “bin” folder in Postgres’s
installation folder.
(The path on my computer is: C:Program FilesPostgreSQL9.3bin )
17
Basic Usage – shp2GTFS
shp2GTFS is a tool we created and is still in development phase. Its usage
is based around the keyfiles. Keyfiles are csv files that contain
information about the timetable of the trips and other logic that needs to
be included in a GTFS feed.
Actually, it connects to the database using a python module, retrieves the
data we ask it to retrieve, and combining them with the information on the
keyfiles it produces the GTFS files one by one.
18
Basic Usage – shp2GTFS
*Note that:
Using shp2GTFS is achievable through Windows Command Prompt and
Cygwin.
Before using shp2GTFS you should set System Variable “client_encoding”
to “UTF-8”.
All input and output paths in the script need to be changed before using it
on another computer or you need to have the exact same folder setup on
all computers.
19
Thank you for your attention!
For more information on our project, visit:
http://www.greenyourmove.org/
Or contact us at:
dimrizopoulos@gmail.com
saharidis@gmail.com
info@greenyourmove.eu
20

More Related Content

What's hot

Unit3 slides
Unit3 slidesUnit3 slides
Unit3 slides
Larefa Bidoun
 
ckan 2.0 Introduction (20140522 updated)
ckan 2.0 Introduction  (20140522 updated)ckan 2.0 Introduction  (20140522 updated)
ckan 2.0 Introduction (20140522 updated)
Chengjen Lee
 
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Sergio Fernández
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
Giorgos Santipantakis
 
CKANCon 2016 & IODC16
CKANCon 2016 & IODC16CKANCon 2016 & IODC16
CKANCon 2016 & IODC16
Chengjen Lee
 
Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)
jottevanger
 
EuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopoEuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopo
geoportal of the federal authorities of the Swiss Confederation
 
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
Chengjen Lee
 
Graph Analytics with ArangoDB
Graph Analytics with ArangoDBGraph Analytics with ArangoDB
Graph Analytics with ArangoDB
ArangoDB Database
 
Geo2tag LBS platform training at FRUCT12
Geo2tag LBS platform training at FRUCT12Geo2tag LBS platform training at FRUCT12
Geo2tag LBS platform training at FRUCT12
OSLL
 
Culture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data LandCulture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data Land
val.cartei
 
Data Grid Taxonomies
Data Grid TaxonomiesData Grid Taxonomies
Data Grid Taxonomies
awesomesos
 
Tx well data final
Tx well data finalTx well data final
Tx well data final
Jack Flannery
 
Ccp4 mmdb-python
Ccp4 mmdb-pythonCcp4 mmdb-python
Ccp4 mmdb-python
vandettaddos
 
Apache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlibApache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlib
Jens Fisseler, Dr.
 
20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来
Takeo Kunishima
 
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as KnowledgeRDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
National Institute of Informatics
 
Summary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File FormatSummary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File Format
The HDF-EOS Tools and Information Center
 
Graph basedrdf storeforapachecassandra
Graph basedrdf storeforapachecassandraGraph basedrdf storeforapachecassandra
Graph basedrdf storeforapachecassandra
Ravindra Ranwala
 
Datomic rtree-pres
Datomic rtree-presDatomic rtree-pres
Datomic rtree-pres
jsofra
 

What's hot (20)

Unit3 slides
Unit3 slidesUnit3 slides
Unit3 slides
 
ckan 2.0 Introduction (20140522 updated)
ckan 2.0 Introduction  (20140522 updated)ckan 2.0 Introduction  (20140522 updated)
ckan 2.0 Introduction (20140522 updated)
 
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
 
CKANCon 2016 & IODC16
CKANCon 2016 & IODC16CKANCon 2016 & IODC16
CKANCon 2016 & IODC16
 
Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)
 
EuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopoEuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopo
 
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
 
Graph Analytics with ArangoDB
Graph Analytics with ArangoDBGraph Analytics with ArangoDB
Graph Analytics with ArangoDB
 
Geo2tag LBS platform training at FRUCT12
Geo2tag LBS platform training at FRUCT12Geo2tag LBS platform training at FRUCT12
Geo2tag LBS platform training at FRUCT12
 
Culture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data LandCulture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data Land
 
Data Grid Taxonomies
Data Grid TaxonomiesData Grid Taxonomies
Data Grid Taxonomies
 
Tx well data final
Tx well data finalTx well data final
Tx well data final
 
Ccp4 mmdb-python
Ccp4 mmdb-pythonCcp4 mmdb-python
Ccp4 mmdb-python
 
Apache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlibApache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlib
 
20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来
 
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as KnowledgeRDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
 
Summary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File FormatSummary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File Format
 
Graph basedrdf storeforapachecassandra
Graph basedrdf storeforapachecassandraGraph basedrdf storeforapachecassandra
Graph basedrdf storeforapachecassandra
 
Datomic rtree-pres
Datomic rtree-presDatomic rtree-pres
Datomic rtree-pres
 

Similar to Presentation data collection and gtfs

Integrating PostGIS in Web Applications
Integrating PostGIS in Web ApplicationsIntegrating PostGIS in Web Applications
Integrating PostGIS in Web Applications
Command Prompt., Inc
 
Time series data monitoring at 99acres.com
Time series data monitoring at 99acres.comTime series data monitoring at 99acres.com
Time series data monitoring at 99acres.com
Ravi Raj
 
Open Source GIS
Open Source GISOpen Source GIS
Open Source GIS
Joe Larson
 
Leicester 2010 notes
Leicester 2010 notesLeicester 2010 notes
Leicester 2010 notes
Joanne Cook
 
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary ProjectEvent Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Bibek Shrestha
 
Bcs Talk Notes
Bcs Talk NotesBcs Talk Notes
Bcs Talk Notes
Joanne Cook
 
Osgis 2010 notes
Osgis 2010 notesOsgis 2010 notes
Osgis 2010 notes
Joanne Cook
 
OpenStreetMap louis liu
OpenStreetMap   louis liuOpenStreetMap   louis liu
OpenStreetMap louis liu
AidIQ
 
Cacti
CactiCacti
Report Hadoop Map Reduce
Report Hadoop Map ReduceReport Hadoop Map Reduce
Report Hadoop Map Reduce
Urvashi Kataria
 
Seven50 Sparc Overview
Seven50 Sparc OverviewSeven50 Sparc Overview
Seven50 Sparc Overview
Roar Media
 
Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)
Sampo Savolainen
 
Spatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use CasesSpatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use Cases
mathieuraj
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
Andreas Schreiber
 
Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)
Soumee Maschatak
 
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCENETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
cscpconf
 
Free open source gis
Free open source gisFree open source gis
Free open source gis
Ashok Peddi
 
Gsoc proposal 2021 polaris
Gsoc proposal 2021 polarisGsoc proposal 2021 polaris
Gsoc proposal 2021 polaris
AyushBansal122
 
Geohosting
GeohostingGeohosting
Geohosting
Karel Charvat
 
Gsoc proposal
Gsoc proposalGsoc proposal
Gsoc proposal
AyushBansal122
 

Similar to Presentation data collection and gtfs (20)

Integrating PostGIS in Web Applications
Integrating PostGIS in Web ApplicationsIntegrating PostGIS in Web Applications
Integrating PostGIS in Web Applications
 
Time series data monitoring at 99acres.com
Time series data monitoring at 99acres.comTime series data monitoring at 99acres.com
Time series data monitoring at 99acres.com
 
Open Source GIS
Open Source GISOpen Source GIS
Open Source GIS
 
Leicester 2010 notes
Leicester 2010 notesLeicester 2010 notes
Leicester 2010 notes
 
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary ProjectEvent Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
 
Bcs Talk Notes
Bcs Talk NotesBcs Talk Notes
Bcs Talk Notes
 
Osgis 2010 notes
Osgis 2010 notesOsgis 2010 notes
Osgis 2010 notes
 
OpenStreetMap louis liu
OpenStreetMap   louis liuOpenStreetMap   louis liu
OpenStreetMap louis liu
 
Cacti
CactiCacti
Cacti
 
Report Hadoop Map Reduce
Report Hadoop Map ReduceReport Hadoop Map Reduce
Report Hadoop Map Reduce
 
Seven50 Sparc Overview
Seven50 Sparc OverviewSeven50 Sparc Overview
Seven50 Sparc Overview
 
Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)
 
Spatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use CasesSpatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use Cases
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)
 
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCENETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
 
Free open source gis
Free open source gisFree open source gis
Free open source gis
 
Gsoc proposal 2021 polaris
Gsoc proposal 2021 polarisGsoc proposal 2021 polaris
Gsoc proposal 2021 polaris
 
Geohosting
GeohostingGeohosting
Geohosting
 
Gsoc proposal
Gsoc proposalGsoc proposal
Gsoc proposal
 

More from LIFE GreenYourMove

Gym 7th research activity day
Gym 7th research activity dayGym 7th research activity day
Gym 7th research activity day
LIFE GreenYourMove
 
Timetable synchronization
Timetable synchronization Timetable synchronization
Timetable synchronization
LIFE GreenYourMove
 
Benders Decomposition
Benders Decomposition Benders Decomposition
Benders Decomposition
LIFE GreenYourMove
 
co-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentationco-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentation
LIFE GreenYourMove
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
LIFE GreenYourMove
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
LIFE GreenYourMove
 
LIFE GreenYourMove Project
LIFE GreenYourMove ProjectLIFE GreenYourMove Project
LIFE GreenYourMove Project
LIFE GreenYourMove
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
LIFE GreenYourMove
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
LIFE GreenYourMove
 
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GreenYourMove
 
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove
 
Presentation escc 2016
Presentation escc 2016Presentation escc 2016
Presentation escc 2016
LIFE GreenYourMove
 
Presentation 3rd CSUM
Presentation 3rd CSUM Presentation 3rd CSUM
Presentation 3rd CSUM
LIFE GreenYourMove
 
Conference Volos
Conference VolosConference Volos
Conference Volos
LIFE GreenYourMove
 
3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility
LIFE GreenYourMove
 
GreenYourMove 1st workshop
GreenYourMove  1st workshop GreenYourMove  1st workshop
GreenYourMove 1st workshop
LIFE GreenYourMove
 
GreenYourMove Presentation
GreenYourMove Presentation GreenYourMove Presentation
GreenYourMove Presentation
LIFE GreenYourMove
 

More from LIFE GreenYourMove (17)

Gym 7th research activity day
Gym 7th research activity dayGym 7th research activity day
Gym 7th research activity day
 
Timetable synchronization
Timetable synchronization Timetable synchronization
Timetable synchronization
 
Benders Decomposition
Benders Decomposition Benders Decomposition
Benders Decomposition
 
co-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentationco-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentation
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
 
LIFE GreenYourMove Project
LIFE GreenYourMove ProjectLIFE GreenYourMove Project
LIFE GreenYourMove Project
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
 
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation
 
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop
 
Presentation escc 2016
Presentation escc 2016Presentation escc 2016
Presentation escc 2016
 
Presentation 3rd CSUM
Presentation 3rd CSUM Presentation 3rd CSUM
Presentation 3rd CSUM
 
Conference Volos
Conference VolosConference Volos
Conference Volos
 
3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility
 
GreenYourMove 1st workshop
GreenYourMove  1st workshop GreenYourMove  1st workshop
GreenYourMove 1st workshop
 
GreenYourMove Presentation
GreenYourMove Presentation GreenYourMove Presentation
GreenYourMove Presentation
 

Recently uploaded

LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
Anant Corporation
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
mahaffeycheryld
 
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
Paris Salesforce Developer Group
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
CVCSOfficial
 
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
PriyankaKilaniya
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
VICTOR MAESTRE RAMIREZ
 
Data Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason WebinarData Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason Webinar
UReason
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
171ticu
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
IJECEIAES
 
Computational Engineering IITH Presentation
Computational Engineering IITH PresentationComputational Engineering IITH Presentation
Computational Engineering IITH Presentation
co23btech11018
 
Embedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoringEmbedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoring
IJECEIAES
 
Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...
Prakhyath Rai
 
22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt
KrishnaveniKrishnara1
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
aryanpankaj78
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
ElakkiaU
 
AI for Legal Research with applications, tools
AI for Legal Research with applications, toolsAI for Legal Research with applications, tools
AI for Legal Research with applications, tools
mahaffeycheryld
 
Gas agency management system project report.pdf
Gas agency management system project report.pdfGas agency management system project report.pdf
Gas agency management system project report.pdf
Kamal Acharya
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
21UME003TUSHARDEB
 
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
upoux
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
nedcocy
 

Recently uploaded (20)

LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
 
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
AI + Data Community Tour - Build the Next Generation of Apps with the Einstei...
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
 
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
 
Data Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason WebinarData Driven Maintenance | UReason Webinar
Data Driven Maintenance | UReason Webinar
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
 
Computational Engineering IITH Presentation
Computational Engineering IITH PresentationComputational Engineering IITH Presentation
Computational Engineering IITH Presentation
 
Embedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoringEmbedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoring
 
Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...
 
22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt22CYT12-Unit-V-E Waste and its Management.ppt
22CYT12-Unit-V-E Waste and its Management.ppt
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
 
AI for Legal Research with applications, tools
AI for Legal Research with applications, toolsAI for Legal Research with applications, tools
AI for Legal Research with applications, tools
 
Gas agency management system project report.pdf
Gas agency management system project report.pdfGas agency management system project report.pdf
Gas agency management system project report.pdf
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
 
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
一比一原版(osu毕业证书)美国俄勒冈州立大学毕业证如何办理
 
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
一比一原版(爱大毕业证书)爱荷华大学毕业证如何办理
 

Presentation data collection and gtfs

  • 1. Introduction to Data Collection & General Transit Feed Specification University of Thessaly,2015 GreenYourMove Project With the contribution of the LIFE programme of the European Union - LIFE14 ENV/GR/000611
  • 3. How are GTFS produced? 3
  • 4. Contents of this presentation  Definitions and Terminology of:  Stop, Routes, Trips, Layers/Shapefiles, CRS, layer features, csv files  OpenStreetMap  General Transit Feed Specification(GTFS)  QuantumGIS(QGIS) & OpenLayers Plugin  PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter  shp2GTFS  Basic usage of:  QGIS  PostgreSQL & PostGIS  shp2GTFS  Conclusion and final results 4
  • 5. Definitions and Terminology  Stop: An object that is defined by a geographic point on Earth and a name/ID, and is usually served/contained in public transit route.  Route: A sequence of stops that are served by a specific vehicle one after another. Information in a route are geospatial objects with IDs and are time-independent .  Trips: Trips are time-dependent executions of routes and they are grouped according to which route they belong to.  Layer/Shapefile: These are two concepts that are interconnected. A shapefile is a data format for GIS systems, which describes vector features, such as points, lines and polygons. When they are used in QGIS they are represented as layers on the map.  CRS: Coordinate Reference System is a system used to locate geographical entities. We will mostly use WGS84 and WGS84/Pseudo Mercator.  QGIS: In QGIS we will create layers, which will contain points and lines and fall under the generic category of layer features.  CSV file: Means Comma-Seperated Values file and is a text file in which every line represents a data record. Each record consists of one or more fields, seperated by commas. 5
  • 6. Definitions and Terminology OpenStreetMap – website https://www.openstreetmap.org/ Definition: As stated on their website: “OpenStreetMap is a free geographic data. OpenStreetMap built by volunteers largely from scratch and released with an open-content license.” Why do we need it? It provides us with datasets about the road network. In most of the cases the raw data from OpenStreetMap needs to be edited in some way in order to use in an application. 6
  • 7. Definitions and Terminology General Transit Feed Specification(GTFS) – website https://developers.google.com/transit/gtfs/ Definition: As stated on their website: “The General Transit Feed Specification (GTFS) defines a common format for public transportation schedules and associated geographic information.” Why do we need it? Because it will be the data format we will use to represent the transit network. It is the mainstream approach when it comes to schedule-based datasets. Its development is supported by big organizations and the number of data available in this form is really bigger than in any other form. 7
  • 8. Definitions and Terminology QuantumGIS(QGIS) – website http://www.qgis.org/ Definition: It is an open-source Geographic Information System(GIS) that is used for viewing, editing and analyzing geographic data. Why do we need it? We use QGIS for data collection. By exploiting the schedule-based nature of a transit network, we create layers which contain all the geographical information of a route. Taking for granted that we somehow know the longitude, latitude and id of a station in a route, we can create a layer containing stops of a route. Next, we use QGIS to create another layer with the data of the actual path the vehicle follows. The output file format are shapefiles. When we open shapefiles with a GIS system they are represented as layers. 8
  • 9. Definitions and Terminology PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter - http://www.postgresql.org/ , http://postgis.net/ Definition: PostgreSQL is an open-source, object-relational database system, while PostGIS is an extension for that database which adds support for geographic objects and allows to run queries for geographic related content in SQL. DBF Loader Exporter is a simple tool for loading files into the database. Why do we need them? It is where we store our data. Furthermore, it allows to run queries to analyze and edit our data. In combination with Python’s modules they are the two main tools that we used in our script shp2GTFS. 9
  • 10. Definitions and Terminology shp2GTFS – not available on website yet. Definition: It is a Python-based script we created that enables us to transform shapefiles to a GTFS feed with less effort than any suggested approach that we are aware of. Why do we need it? Because we need to convert the data we gathered with QGIS to GTFS feeds. There were no tools available online that would enable us to combine the simplicity of gathering data with QGIS and transform the produced layers/shapefiles to a GTFS feed. 10
  • 11. Basic Usage - QGIS 11 The interface: Basic Toolbar, contains most of the tools we need and will use In this box we can see the layers have opened on our canvas. Lon,Lat & CRS information Canvas
  • 12. Basic Usage - QGIS From the basic toolbar we will need: 12 Add feature (Point or Line) Used to open a map layer(plugin) Select and deselect a feature
  • 13. Basic Usage - QGIS About the Plugin and the creation of a layer 13
  • 14. Basic Usage - QGIS Note that:  When we create and save a shapefile to a folder in our computer, there are several files created with it. We only care about the shapefile, but we want to keep the other files too, because they contain information about CRS, encoding, etc. Opening and editing the shapefile only is enough and other files change accordingly.  We are always have to open and work on a OpenStreetMap map layer and not use other services like Bing Maps or Google Maps. 14
  • 15. Basic Usage – PostgreSQL - PostGIS We use the software through a graphic user interface called pgAdmin 3. 15 pgAdmin’s icon:
  • 16. Basic Usage – PostgreSQL - PostGIS 16 In order to load files onto the Database we use the a plugin: After entering username, password and database name we can connect and load shapefiles onto the database.
  • 17. Basic Usage – PostgreSQL - PostGIS *Note that: When installing the database software we enter username and password. We used same username and password for all of the PCs we used. Also before using the loader software you should add to “Path” System Variable the path to the location of the “bin” folder in Postgres’s installation folder. (The path on my computer is: C:Program FilesPostgreSQL9.3bin ) 17
  • 18. Basic Usage – shp2GTFS shp2GTFS is a tool we created and is still in development phase. Its usage is based around the keyfiles. Keyfiles are csv files that contain information about the timetable of the trips and other logic that needs to be included in a GTFS feed. Actually, it connects to the database using a python module, retrieves the data we ask it to retrieve, and combining them with the information on the keyfiles it produces the GTFS files one by one. 18
  • 19. Basic Usage – shp2GTFS *Note that: Using shp2GTFS is achievable through Windows Command Prompt and Cygwin. Before using shp2GTFS you should set System Variable “client_encoding” to “UTF-8”. All input and output paths in the script need to be changed before using it on another computer or you need to have the exact same folder setup on all computers. 19
  • 20. Thank you for your attention! For more information on our project, visit: http://www.greenyourmove.org/ Or contact us at: dimrizopoulos@gmail.com saharidis@gmail.com info@greenyourmove.eu 20