SlideShare a Scribd company logo
Introduction to Data
Collection & General
Transit Feed
Specification
University of Thessaly, 2017
GreenYourMove Project
With the contribution of the LIFE programme of the European Union - LIFE14 ENV/GR/000611
The Big picture
2
How are GTFS produced?
3
Contents of this presentation
 Definitions and Terminology of:
 Stop, Routes, Trips, Layers/Shapefiles, CRS, layer features, csv files
 OpenStreetMap
 General Transit Feed Specification(GTFS)
 QuantumGIS(QGIS) & OpenLayers Plugin
 PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter
 shp2GTFS
 Basic usage of:
 QGIS
 PostgreSQL & PostGIS
 shp2GTFS
 Conclusion and final results
4
Definitions and Terminology
 Stop: An object that is defined by a geographic point on Earth and a name/ID, and is usually
served/contained in public transit route.
 Route: A sequence of stops that are served by a specific vehicle one after another. Information
in a route are geospatial objects with IDs and are time-independent .
 Trips: Trips are time-dependent executions of routes and they are grouped according to which
route they belong to.
 Layer/Shapefile: These are two concepts that are interconnected. A shapefile is a data format
for GIS systems, which describes vector features, such as points, lines and polygons. When they
are used in QGIS they are represented as layers on the map.
 CRS: Coordinate Reference System is a system used to locate geographical entities. We will
mostly use WGS84 and WGS84/Pseudo Mercator.
 QGIS: In QGIS we will create layers, which will contain points and lines and fall under the
generic category of layer features.
 CSV file: Means Comma-Seperated Values file and is a text file in which every line represents a
data record. Each record consists of one or more fields, seperated by commas.
5
Definitions and Terminology
OpenStreetMap – website https://www.openstreetmap.org/
Definition: As stated on their website: “OpenStreetMap is a free geographic data.
OpenStreetMap built by volunteers largely from scratch and released with an
open-content license.”
Why do we need it?
It provides us with datasets about the road network. In most of the cases the raw
data from OpenStreetMap needs to be edited in some way in order to use in an
application.
6
Definitions and Terminology
General Transit Feed Specification(GTFS) – website
https://developers.google.com/transit/gtfs/
Definition: As stated on their website: “The General Transit Feed Specification
(GTFS) defines a common format for public transportation schedules and
associated geographic information.”
Why do we need it?
Because it will be the data format we will use to represent the transit network. It is
the mainstream approach when it comes to schedule-based datasets. Its
development is supported by big organizations and the number of data available
in this form is really bigger than in any other form.
7
Definitions and Terminology
QuantumGIS(QGIS) – website http://www.qgis.org/
Definition: It is an open-source Geographic Information System(GIS) that is used
for viewing, editing and analyzing geographic data.
Why do we need it?
We use QGIS for data collection. By exploiting the schedule-based nature of a
transit network, we create layers which contain all the geographical information of
a route. Taking for granted that we somehow know the longitude, latitude and id
of a station in a route, we can create a layer containing stops of a route. Next, we
use QGIS to create another layer with the data of the actual path the vehicle
follows. The output file format are shapefiles. When we open shapefiles with a GIS
system they are represented as layers.
8
Definitions and Terminology
PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter -
http://www.postgresql.org/ , http://postgis.net/
Definition: PostgreSQL is an open-source, object-relational database system, while
PostGIS is an extension for that database which adds support for geographic
objects and allows to run queries for geographic related content in SQL. DBF
Loader Exporter is a simple tool for loading files into the database.
Why do we need them?
It is where we store our data. Furthermore, it allows to run queries to analyze and
edit our data. In combination with Python’s modules they are the two main tools
that we used in our script shp2GTFS.
9
Definitions and Terminology
shp2GTFS – not available on website yet.
Definition: It is a Python-based script we created that enables us to
transform shapefiles to a GTFS feed with less effort than any suggested
approach that we are aware of.
Why do we need it?
Because we need to convert the data we gathered with QGIS to GTFS
feeds. There were no tools available online that would enable us to
combine the simplicity of gathering data with QGIS and transform the
produced layers/shapefiles to a GTFS feed.
10
Basic Usage - QGIS
11
The interface:
Basic Toolbar, contains
most of the tools we
need
and will use
In this box we can see the layers have opened on our canvas.
Lon,Lat & CRS information
Canvas
Basic Usage - QGIS
From the basic toolbar we will need:
12
Add feature
(Point or Line)
Used to open a map
layer(plugin)
Select and deselect a
feature
Basic Usage - QGIS
About the Plugin and the creation of a layer
13
Basic Usage - QGIS
Note that:
 When we create and save a shapefile to a folder in our computer, there
are several files created with it. We only care about the shapefile, but
we want to keep the other files too, because they contain information
about CRS, encoding, etc. Opening and editing the shapefile only is
enough and other files change accordingly.
 We are always have to open and work on a OpenStreetMap map layer
and not use other services like Bing Maps or Google Maps.
14
Basic Usage – PostgreSQL - PostGIS
We use the software through a graphic user interface called pgAdmin 3.
15
pgAdmin’s icon:
Basic Usage – PostgreSQL - PostGIS
16
In order to load files onto the
Database we use the a plugin:
After entering username, password
and database name we can connect
and load shapefiles onto the database.
Basic Usage – PostgreSQL - PostGIS
*Note that:
When installing the database software we enter username and password.
We used same username and password for all of the PCs we used.
Also before using the loader software you should add to “Path” System
Variable the path to the location of the “bin” folder in Postgres’s
installation folder.
(The path on my computer is: C:Program FilesPostgreSQL9.3bin )
17
Basic Usage – shp2GTFS
shp2GTFS is a tool we created and is still in development phase. Its usage
is based around the keyfiles. Keyfiles are csv files that contain
information about the timetable of the trips and other logic that needs to
be included in a GTFS feed.
Actually, it connects to the database using a python module, retrieves the
data we ask it to retrieve, and combining them with the information on the
keyfiles it produces the GTFS files one by one.
18
Basic Usage – shp2GTFS
*Note that:
Using shp2GTFS is achievable through Windows Command Prompt and
Cygwin.
Before using shp2GTFS you should set System Variable “client_encoding”
to “UTF-8”.
All input and output paths in the script need to be changed before using it
on another computer or you need to have the exact same folder setup on
all computers.
19
Thank you for your attention!
For more information on our project, visit:
http://www.greenyourmove.org/
Or contact us at:
saharidis@gmail.com
info@greenyourmove.eu
20

More Related Content

What's hot

Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
Blake Regalia
 
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Sergio Fernández
 
Unit3 slides
Unit3 slidesUnit3 slides
Unit3 slides
Larefa Bidoun
 
CKANCon 2016 & IODC16
CKANCon 2016 & IODC16CKANCon 2016 & IODC16
CKANCon 2016 & IODC16
Chengjen Lee
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
Giorgos Santipantakis
 
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked DataMark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
mbruemmer
 
Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)
jottevanger
 
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
Chengjen Lee
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
Chengjen Lee
 
Tx well data final
Tx well data finalTx well data final
Tx well data final
Jack Flannery
 
EuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopoEuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopo
geoportal of the federal authorities of the Swiss Confederation
 
Data Grid Taxonomies
Data Grid TaxonomiesData Grid Taxonomies
Data Grid Taxonomies
awesomesos
 
Culture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data LandCulture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data Land
val.cartei
 
Graph Analytics with ArangoDB
Graph Analytics with ArangoDBGraph Analytics with ArangoDB
Graph Analytics with ArangoDB
ArangoDB Database
 
Apache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlibApache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlib
Jens Fisseler, Dr.
 
20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来
Takeo Kunishima
 
Summary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File FormatSummary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File Format
The HDF-EOS Tools and Information Center
 
Webservice Mirabel to koha KohaCon12 - Edinburgh
Webservice Mirabel to koha  KohaCon12 - EdinburghWebservice Mirabel to koha  KohaCon12 - Edinburgh
Webservice Mirabel to koha KohaCon12 - Edinburgh
SciencesPo Grenoble
 
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as KnowledgeRDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
National Institute of Informatics
 
LSMW - Multiple Line of Material Master Long Text
LSMW - Multiple Line of Material Master Long TextLSMW - Multiple Line of Material Master Long Text
LSMW - Multiple Line of Material Master Long Text
Ridzuan
 

What's hot (20)

Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
Towards a More Efficient Paradigm of Storing and Querying Spatial Data on the...
 
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
Geospatial querying in Apache Marmotta - ApacheCon Big Data Europe 2015
 
Unit3 slides
Unit3 slidesUnit3 slides
Unit3 slides
 
CKANCon 2016 & IODC16
CKANCon 2016 & IODC16CKANCon 2016 & IODC16
CKANCon 2016 & IODC16
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
 
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked DataMark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
Mark Zöpfgen: Software-Supported Bibliographic Recording and Linked Data
 
Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)Adventures in Linked Data Land (presentation by Richard Light)
Adventures in Linked Data Land (presentation by Richard Light)
 
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
將 Open Data 放上 Open Source Platforms: 開源資料入口平台 CKAN 開發經驗分享
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
 
Tx well data final
Tx well data finalTx well data final
Tx well data final
 
EuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopoEuroGeographics Linked Data by geo.admin.ch /swisstopo
EuroGeographics Linked Data by geo.admin.ch /swisstopo
 
Data Grid Taxonomies
Data Grid TaxonomiesData Grid Taxonomies
Data Grid Taxonomies
 
Culture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data LandCulture Geeks Feb talk: Adventures in Linked Data Land
Culture Geeks Feb talk: Adventures in Linked Data Land
 
Graph Analytics with ArangoDB
Graph Analytics with ArangoDBGraph Analytics with ArangoDB
Graph Analytics with ArangoDB
 
Apache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlibApache Spark — Fundamentals and MLlib
Apache Spark — Fundamentals and MLlib
 
20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来20090925 HTML5の過去、現在、未来
20090925 HTML5の過去、現在、未来
 
Summary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File FormatSummary of HDF-EOS5 Files, Data Model and File Format
Summary of HDF-EOS5 Files, Data Model and File Format
 
Webservice Mirabel to koha KohaCon12 - Edinburgh
Webservice Mirabel to koha  KohaCon12 - EdinburghWebservice Mirabel to koha  KohaCon12 - Edinburgh
Webservice Mirabel to koha KohaCon12 - Edinburgh
 
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as KnowledgeRDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
RDF4U: RDF Graph Visualization by Interpreting Linked Data as Knowledge
 
LSMW - Multiple Line of Material Master Long Text
LSMW - Multiple Line of Material Master Long TextLSMW - Multiple Line of Material Master Long Text
LSMW - Multiple Line of Material Master Long Text
 

Similar to LIFE GreenYourMove Project - GTFS data

Integrating PostGIS in Web Applications
Integrating PostGIS in Web ApplicationsIntegrating PostGIS in Web Applications
Integrating PostGIS in Web Applications
Command Prompt., Inc
 
Time series data monitoring at 99acres.com
Time series data monitoring at 99acres.comTime series data monitoring at 99acres.com
Time series data monitoring at 99acres.com
Ravi Raj
 
Open Source GIS
Open Source GISOpen Source GIS
Open Source GIS
Joe Larson
 
Leicester 2010 notes
Leicester 2010 notesLeicester 2010 notes
Leicester 2010 notes
Joanne Cook
 
Osgis 2010 notes
Osgis 2010 notesOsgis 2010 notes
Osgis 2010 notes
Joanne Cook
 
Bcs Talk Notes
Bcs Talk NotesBcs Talk Notes
Bcs Talk Notes
Joanne Cook
 
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary ProjectEvent Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Bibek Shrestha
 
OpenStreetMap louis liu
OpenStreetMap   louis liuOpenStreetMap   louis liu
OpenStreetMap louis liu
AidIQ
 
Cacti
CactiCacti
Report Hadoop Map Reduce
Report Hadoop Map ReduceReport Hadoop Map Reduce
Report Hadoop Map Reduce
Urvashi Kataria
 
Seven50 Sparc Overview
Seven50 Sparc OverviewSeven50 Sparc Overview
Seven50 Sparc Overview
Roar Media
 
Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)
Sampo Savolainen
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
Andreas Schreiber
 
Spatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use CasesSpatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use Cases
mathieuraj
 
Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)
Soumee Maschatak
 
Gsoc proposal 2021 polaris
Gsoc proposal 2021 polarisGsoc proposal 2021 polaris
Gsoc proposal 2021 polaris
AyushBansal122
 
Gsoc proposal
Gsoc proposalGsoc proposal
Gsoc proposal
AyushBansal122
 
Geohosting
GeohostingGeohosting
Geohosting
Karel Charvat
 
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
Paula Díaz
 
Phnom penh mapping meetup #15
Phnom penh mapping meetup #15Phnom penh mapping meetup #15
Phnom penh mapping meetup #15
Open Development Cambodia
 

Similar to LIFE GreenYourMove Project - GTFS data (20)

Integrating PostGIS in Web Applications
Integrating PostGIS in Web ApplicationsIntegrating PostGIS in Web Applications
Integrating PostGIS in Web Applications
 
Time series data monitoring at 99acres.com
Time series data monitoring at 99acres.comTime series data monitoring at 99acres.com
Time series data monitoring at 99acres.com
 
Open Source GIS
Open Source GISOpen Source GIS
Open Source GIS
 
Leicester 2010 notes
Leicester 2010 notesLeicester 2010 notes
Leicester 2010 notes
 
Osgis 2010 notes
Osgis 2010 notesOsgis 2010 notes
Osgis 2010 notes
 
Bcs Talk Notes
Bcs Talk NotesBcs Talk Notes
Bcs Talk Notes
 
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary ProjectEvent Visualization with OpenStreetMap Data, Interdisciplinary Project
Event Visualization with OpenStreetMap Data, Interdisciplinary Project
 
OpenStreetMap louis liu
OpenStreetMap   louis liuOpenStreetMap   louis liu
OpenStreetMap louis liu
 
Cacti
CactiCacti
Cacti
 
Report Hadoop Map Reduce
Report Hadoop Map ReduceReport Hadoop Map Reduce
Report Hadoop Map Reduce
 
Seven50 Sparc Overview
Seven50 Sparc OverviewSeven50 Sparc Overview
Seven50 Sparc Overview
 
Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)Simple APIs for Spatial Data (OGC API - Features)
Simple APIs for Spatial Data (OGC API - Features)
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
Spatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use CasesSpatial Data Integrator - Software Presentation and Use Cases
Spatial Data Integrator - Software Presentation and Use Cases
 
Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)Managing Big data Module 3 (1st part)
Managing Big data Module 3 (1st part)
 
Gsoc proposal 2021 polaris
Gsoc proposal 2021 polarisGsoc proposal 2021 polaris
Gsoc proposal 2021 polaris
 
Gsoc proposal
Gsoc proposalGsoc proposal
Gsoc proposal
 
Geohosting
GeohostingGeohosting
Geohosting
 
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
Exchanging the Status between Clients of Geospatial Web Services and GIS appl...
 
Phnom penh mapping meetup #15
Phnom penh mapping meetup #15Phnom penh mapping meetup #15
Phnom penh mapping meetup #15
 

More from LIFE GreenYourMove

Gym 7th research activity day
Gym 7th research activity dayGym 7th research activity day
Gym 7th research activity day
LIFE GreenYourMove
 
Timetable synchronization
Timetable synchronization Timetable synchronization
Timetable synchronization
LIFE GreenYourMove
 
Benders Decomposition
Benders Decomposition Benders Decomposition
Benders Decomposition
LIFE GreenYourMove
 
co-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentationco-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentation
LIFE GreenYourMove
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
LIFE GreenYourMove
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
LIFE GreenYourMove
 
LIFE GreenYourMove Project
LIFE GreenYourMove ProjectLIFE GreenYourMove Project
LIFE GreenYourMove Project
LIFE GreenYourMove
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
LIFE GreenYourMove
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
LIFE GreenYourMove
 
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GreenYourMove
 
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove
 
Presentation escc 2016
Presentation escc 2016Presentation escc 2016
Presentation escc 2016
LIFE GreenYourMove
 
Presentation 3rd CSUM
Presentation 3rd CSUM Presentation 3rd CSUM
Presentation 3rd CSUM
LIFE GreenYourMove
 
Conference Volos
Conference VolosConference Volos
Conference Volos
LIFE GreenYourMove
 
3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility
LIFE GreenYourMove
 
GreenYourMove 1st workshop
GreenYourMove  1st workshop GreenYourMove  1st workshop
GreenYourMove 1st workshop
LIFE GreenYourMove
 
GreenYourMove Presentation
GreenYourMove Presentation GreenYourMove Presentation
GreenYourMove Presentation
LIFE GreenYourMove
 

More from LIFE GreenYourMove (17)

Gym 7th research activity day
Gym 7th research activity dayGym 7th research activity day
Gym 7th research activity day
 
Timetable synchronization
Timetable synchronization Timetable synchronization
Timetable synchronization
 
Benders Decomposition
Benders Decomposition Benders Decomposition
Benders Decomposition
 
co-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentationco-modal emission calculation and inventory-presentation
co-modal emission calculation and inventory-presentation
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Rizopoulos D, Saha...
 
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
ESCC2018, Mykonos, Greece, June 4-8, 2018, presentation by Fragkogios A., Sah...
 
LIFE GreenYourMove Project
LIFE GreenYourMove ProjectLIFE GreenYourMove Project
LIFE GreenYourMove Project
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
 
ESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, GreeceESCC 2016, July 10-16, Athens, Greece
ESCC 2016, July 10-16, Athens, Greece
 
LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation LIFE GYM 5th Hellenic forum for science technology and innovation
LIFE GYM 5th Hellenic forum for science technology and innovation
 
LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop LIFE GreenYourMove project: 1st workshop
LIFE GreenYourMove project: 1st workshop
 
Presentation escc 2016
Presentation escc 2016Presentation escc 2016
Presentation escc 2016
 
Presentation 3rd CSUM
Presentation 3rd CSUM Presentation 3rd CSUM
Presentation 3rd CSUM
 
Conference Volos
Conference VolosConference Volos
Conference Volos
 
3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility3rd Conference on Sustainable Urban Mobility
3rd Conference on Sustainable Urban Mobility
 
GreenYourMove 1st workshop
GreenYourMove  1st workshop GreenYourMove  1st workshop
GreenYourMove 1st workshop
 
GreenYourMove Presentation
GreenYourMove Presentation GreenYourMove Presentation
GreenYourMove Presentation
 

Recently uploaded

Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...
Leonel Morgado
 
AJAY KUMAR NIET GreNo Guava Project File.pdf
AJAY KUMAR NIET GreNo Guava Project File.pdfAJAY KUMAR NIET GreNo Guava Project File.pdf
AJAY KUMAR NIET GreNo Guava Project File.pdf
AJAY KUMAR
 
GBSN - Biochemistry (Unit 6) Chemistry of Proteins
GBSN - Biochemistry (Unit 6) Chemistry of ProteinsGBSN - Biochemistry (Unit 6) Chemistry of Proteins
GBSN - Biochemistry (Unit 6) Chemistry of Proteins
Areesha Ahmad
 
Gadgets for management of stored product pests_Dr.UPR.pdf
Gadgets for management of stored product pests_Dr.UPR.pdfGadgets for management of stored product pests_Dr.UPR.pdf
Gadgets for management of stored product pests_Dr.UPR.pdf
PirithiRaju
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
University of Maribor
 
HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1
Shashank Shekhar Pandey
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
by6843629
 
cathode ray oscilloscope and its applications
cathode ray oscilloscope and its applicationscathode ray oscilloscope and its applications
cathode ray oscilloscope and its applications
sandertein
 
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
ABHISHEK SONI NIMT INSTITUTE OF MEDICAL AND PARAMEDCIAL SCIENCES , GOVT PG COLLEGE NOIDA
 
fermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptxfermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptx
ananya23nair
 
Direct Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart AgricultureDirect Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart Agriculture
International Food Policy Research Institute- South Asia Office
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
University of Hertfordshire
 
Microbiology of Central Nervous System INFECTIONS.pdf
Microbiology of Central Nervous System INFECTIONS.pdfMicrobiology of Central Nervous System INFECTIONS.pdf
Microbiology of Central Nervous System INFECTIONS.pdf
sammy700571
 
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdfHUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
Ritik83251
 
Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
Vandana Devesh Sharma
 
Summary Of transcription and Translation.pdf
Summary Of transcription and Translation.pdfSummary Of transcription and Translation.pdf
Summary Of transcription and Translation.pdf
vadgavevedant86
 
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
hozt8xgk
 
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDSJAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
Sérgio Sacani
 
LEARNING TO LIVE WITH LAWS OF MOTION .pptx
LEARNING TO LIVE WITH LAWS OF MOTION .pptxLEARNING TO LIVE WITH LAWS OF MOTION .pptx
LEARNING TO LIVE WITH LAWS OF MOTION .pptx
yourprojectpartner05
 
11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf
PirithiRaju
 

Recently uploaded (20)

Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...
 
AJAY KUMAR NIET GreNo Guava Project File.pdf
AJAY KUMAR NIET GreNo Guava Project File.pdfAJAY KUMAR NIET GreNo Guava Project File.pdf
AJAY KUMAR NIET GreNo Guava Project File.pdf
 
GBSN - Biochemistry (Unit 6) Chemistry of Proteins
GBSN - Biochemistry (Unit 6) Chemistry of ProteinsGBSN - Biochemistry (Unit 6) Chemistry of Proteins
GBSN - Biochemistry (Unit 6) Chemistry of Proteins
 
Gadgets for management of stored product pests_Dr.UPR.pdf
Gadgets for management of stored product pests_Dr.UPR.pdfGadgets for management of stored product pests_Dr.UPR.pdf
Gadgets for management of stored product pests_Dr.UPR.pdf
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
 
HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
 
cathode ray oscilloscope and its applications
cathode ray oscilloscope and its applicationscathode ray oscilloscope and its applications
cathode ray oscilloscope and its applications
 
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
 
fermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptxfermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptx
 
Direct Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart AgricultureDirect Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart Agriculture
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
 
Microbiology of Central Nervous System INFECTIONS.pdf
Microbiology of Central Nervous System INFECTIONS.pdfMicrobiology of Central Nervous System INFECTIONS.pdf
Microbiology of Central Nervous System INFECTIONS.pdf
 
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdfHUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
 
Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
 
Summary Of transcription and Translation.pdf
Summary Of transcription and Translation.pdfSummary Of transcription and Translation.pdf
Summary Of transcription and Translation.pdf
 
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
快速办理(UAM毕业证书)马德里自治大学毕业证学位证一模一样
 
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDSJAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
 
LEARNING TO LIVE WITH LAWS OF MOTION .pptx
LEARNING TO LIVE WITH LAWS OF MOTION .pptxLEARNING TO LIVE WITH LAWS OF MOTION .pptx
LEARNING TO LIVE WITH LAWS OF MOTION .pptx
 
11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf
 

LIFE GreenYourMove Project - GTFS data

  • 1. Introduction to Data Collection & General Transit Feed Specification University of Thessaly, 2017 GreenYourMove Project With the contribution of the LIFE programme of the European Union - LIFE14 ENV/GR/000611
  • 3. How are GTFS produced? 3
  • 4. Contents of this presentation  Definitions and Terminology of:  Stop, Routes, Trips, Layers/Shapefiles, CRS, layer features, csv files  OpenStreetMap  General Transit Feed Specification(GTFS)  QuantumGIS(QGIS) & OpenLayers Plugin  PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter  shp2GTFS  Basic usage of:  QGIS  PostgreSQL & PostGIS  shp2GTFS  Conclusion and final results 4
  • 5. Definitions and Terminology  Stop: An object that is defined by a geographic point on Earth and a name/ID, and is usually served/contained in public transit route.  Route: A sequence of stops that are served by a specific vehicle one after another. Information in a route are geospatial objects with IDs and are time-independent .  Trips: Trips are time-dependent executions of routes and they are grouped according to which route they belong to.  Layer/Shapefile: These are two concepts that are interconnected. A shapefile is a data format for GIS systems, which describes vector features, such as points, lines and polygons. When they are used in QGIS they are represented as layers on the map.  CRS: Coordinate Reference System is a system used to locate geographical entities. We will mostly use WGS84 and WGS84/Pseudo Mercator.  QGIS: In QGIS we will create layers, which will contain points and lines and fall under the generic category of layer features.  CSV file: Means Comma-Seperated Values file and is a text file in which every line represents a data record. Each record consists of one or more fields, seperated by commas. 5
  • 6. Definitions and Terminology OpenStreetMap – website https://www.openstreetmap.org/ Definition: As stated on their website: “OpenStreetMap is a free geographic data. OpenStreetMap built by volunteers largely from scratch and released with an open-content license.” Why do we need it? It provides us with datasets about the road network. In most of the cases the raw data from OpenStreetMap needs to be edited in some way in order to use in an application. 6
  • 7. Definitions and Terminology General Transit Feed Specification(GTFS) – website https://developers.google.com/transit/gtfs/ Definition: As stated on their website: “The General Transit Feed Specification (GTFS) defines a common format for public transportation schedules and associated geographic information.” Why do we need it? Because it will be the data format we will use to represent the transit network. It is the mainstream approach when it comes to schedule-based datasets. Its development is supported by big organizations and the number of data available in this form is really bigger than in any other form. 7
  • 8. Definitions and Terminology QuantumGIS(QGIS) – website http://www.qgis.org/ Definition: It is an open-source Geographic Information System(GIS) that is used for viewing, editing and analyzing geographic data. Why do we need it? We use QGIS for data collection. By exploiting the schedule-based nature of a transit network, we create layers which contain all the geographical information of a route. Taking for granted that we somehow know the longitude, latitude and id of a station in a route, we can create a layer containing stops of a route. Next, we use QGIS to create another layer with the data of the actual path the vehicle follows. The output file format are shapefiles. When we open shapefiles with a GIS system they are represented as layers. 8
  • 9. Definitions and Terminology PostgreSQL, PostGIS & Shapefile and DBF Loader Exporter - http://www.postgresql.org/ , http://postgis.net/ Definition: PostgreSQL is an open-source, object-relational database system, while PostGIS is an extension for that database which adds support for geographic objects and allows to run queries for geographic related content in SQL. DBF Loader Exporter is a simple tool for loading files into the database. Why do we need them? It is where we store our data. Furthermore, it allows to run queries to analyze and edit our data. In combination with Python’s modules they are the two main tools that we used in our script shp2GTFS. 9
  • 10. Definitions and Terminology shp2GTFS – not available on website yet. Definition: It is a Python-based script we created that enables us to transform shapefiles to a GTFS feed with less effort than any suggested approach that we are aware of. Why do we need it? Because we need to convert the data we gathered with QGIS to GTFS feeds. There were no tools available online that would enable us to combine the simplicity of gathering data with QGIS and transform the produced layers/shapefiles to a GTFS feed. 10
  • 11. Basic Usage - QGIS 11 The interface: Basic Toolbar, contains most of the tools we need and will use In this box we can see the layers have opened on our canvas. Lon,Lat & CRS information Canvas
  • 12. Basic Usage - QGIS From the basic toolbar we will need: 12 Add feature (Point or Line) Used to open a map layer(plugin) Select and deselect a feature
  • 13. Basic Usage - QGIS About the Plugin and the creation of a layer 13
  • 14. Basic Usage - QGIS Note that:  When we create and save a shapefile to a folder in our computer, there are several files created with it. We only care about the shapefile, but we want to keep the other files too, because they contain information about CRS, encoding, etc. Opening and editing the shapefile only is enough and other files change accordingly.  We are always have to open and work on a OpenStreetMap map layer and not use other services like Bing Maps or Google Maps. 14
  • 15. Basic Usage – PostgreSQL - PostGIS We use the software through a graphic user interface called pgAdmin 3. 15 pgAdmin’s icon:
  • 16. Basic Usage – PostgreSQL - PostGIS 16 In order to load files onto the Database we use the a plugin: After entering username, password and database name we can connect and load shapefiles onto the database.
  • 17. Basic Usage – PostgreSQL - PostGIS *Note that: When installing the database software we enter username and password. We used same username and password for all of the PCs we used. Also before using the loader software you should add to “Path” System Variable the path to the location of the “bin” folder in Postgres’s installation folder. (The path on my computer is: C:Program FilesPostgreSQL9.3bin ) 17
  • 18. Basic Usage – shp2GTFS shp2GTFS is a tool we created and is still in development phase. Its usage is based around the keyfiles. Keyfiles are csv files that contain information about the timetable of the trips and other logic that needs to be included in a GTFS feed. Actually, it connects to the database using a python module, retrieves the data we ask it to retrieve, and combining them with the information on the keyfiles it produces the GTFS files one by one. 18
  • 19. Basic Usage – shp2GTFS *Note that: Using shp2GTFS is achievable through Windows Command Prompt and Cygwin. Before using shp2GTFS you should set System Variable “client_encoding” to “UTF-8”. All input and output paths in the script need to be changed before using it on another computer or you need to have the exact same folder setup on all computers. 19
  • 20. Thank you for your attention! For more information on our project, visit: http://www.greenyourmove.org/ Or contact us at: saharidis@gmail.com info@greenyourmove.eu 20