I talk in Hong Kong Open Source Conference 2017, a brief introduction of OpenStreetMap, and the Challenge of localization, especially in East Asia.
我在香港開源年會簡介開放街圖,以及在地化的挑戰,特別是在東亞這一帶。
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
The progress and challenge of OpenStreetMap in East Asia
1. The Progress and Challenges of
Mapping in Taiwan
HK Open Source Conference, 2017, Hong Kong Cyberport
Dennis Raylin Chen
2. ● OSM ID: Supaplex
● Work in Tech media TechNews in Taiwan
● Wikipedian, Supervisor of Wikimedia Taiwan
● Board member of OpenStreetMap Taiwan
Organization
● Taipei Meetup host, translator of OSM related
project
Dennis
3. What is OpenStreetMap
● OSM, osm.org
● Founded in 2004
● Community editing web
map
● Wikipedia version Map
●
Website using OSM :
Foursquare, Apple
Photo, USAtoday,
Facebook
4. Founder
● British Guy Steve Coast
● GIS Student
● He complained that English
OS Geodata is too Expensive
● So He launch a Web Map
Project like Wikipedia,
Everybody can Countribute
https://www.hpematter.com/issue-no-4-spring-2015/peoples-map-meet-most-comprehensive-map-planet
8. Wikipedia Vs OpenStreetMap
● License: CC-BY-SA and ODbL
● OpenStreetMap data is structure data
● OpenStreetMap does not have Wikipedia Notability
Guideline, if it is exist then It can be mapped
● Crowds Matters, Both Needs Contributors
28. Getting data from OSM
● Planet
●
3rd
Party Extract, ex: Geofabrik
●
API: OpenStreetMap API , Overpass API
● Use Case: For use in GIS tools, like QGIS analysis
30. Getting List of Hong Kong Road
Names By Overpass API
http://overpass-turbo.eu/?Q=%5Bout%3Acsv%28%22name%22%3Bfalse%29%5D%3B%0Aarea
%5Bname%3D%22Troisdorf%22%5D%3B%0Away%28area%29%5Bhighway%5D%5Bname%5D%3B
%0Aout%3B
37. Map Errors Report from Facebook
https://www.flickr.com/photos/dongpo/19138103974
38. Sudden change
of map, means
there are the
furious users
● Not aware of the
feedback is public
accessible, and the
map is maintain by
communities
(Nobody, 沒有人 )
40. Facebook use in East Asia
● In the forum post, Facebook Staff mention using
OpenStreetMap in landmark page in Japan, South
Korean
● However doesn't mention China, Taiwan, Vietnam
● Facebook works with DigitalGlobe, using AI to
trace the road network on the satellite image
44. Taiwan Topo Map
● Already using
OpenStreetMap
● Some hikers also
adding trail to
OpenStreetmap
● Combining the DTM
data from the
government, the map
rending is more useful
for climbing mountain
https://www.facebook.com/photo.php?fbid=10154544537337138&set=gm.676811479141135&type=3&theat
http://sea.tokyo.idv.tw/?p=3004
46. Program
●
Drinking Water Map
• http://drinking.teia.tw/
Openstreetmap Taiwan Supaplex 85
More information:
http://beta.hackfoldr.org/drinking-water
47. Drinking water map
● Work with local
Environment group:
Taiwan Environment
Information Center
● Host several meetups
● Use Overpass API
58. Problem and Challenge
● Localization
– Chinese Text
● Lack of East Asia Specific Tagging Standard
– Religions
59. App Could Easily Switch to Another
Language
But not on the main site
60. Chinese witch one: Traditional or
Simplified?
●
中國 / 中国
●
臺灣 / 台湾
●
南韓 / 韩国
61. Different Chinese Characters
●
正體 / 简体
● Traditional Chinese / Simplified Chinese
● China and Taiwan use different set of Chinese
characters
● Name:zh Chinese name field is not enough
63. Terms used in different writing system
● Cannes (Where the Cannes File Festival hold)
– 戛纳
– 坎城
– 康城
● Mindanao (The Philippine)
– 棉兰老
– 民答那峨
– 棉蘭老
64. Name tag use in Taiwan (proposed)
Including Language/Dialogue
https://docs.google.com/spreadsheets/d/1d0ahZTEuu9B8Ud7CJOFYi5fBSoI_s1iOo8QZoKkrA5E/edit#gid=
0
65. Name tag use in Taiwan (proposed)
Taiwanese Aboriginal Tribe
67. Even Christian Is a Problem
●
True Jesus Church ( 真耶穌教會 ) is just number 2
in Taiwan compare to Presbyterianism
– Original from China during the Three-Self Patriotic
Movement ( 三自運動 )
●
Bread and Soul ( 靈糧堂 ) is very popular in Taiwan
(Also Controversies)
● How to Tag These Denomination?
68. The way to tag deities and religious
(proposed)
Tsihua Temple
Queen Mother of the West
Tiandiism
69. Further Readings
● My Talk about Taiwan Related Localizated Tagging
Scheme Proposed and the Experience of State of the
Map Asia
https://www.openstreetmap.org/user/Supaplex/diary/399
●
70. Any Question
●
Facebook Group : OpenStreetMap Taiwan
https://www.facebook.com/groups/OpenStreetMap.TW/
●
Taiwan Community Site : http://www.openstreetmap.tw
Editor's Notes
Hi everyone. I'm Dennis from Taiwan Glad to be here again. I was at Hong Kong when the Wikipedia conference Wikimania was hold here in 2012, talking about the writing bootcamp in Taipei. Today I'm talking about the challenges and progress the OpenStreetMap Taiwan community is facing.
Here is my profile.My day job is a tech correspondent at Tech Media Technews. In my spare time I'm also contribute to Wikipedia.
Have you ever heard of OpenStreetMap before this talk. Please raise your hand. It is abbreviation is OSM, founded in 2014, inspired by the online and co-editing encyclepdia Wikpedia. OpenStreetMap is a community editing web map, use the model of co-editing just like Wikipedia. Now OpenStreetMap is over ten years old, serval big website like Foursqure, Apple Phone, USAtoday and even Facebook use map data from OpenStreetMap.
OpenStreetMap was founded by British Guy Steve Coast. He was a GIS graduate student. He complain about the high cost of getting Geo data from government. So he decide to mimic the way Wikipedia does-launch a web map that everybody can contribute.
This slide show the every edits in the particle area. So if someone do something bad, it can be spot by other contributers.
Now there are several tools to detect data error.
There are some gamify approach that let users to fix small error that won't spend too much time.
Here is a simple compare of Wikipedia and OpenStreetMap. On the license part, Wikipedia content is CC-BY-SA. OpenStreetMap use database license ODbL. OpenStreetMap data is structure data. And OpenStreetMap does not have Wikipedia notability guideline, if something exist, then you could map on OpenStreetMap. Crowds matters. Both projects need contributors.
The whole world data of OpenStreetMap is available on Planet. The size is 57GB
Now OpenStreetMap has over 3 million contributors.
This is whole infrastructure of OpenStreetMap
Welled- mapped example on the city level: Berlin, Germany
OpenStreetMap is not only a map, it is a databse, could export veries map style.
Standard layer features the most common OpenSreetMap style.
Cycle map focuses on out door activities. And combing contour line from other source.
Transport Map highlights bus routes and metro lines. And simplified the things appears on the map.
The OpenStreetMap related organization HOT developed map style, showing public facility like police station and fire station.
Ya, you could choose artist style.
Here is the Crayon drawing style
3D buildings
Here is a sample of Taipei data on OpenStreetMap. I think public transport data is most complicated data to map. So here is the route network of Taipei, to give you the idea of how the mapping in Taiwan is done. All the subway line is mapped and some route are added.
A example from hiking usage in Taiwan. The power line and tower is well mapped in Taiwan. The hiker use power tower and line to recognize where is he. Compare to another commercial maps have few data, OSM is very useful.
Map and navigation Apps using OpenStreetMap for offline purpose, available on iOS and Android platform.
Let's watch a video of crisis mapping. An area that OpenStreetMap has huge advantage. The video shows after the Haiti Earthquake, mappers around the world using satellite image to trace roads and building in Haiti capital.
A recent example is Nepal Earthquake action, even Bill Gates praise citizen around the world for mapping the effected area.
3D buildings with colors.
A feature of OpenStreetMap: mulit-language. Here is a screenshot from India developer, showing switch india different mainstream language names on the map
You might be curious about how to get data from OSM. There are several API available if you don't need the whole planet. When you get the data, you could use in QGIS for analysis.
OpenStreetMap API calling example: downloading all data in the box.
Overpass API example, get all road names in HK
Use by many 3rd parties, different use case.
The list goes on.
And on. Such a long list.
You could see the checkin site Foursqure, on the right left corner, there is a small text shows: OpenStreetMap
The most surprise use case is on Facebook Landmark page in East Asia.
In 2015 Facebook was experiencing using OSM data. You could see there is a boundary between different map system.
Increase Map errors, some from Facebook.
And one of the error report seems to be furious. He is mad about Facebook change of Map. And he is not aware of the feedback is public available.
In the same time change map in East Asia, Facebook also test using AI to trace road network just like human
In the forum post, Facebook staff mention using OSM in landmark page in Japan, South Korean
However doesn't mention China, Taiwan, Vietnam
Facebook works with Satellite image provider DigialGlobe for the AI tracing road network task.
Two landmark page in Japan
Facebook made a multi-langue map by OpenStreetMap data, switched by changing the language setting.
Early version of the Facebook Map. Some empty square that should be text. A CJK problem
Compare to previous action, prepare in advanced, move more rapid. The corporation of satellite image company and crisis response organization is deeper.
One Million Edit
In the first 10 Days, there are average 1,000 people edit
In Taiwan, OpenStreetMap data is heavily use by Hiking community. Using Taiwan Topo map use by some hiking map for navigation. Topo Map combined government DTM data for producing contour line on map.
Website for distributing Taiwan TOPO Map data, made by hiker Rudy for offline navigation.
https://dl.dropboxusercontent.com/u/899714/maps/taiwan_topo.html
Drinking water is a project by launched by environment NGO. The map use API mention earlier overpass for real-time display of certain POI on the map.
The website screenshot.
Project code available on Github
Some code for the quarry part by Overpass API
Another project using OpenStreetMap data, the Fortune Teller App. The app overlap data from government using scraper, getting data like the list of overwork companies, the houses which has someone commit suicide.
The code on Github, including scraper and the code for rendering map
Election map, land transaction map, Potential of Soil liquefaction Map
There are more community activities in Taiwan. Not only the big State of the Map Taiwan, but for the meetup in Two cities every month. Kaohsiung meetup is co hosed with Wikimedia community
Here's the photo of the community activities. The Taipei Meetup, and this is the meetup during the Taiwan largest open source conference COSCUP, and the booth on COSCUP.
However OpenStreetMap is Europe-center project. So in East Asia, there are localization problem and lack of East Asia specific tagging standard, like how to categorized religion system in East Asia
App could easily switch to another language, but not on the OpenStreetMap.org website
And for the Chinese world, which Chinese sould we use, the traditional or simplified?
Characters is different between two different system, and the terms is also different. And the Chinese name filed name:zh is not enough to distinguish.
Two terms that use different words. The city famous for the film festival, Cannes, has totally different translated terms in Hong Kong, Taiwan and China.
And Mindanao is also totally different.
Chinese language/dialogue Minnan, Hakka, Cantonese names standard proposed.
Including Taiwanese Aboriginal Tribe language name standard.
The religion system in East Asia is different from western aspect.
Traditional religion in Taiwan is Polytheism, so the