SlideShare a Scribd company logo
Lessons Learned from
Data Preparation for
Geographic Information
Systems using Open Data
OpenSym2018
Jun Iio
Chuo University, Tokyo JAPAN
Copyright © Jun Iio 2
Chuo University
742-1, Higashi-nakano,
Hachioji-shi, Tokyo
Copyright © Jun Iio 3
Background
●
Data Visualization
– The data are aggregated within administrative
districts and scattered on the map of Hachioji-
city
●
Target data (as of FY2016)
– The number of registered citizens
– The number of visitors, who are checked out
more than one book a year
– The number of times of checking out
– The number of books which are checked out
Copyright © Jun Iio 4
Hachioji-city Libraries
Chuo Univ.
Copyright © Jun Iio 5
Key Index
● The density of visitors di
for the district i
– di
= Tot. # of visitors / Tot. # of residents
● The ratio on the density of visitors Di
– Di
= di
/ maxj
{ dj
}
– Characteristics of Di
● Di
tends to be 1.0 for the closest district i to the
library
●
The longer the distance from the library is, the
lower the value is.
Copyright © Jun Iio 6
Data Visualization with the Graph
Y-axis:The ratio on the density of visitors
X-axis:The distance from library to gravity center
Copyright © Jun Iio 7
Data Visualization on the Map
● Visualizing the value Di
for each library
Central Library Lifelong Learning Center Library
Kawaguchi Library Minamiosawa Library
Copyright © Jun Iio 8
The areas whose ratio is more than 20%
Copyright © Jun Iio 9
Data Preparation
●
We have to prepare two kinds of (open-)
data
– Geographical data
●
Boundary data (city, town, administrative area)
●
Road, Rail, River, Mountain, etc.
●
Building, other objects…
– Various data to be analyzed
Copyright © Jun Iio 10
Open-data from Hachioji-city
Copyright © Jun Iio 11
Geographical Open-data (1)
Copyright © Jun Iio 12
Geographical Open-data (2)
Copyright © Jun Iio 13
Problems
●
Representational mismatch
●
Too much complicated
●
Not suitable for some analysis
Copyright © Jun Iio 14
Solving Problems before Analysis
Copyright © Jun Iio 15
Mismatch in Two Datasets
Copyright © Jun Iio 16
Too Much Complicated
Rock reef
Seawall
Copyright © Jun Iio 17
Merging Several Regions
Copyright © Jun Iio 18
Merging Two Adjacent Regions
Copyright © Jun Iio 19
Appropriate Boundary
Copyright © Jun Iio 20
Conclusions and Future Work
●
Some ministries (MLIT and MIC) have published
boundary data for defining administrative regions on
the internet.
●
However, the raw data provided are inappropriate
for use in spatial analyses using GIS tools.
●
This paper reported procedures required to clean
the boundary data provided by the Japanese
government as open-data.
●
The methods explained here, including the name
aggregation and data cleansing, are operated by
applying some scripts manually.
●
Therefore, a trial to implement a system to
automatically realize these procedures remains in the
scope of future work.

More Related Content

Similar to Lessons Learned from Data Preparation for Geographic Information Systems Using Open Data

CPaaS.io - Overview - Final Review Meeting
CPaaS.io - Overview - Final Review MeetingCPaaS.io - Overview - Final Review Meeting
CPaaS.io - Overview - Final Review Meeting
Stephan Haller
 
A Study of the Development and Distribution of Open Geospatial Data in Japane...
A Study of the Development and Distribution of Open Geospatial Data in Japane...A Study of the Development and Distribution of Open Geospatial Data in Japane...
A Study of the Development and Distribution of Open Geospatial Data in Japane...
Toshikazu Seto
 
Dimensions of Open Data Activities in Japan: Policy, Technology and Community
Dimensions of Open Data Activities in Japan: Policy, Technology and CommunityDimensions of Open Data Activities in Japan: Policy, Technology and Community
Dimensions of Open Data Activities in Japan: Policy, Technology and Community
National Institute of Informatics (NII)
 
SDI-Initiatives-in-Nepal (1).pptx
SDI-Initiatives-in-Nepal (1).pptxSDI-Initiatives-in-Nepal (1).pptx
SDI-Initiatives-in-Nepal (1).pptx
FareLessmotiVation
 
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
mysociety
 
Open data developments in Japan
Open data developments in JapanOpen data developments in Japan
Open data developments in Japan
ccAustralia
 
Applications of Micro Geo Data for Urban Monitoring
Applications of Micro Geo Data  for Urban Monitoring Applications of Micro Geo Data  for Urban Monitoring
Applications of Micro Geo Data for Urban Monitoring
Yuki Akiyama
 
Introduction for Linked Open Data Initiative, Inc. (Japan)
Introduction for Linked Open Data Initiative, Inc. (Japan)Introduction for Linked Open Data Initiative, Inc. (Japan)
Introduction for Linked Open Data Initiative, Inc. (Japan)
National Institute of Informatics (NII)
 
ICT Observatories as a Policy Support Tool: The Picto Experience.
ICT Observatories as a Policy Support Tool: The Picto Experience.ICT Observatories as a Policy Support Tool: The Picto Experience.
ICT Observatories as a Policy Support Tool: The Picto Experience.
Enrico Ferro
 
20140710 tca gsdi
20140710 tca gsdi20140710 tca gsdi
20140710 tca gsdiDongpo Deng
 
Indicator Framework and Results
Indicator Framework and ResultsIndicator Framework and Results
Indicator Framework and Results
OECDregions
 
Tut mathematics and hypermedia research seminar 2011 11-11
Tut mathematics and hypermedia research seminar 2011 11-11Tut mathematics and hypermedia research seminar 2011 11-11
Tut mathematics and hypermedia research seminar 2011 11-11
Yleisradio
 
AfricaGIS 2017 Keynote Address_Patrick Ooro
AfricaGIS 2017 Keynote Address_Patrick OoroAfricaGIS 2017 Keynote Address_Patrick Ooro
AfricaGIS 2017 Keynote Address_Patrick Ooro
Patrick Ooro
 
Towards and OECD Localised Indicator Framework for SDGs
Towards and OECD Localised Indicator Framework for SDGsTowards and OECD Localised Indicator Framework for SDGs
Towards and OECD Localised Indicator Framework for SDGs
OECDregions
 
Introduction Linked Open Data Initiative
Introduction Linked Open Data InitiativeIntroduction Linked Open Data Initiative
Introduction Linked Open Data Initiative
Iwao KOBAYASHI
 
Paolo Veneri- Measuring the SDGs
Paolo Veneri-  Measuring the SDGsPaolo Veneri-  Measuring the SDGs
Paolo Veneri- Measuring the SDGs
OECD CFE
 
Dsir2019(nishiyama)
Dsir2019(nishiyama)Dsir2019(nishiyama)
Dsir2019(nishiyama)
Keita Nishiyama
 
An Interpretive Study on Information Usage and ICT Adoption in Rural Areas
An Interpretive Study on Information Usage and ICT Adoption in Rural AreasAn Interpretive Study on Information Usage and ICT Adoption in Rural Areas
An Interpretive Study on Information Usage and ICT Adoption in Rural Areas
Doy Sundarasaradula
 

Similar to Lessons Learned from Data Preparation for Geographic Information Systems Using Open Data (20)

CPaaS.io - Overview - Final Review Meeting
CPaaS.io - Overview - Final Review MeetingCPaaS.io - Overview - Final Review Meeting
CPaaS.io - Overview - Final Review Meeting
 
A Study of the Development and Distribution of Open Geospatial Data in Japane...
A Study of the Development and Distribution of Open Geospatial Data in Japane...A Study of the Development and Distribution of Open Geospatial Data in Japane...
A Study of the Development and Distribution of Open Geospatial Data in Japane...
 
Dimensions of Open Data Activities in Japan: Policy, Technology and Community
Dimensions of Open Data Activities in Japan: Policy, Technology and CommunityDimensions of Open Data Activities in Japan: Policy, Technology and Community
Dimensions of Open Data Activities in Japan: Policy, Technology and Community
 
SDI-Initiatives-in-Nepal (1).pptx
SDI-Initiatives-in-Nepal (1).pptxSDI-Initiatives-in-Nepal (1).pptx
SDI-Initiatives-in-Nepal (1).pptx
 
Tourism Service Portfolio
Tourism Service PortfolioTourism Service Portfolio
Tourism Service Portfolio
 
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
The State of Open Data: research findings Mor Rubinstein (360Giving, UK) Tim ...
 
Open data developments in Japan
Open data developments in JapanOpen data developments in Japan
Open data developments in Japan
 
Applications of Micro Geo Data for Urban Monitoring
Applications of Micro Geo Data  for Urban Monitoring Applications of Micro Geo Data  for Urban Monitoring
Applications of Micro Geo Data for Urban Monitoring
 
Japón kiyoko tsutsumi
Japón kiyoko tsutsumiJapón kiyoko tsutsumi
Japón kiyoko tsutsumi
 
Introduction for Linked Open Data Initiative, Inc. (Japan)
Introduction for Linked Open Data Initiative, Inc. (Japan)Introduction for Linked Open Data Initiative, Inc. (Japan)
Introduction for Linked Open Data Initiative, Inc. (Japan)
 
ICT Observatories as a Policy Support Tool: The Picto Experience.
ICT Observatories as a Policy Support Tool: The Picto Experience.ICT Observatories as a Policy Support Tool: The Picto Experience.
ICT Observatories as a Policy Support Tool: The Picto Experience.
 
20140710 tca gsdi
20140710 tca gsdi20140710 tca gsdi
20140710 tca gsdi
 
Indicator Framework and Results
Indicator Framework and ResultsIndicator Framework and Results
Indicator Framework and Results
 
Tut mathematics and hypermedia research seminar 2011 11-11
Tut mathematics and hypermedia research seminar 2011 11-11Tut mathematics and hypermedia research seminar 2011 11-11
Tut mathematics and hypermedia research seminar 2011 11-11
 
AfricaGIS 2017 Keynote Address_Patrick Ooro
AfricaGIS 2017 Keynote Address_Patrick OoroAfricaGIS 2017 Keynote Address_Patrick Ooro
AfricaGIS 2017 Keynote Address_Patrick Ooro
 
Towards and OECD Localised Indicator Framework for SDGs
Towards and OECD Localised Indicator Framework for SDGsTowards and OECD Localised Indicator Framework for SDGs
Towards and OECD Localised Indicator Framework for SDGs
 
Introduction Linked Open Data Initiative
Introduction Linked Open Data InitiativeIntroduction Linked Open Data Initiative
Introduction Linked Open Data Initiative
 
Paolo Veneri- Measuring the SDGs
Paolo Veneri-  Measuring the SDGsPaolo Veneri-  Measuring the SDGs
Paolo Veneri- Measuring the SDGs
 
Dsir2019(nishiyama)
Dsir2019(nishiyama)Dsir2019(nishiyama)
Dsir2019(nishiyama)
 
An Interpretive Study on Information Usage and ICT Adoption in Rural Areas
An Interpretive Study on Information Usage and ICT Adoption in Rural AreasAn Interpretive Study on Information Usage and ICT Adoption in Rural Areas
An Interpretive Study on Information Usage and ICT Adoption in Rural Areas
 

More from Jun Iio

フラクタルへの誘い an introduction to fractal
フラクタルへの誘い an introduction to fractalフラクタルへの誘い an introduction to fractal
フラクタルへの誘い an introduction to fractal
Jun Iio
 
オンラインイベント支援システムOLiVESの開発と運用
オンラインイベント支援システムOLiVESの開発と運用オンラインイベント支援システムOLiVESの開発と運用
オンラインイベント支援システムOLiVESの開発と運用
Jun Iio
 
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
Jun Iio
 
オンラインイベント支援システムを作ってみたらどうだったかな?
オンラインイベント支援システムを作ってみたらどうだったかな?オンラインイベント支援システムを作ってみたらどうだったかな?
オンラインイベント支援システムを作ってみたらどうだったかな?
Jun Iio
 
Do you know every cat has four bears?
Do you know every cat has four bears?Do you know every cat has four bears?
Do you know every cat has four bears?
Jun Iio
 
大学教員になりたい企業人の皆様へ
大学教員になりたい企業人の皆様へ大学教員になりたい企業人の皆様へ
大学教員になりたい企業人の皆様へ
Jun Iio
 
情報系学部におけるBYODの試み
情報系学部におけるBYODの試み情報系学部におけるBYODの試み
情報系学部におけるBYODの試み
Jun Iio
 
The Semiotics of Toilet Signs
The Semiotics of Toilet SignsThe Semiotics of Toilet Signs
The Semiotics of Toilet Signs
Jun Iio
 
OpenCampus2019_Tama
OpenCampus2019_TamaOpenCampus2019_Tama
OpenCampus2019_Tama
Jun Iio
 
不偏分散ではなぜNでなくN-1で割るのか
不偏分散ではなぜNでなくN-1で割るのか不偏分散ではなぜNでなくN-1で割るのか
不偏分散ではなぜNでなくN-1で割るのか
Jun Iio
 
2019年春季HCD研究発表会特別講話
2019年春季HCD研究発表会特別講話2019年春季HCD研究発表会特別講話
2019年春季HCD研究発表会特別講話
Jun Iio
 
UXDの課題
UXDの課題UXDの課題
UXDの課題
Jun Iio
 
2019年度BYODソフトウェアインストールガイダンス資料
2019年度BYODソフトウェアインストールガイダンス資料2019年度BYODソフトウェアインストールガイダンス資料
2019年度BYODソフトウェアインストールガイダンス資料
Jun Iio
 
Twitterでみる社会のトレンド
Twitterでみる社会のトレンドTwitterでみる社会のトレンド
Twitterでみる社会のトレンド
Jun Iio
 
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
Jun Iio
 
The presentation material for my lecture at the open campus, 22nd Sep. 2018
The presentation material for my lecture at the open campus, 22nd Sep. 2018The presentation material for my lecture at the open campus, 22nd Sep. 2018
The presentation material for my lecture at the open campus, 22nd Sep. 2018
Jun Iio
 
図書館利用実態の可視化 および 読書感想文コンクール作品の分析
図書館利用実態の可視化 および 読書感想文コンクール作品の分析図書館利用実態の可視化 および 読書感想文コンクール作品の分析
図書館利用実態の可視化 および 読書感想文コンクール作品の分析
Jun Iio
 
たこ焼き屋で学ぶ情報隠蔽
たこ焼き屋で学ぶ情報隠蔽たこ焼き屋で学ぶ情報隠蔽
たこ焼き屋で学ぶ情報隠蔽
Jun Iio
 
トイレサインとピクトグラム
トイレサインとピクトグラムトイレサインとピクトグラム
トイレサインとピクトグラム
Jun Iio
 
Introduction to "Global Studies 2018, Vietnam Program"
Introduction to "Global Studies 2018, Vietnam Program"Introduction to "Global Studies 2018, Vietnam Program"
Introduction to "Global Studies 2018, Vietnam Program"
Jun Iio
 

More from Jun Iio (20)

フラクタルへの誘い an introduction to fractal
フラクタルへの誘い an introduction to fractalフラクタルへの誘い an introduction to fractal
フラクタルへの誘い an introduction to fractal
 
オンラインイベント支援システムOLiVESの開発と運用
オンラインイベント支援システムOLiVESの開発と運用オンラインイベント支援システムOLiVESの開発と運用
オンラインイベント支援システムOLiVESの開発と運用
 
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
麻雀を全く知らない人に純正九蓮宝燈とは何かを教えるための資料
 
オンラインイベント支援システムを作ってみたらどうだったかな?
オンラインイベント支援システムを作ってみたらどうだったかな?オンラインイベント支援システムを作ってみたらどうだったかな?
オンラインイベント支援システムを作ってみたらどうだったかな?
 
Do you know every cat has four bears?
Do you know every cat has four bears?Do you know every cat has four bears?
Do you know every cat has four bears?
 
大学教員になりたい企業人の皆様へ
大学教員になりたい企業人の皆様へ大学教員になりたい企業人の皆様へ
大学教員になりたい企業人の皆様へ
 
情報系学部におけるBYODの試み
情報系学部におけるBYODの試み情報系学部におけるBYODの試み
情報系学部におけるBYODの試み
 
The Semiotics of Toilet Signs
The Semiotics of Toilet SignsThe Semiotics of Toilet Signs
The Semiotics of Toilet Signs
 
OpenCampus2019_Tama
OpenCampus2019_TamaOpenCampus2019_Tama
OpenCampus2019_Tama
 
不偏分散ではなぜNでなくN-1で割るのか
不偏分散ではなぜNでなくN-1で割るのか不偏分散ではなぜNでなくN-1で割るのか
不偏分散ではなぜNでなくN-1で割るのか
 
2019年春季HCD研究発表会特別講話
2019年春季HCD研究発表会特別講話2019年春季HCD研究発表会特別講話
2019年春季HCD研究発表会特別講話
 
UXDの課題
UXDの課題UXDの課題
UXDの課題
 
2019年度BYODソフトウェアインストールガイダンス資料
2019年度BYODソフトウェアインストールガイダンス資料2019年度BYODソフトウェアインストールガイダンス資料
2019年度BYODソフトウェアインストールガイダンス資料
 
Twitterでみる社会のトレンド
Twitterでみる社会のトレンドTwitterでみる社会のトレンド
Twitterでみる社会のトレンド
 
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
The presentation material for my lecture at the open campus, 22nd Sep. 2018 (2)
 
The presentation material for my lecture at the open campus, 22nd Sep. 2018
The presentation material for my lecture at the open campus, 22nd Sep. 2018The presentation material for my lecture at the open campus, 22nd Sep. 2018
The presentation material for my lecture at the open campus, 22nd Sep. 2018
 
図書館利用実態の可視化 および 読書感想文コンクール作品の分析
図書館利用実態の可視化 および 読書感想文コンクール作品の分析図書館利用実態の可視化 および 読書感想文コンクール作品の分析
図書館利用実態の可視化 および 読書感想文コンクール作品の分析
 
たこ焼き屋で学ぶ情報隠蔽
たこ焼き屋で学ぶ情報隠蔽たこ焼き屋で学ぶ情報隠蔽
たこ焼き屋で学ぶ情報隠蔽
 
トイレサインとピクトグラム
トイレサインとピクトグラムトイレサインとピクトグラム
トイレサインとピクトグラム
 
Introduction to "Global Studies 2018, Vietnam Program"
Introduction to "Global Studies 2018, Vietnam Program"Introduction to "Global Studies 2018, Vietnam Program"
Introduction to "Global Studies 2018, Vietnam Program"
 

Recently uploaded

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 

Lessons Learned from Data Preparation for Geographic Information Systems Using Open Data

  • 1. Lessons Learned from Data Preparation for Geographic Information Systems using Open Data OpenSym2018 Jun Iio Chuo University, Tokyo JAPAN
  • 2. Copyright © Jun Iio 2 Chuo University 742-1, Higashi-nakano, Hachioji-shi, Tokyo
  • 3. Copyright © Jun Iio 3 Background ● Data Visualization – The data are aggregated within administrative districts and scattered on the map of Hachioji- city ● Target data (as of FY2016) – The number of registered citizens – The number of visitors, who are checked out more than one book a year – The number of times of checking out – The number of books which are checked out
  • 4. Copyright © Jun Iio 4 Hachioji-city Libraries Chuo Univ.
  • 5. Copyright © Jun Iio 5 Key Index ● The density of visitors di for the district i – di = Tot. # of visitors / Tot. # of residents ● The ratio on the density of visitors Di – Di = di / maxj { dj } – Characteristics of Di ● Di tends to be 1.0 for the closest district i to the library ● The longer the distance from the library is, the lower the value is.
  • 6. Copyright © Jun Iio 6 Data Visualization with the Graph Y-axis:The ratio on the density of visitors X-axis:The distance from library to gravity center
  • 7. Copyright © Jun Iio 7 Data Visualization on the Map ● Visualizing the value Di for each library Central Library Lifelong Learning Center Library Kawaguchi Library Minamiosawa Library
  • 8. Copyright © Jun Iio 8 The areas whose ratio is more than 20%
  • 9. Copyright © Jun Iio 9 Data Preparation ● We have to prepare two kinds of (open-) data – Geographical data ● Boundary data (city, town, administrative area) ● Road, Rail, River, Mountain, etc. ● Building, other objects… – Various data to be analyzed
  • 10. Copyright © Jun Iio 10 Open-data from Hachioji-city
  • 11. Copyright © Jun Iio 11 Geographical Open-data (1)
  • 12. Copyright © Jun Iio 12 Geographical Open-data (2)
  • 13. Copyright © Jun Iio 13 Problems ● Representational mismatch ● Too much complicated ● Not suitable for some analysis
  • 14. Copyright © Jun Iio 14 Solving Problems before Analysis
  • 15. Copyright © Jun Iio 15 Mismatch in Two Datasets
  • 16. Copyright © Jun Iio 16 Too Much Complicated Rock reef Seawall
  • 17. Copyright © Jun Iio 17 Merging Several Regions
  • 18. Copyright © Jun Iio 18 Merging Two Adjacent Regions
  • 19. Copyright © Jun Iio 19 Appropriate Boundary
  • 20. Copyright © Jun Iio 20 Conclusions and Future Work ● Some ministries (MLIT and MIC) have published boundary data for defining administrative regions on the internet. ● However, the raw data provided are inappropriate for use in spatial analyses using GIS tools. ● This paper reported procedures required to clean the boundary data provided by the Japanese government as open-data. ● The methods explained here, including the name aggregation and data cleansing, are operated by applying some scripts manually. ● Therefore, a trial to implement a system to automatically realize these procedures remains in the scope of future work.