This document describes the development of a GIS tool to automate urban planning equalization and compensation calculations that were previously done manually according to Portuguese legislation. The tool was developed by: 1) Assessing the existing manual process, 2) Designing a GIS data model, 3) Developing Python scripts to perform the necessary calculations and produce outputs, and 4) Testing the tool and making corrections. The final tool streamlines the calculation process, facilitates the work of technicians, and provides integrated spatial and non-spatial outputs, including a final report. The tool accomplishes the goals of translating the legal framework into an automated GIS workflow.
3. Note:
This work was originally presented in portuguese, at the Portuguese
ESRI User Conference 2012. This version was translated and
adapted to english.
4. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
AGENDA
I. INTRODUCTION
II. OBJECTIVES
III. METHODOLOGY
IV. RESULTS
V. CONCLUSIONS
6. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
Legally defined mechanism (Framework Law on Spatial
Planning and Urbanism)
The law defines the citizen rights and obligations and the
objectives of the mechanism
NO T C UD ORT N .I
I
I
Integrated in the Council’s legal framework
Different indexs and parameters defined by the legal
framework, calculated with GIS tools, example:
- Average Index of Use (AIU);
- Distribution of Costs of Urbanization (DCU);
- Effective Area Lending (EAL);
- Beneficts value (V1);
- Charges value (V2).
8. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
SE V T CEJ B O.II
I
Tranlate a legal document into a GIS tools
From legislation...
… to GIS
9. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
SE V T CEJ B O.II
I
Facilitate the work of the technicians responsible for the
calculations
Automate the process of calculating and producing
outputs (spatial and alphanumeric data, reports)
Create a single, integrated platform
11. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
1. Assessment of the current process
O OD OHTE MIII
L
.
2. GIS Data Model definition
3. Tools Development
4. Tests and corrections
12. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
1. Assessment of the current process
O OD OHTE MIII
L
.
Brainstorm with the involved technicians
Workflow assessment
Inputs
Calculations
Informations
Conversion of current methodology in accordance with
the proposed objectives
Data Model definition
Develop the calculation tools
13. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
2. GIS Data Model definition
Define geographic entities - Feature Classes - and the
alphanumeric entities - Tables - necessary to the process
and the relationships between all entities
O OD OHTE MIII
L
.
1 Main Feature Class
6 Tables
3 Support Feature Classes
14. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
2. GIS Data Model definition
Table
Table
SECÇÃO
PROJECTO
Relationship class
Relationship class
PARCELA - SECÇÃO
M
PARCELA - PROJECTO
1
1
M
Table
Table
PEREQUAÇÃO (PARCELA)
LOTEAMENTOS
Feature Class
PARCELAS
Relationship class
Relationship class
PARCELA – PEREQ. PARCELA
O OD OHTE MIII
L
.
M
PARCELA - LOTEAMENTOS
1
1
Relationship class
Relationship class
PARCELA – PEREQ. SECÇÃO
M
M
PARCELA – OP. URBANIST
1
1
M
Table
Table
OPER. URBANÍSTICAS
PEREQUAÇÃO (SECÇÃO)
Feature Class
Feature Class
Feature Class
CLASSES ESPAÇO
CONFRONTAÇÃO
INTERSECÇÃO
15. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
O OD OHTE MIII
L
.
What needs to be calculated?
Parametrs
Spatial operations
Inputs and Outputs
Tables and rows to use
How to calculate it?
Handle spatial objects (fc, mxd, layouts)
Handle alphanumeric objects (tables)
Use geoprocessing operations (gptasks)
Handle inputs and outputs of various nature
Create a final report
16. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
O OD OHTE MIII
L
.
What can I use to develop the tools?
What is Python?
Programming language
Easy to use
Direct access to ArcGIS objects (arcpy)
Set of modules to access various objects (e.g.,
files, system data, etc.)
Scripts stored in a Toolbox
17. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
O OD OHTE MIII
L
.
Definition of steps for calculations and reporting
1.
2.
3.
4.
5.
6.
7.
8.
Parcels data calculations
Spatial intersections
Sections data calculations
Project data calculations
Urbanistic mechanism calculations
Land lots data
Urbanistic operations data
Print final report
18. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
Example 1: Parcels data calculations
O OD OHTE MIII
L
.
- Goal: Populate table fields and calculate
parameters;
- Inputs: Parcels, applicant details;
- Outputs: Parcels, applicant details,
parameters (EdAb e AcedAb)
Toolbox view
Script view
19. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
O OD OHTE MIII
L
.
3. Tools development
Example 2: Spatial intersections
- Goal: Spatial intersection of
the parcel with the type of soil
ocupation
- Inputs: Parcels, Soil
occupation classes
- Outputs: Spatial intersection
results
Toolbox view
Script view
20. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
O OD OHTE MIII
L
.
3. Tools development
Example 3: Urbanistic mechanism calculations
- Goal: Urbanistic mechanism
final calculations
- Inputs: Parcels, Tabels with
sections and land lots data,
parameters
- Outputs: Compensatory
mechanism table
Toolbox view
Script view
21. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
Example 3: Urbanistic mechanism calculations
O OD OHTE MIII
L
.
Script view (Sample 1)
Script view (Sample 2)
22. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
Example 4: Print final report
O OD OHTE MIII
L
.
- Goal: Print report with
necessary data
- Inputs: Applicant details,
Lots, Parcels
- Outputs: Report (pdf)
Script view
Sample 1
Sample 2
Toolbox view
Sample 3
23. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
3. Tools development
Example 4: Print final report
Sample 2
O OD OHTE MIII
L
.
Sample 1
Sample 3
24. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
4. Tests and corrections
O OD OHTE MIII
L
.
Tests made with an existing Urbanization Plan
First runs:
errors
bad results
Tests
Presently:
good results
Preparing tests with other plans
Corrections
Improvments
26. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
STL USE R. V
I
Desktop application to calcule the urbanistic mechanism
27. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
SL T USE R. V
I
Integrate scripts in a toolbox within a geodatabase
28. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
STL USE R. V
I
Digital outputs delivery (geographic and tabular data
and pdf report)
30. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
S NO S U C NOC
I L.V
Main gools accomplished
Tranlate a legal document into a GIS tools
Facilitate the work of the technicians
Create a single, integrated platform
Overcome difficulties
First approach to python scripting
Process complexity
Continuous improvement
The current scripts are different then the inicial
ones
Make the process simpler and faster
31. URBANISTIC EQUALIZATION AND COMPENSATORY MECHANISM
- FROM LEGISLATION TO GIS -
How should the app evolve?
Clear and reduce the number of scripts
S NO S U C NOC
I L.V
Evolve into application server
Evolve into web geoprocessing task
Create operations historic table
Make the tool available for the citizen
32. Rui Menezes
C.M. LOULÉ | D.A.T. | D.I.G.C
www.cm-loule.pt
Final Note:
For further information please contact me by email (
rui.menezes@cm-loule.pt or ruimenez@gmail.com)
Editor's Notes
BOM DIA
AGRADECIMENTOS À ESRI
PROJECTO DE TRANSFORMAR UM DIPLOMA LEGAL NUMA FERRAMENTA SIG
BOM DIA
AGRADECIMENTOS À ESRI
PROJECTO DE TRANSFORMAR UM DIPLOMA LEGAL NUMA FERRAMENTA SIG
QUEM JÁ OUVIU FALAR?
QUEM JÁ UTILIZOU COMO FERRAMENTA?
LBPOTU – Lei de Bases da Política de Ordenamento do Território e Urbanismo
RJIGT – Regime Jurídico dos Instr. Gestão Territorial
Facilitar o trabalho dos técnicos responsáveis pelos cálculos
Passar do exxel, mais autocad, mais folhas, etc, para uma única plataforma
Automatizar o processo de cálculo e de produção de outputs digitais (pdf e dados geográficos)
Feitos os cálculos em excel e depois passados para um word, etc
Avaliar o processo actual: verificar como era o fluxo de trabalho, discutir com os colegas, contas em excel
Avaliar o processo actual: verificar como era o fluxo de trabalho, discutir com os colegas, contas em excel
1 pricipal -> Parcela e 3 de Apoio
Relacionadas pelo ID
Manipular objectos geográficos (fc, mxd, etc)
Manipular objectos alfanuméricos (tabelas)
Usar operações de geoprocessamento
Dados de entrada e de saída de diversos tipo – fc, tabelas, constantes, etc
Criar um relatório final
O que é Python?
Linguagem de programação Open Source
Fácil de usar
Acede directamente aos objectos ArcGIS (arcpy)
Conjunto de módulos para aceder a diversos objectos (por exemplo, ficheiros, dados de sistema, etc)
Scripts guardados numa toolbox
Definidos oito passos para cálculos e produção de relatórios
Cálculo dos dados de parcela
Confrontação
Cálculo dos dados de Secção
Cálculo dos dados de Projecto
Cálculo dos dados de Perequação
Dados de Loteamentos
Dados de Operações Urbanísticas
Imprimir Relatório
Antes disto é feita uma tarefa de edição para desenho da parcela
Script com 200 linhas
Script com 200 linhas
Avaliar o processo actual: verificar como era o fluxo de trabalho, discutir com os colegas, contas em excel
Dados e ferramentas integrados numa única plataforma
Dados e ferramentas integrados numa única plataforma
Foram atingidos os objectivos
Primeira abordagem: Nunca se tinha feito nada, limitações a todos os níves
Dificuldades: inexistência de cadastro
Melhoria contínua: estes scripts já são diferentes das primeiras tentativas
Futuro:
Limpas os scripts -> i.e, minimizar/facilitar o trabalho os técnicos
Evoluir para aplicação servidor -> Está em desktop (dados e ferramentas locais)
Evoluir para geoprocessamento web -> utilizável no ArcGIS Server / MSW
Histórico -> tabela e mecanismo para verificar os dados referentes a um dado projecto
Futuro:
Limpas os scripts -> i.e, minimizar/facilitar o trabalho os técnicos
Utilizar uma parcela existente
Evoluir para aplicação servidor -> Está em desktop (dados e ferramentas locais)
Evoluir para geoprocessamento web -> utilizável no ArcGIS Server / MSW
Histórico -> tabela e mecanismo para verificar os dados referentes a um dado projecto, importante para monitorizar os planos
Serviço do Munícipe -> Ferramenta de apoio à decisão, q não dispensará de análise técnica