The Datapunt Amsterdam Infrastructure and how it enables us to quickly solve real problems

1. City of
Amsterdam
High velocity development
The Datapunt Amsterdam Infrastructure and
how it enables us to quickly solve real problems

2. City of
Amsterdam
Amsterdam
Open Source
Amsterdam.GitHub.io
GitHub.com/amsterdam
Boris van Hoytema
boris@vanhoytema.com
@bvhme

3. Datapunt in the City of Amsterdam

4. Datapunt: Connecting City Data
● Development team
● Tasked to connect city data in
Amsterdam
○ Connect internal and external data
○ With internal users, partners and the
public
○ To who wants it and is allowed to
● Mix of own and ‘client’ work

5. Datapunt: Team
● An Agile Scrum workflow enabling iterative development
● Using DevOps and Continuous Delivery to accelerate development
● Open Source
● Team includes Backenders, Frontenders, DevOpsers, Supporters, Privacy
experts, Designers, Architects, Product Owners

6. 1. City Data APIs
● APIs for Maps, Statistics, 360°
Imagery, Addresses, Company
information Historical data, etc,
etc, etc
● REST APIs, WMS/WFS services and
map tiles
● Access control for restricted data
● All with OpenAPI documentation

8. Data finding its users

9. 2. Data products
Authz
An OAuth 2.0 compatible authorization
service written in Go.

10. 2. Data products
Open Panorama
An end to end solution for processing,
normalisation, anonymisation and
serving 360° street view panoramas.
From raw files to API.

11. 2. Data products
Open data portal for existing open
data
● Frontends to the City Data APIs
● For the public, partners and
internal users (progressive
disclosure)

14. «Everything is code» and «Code flows»

15. Swarm of services
Stats
Mean time to migrate 1 day
Vertical scaling 15 minutes
Horizontal scaling 20 minutes
APIs 19
Geoservices 20
Databases 20
Servers 57
GIT Repositories 35
Deploys per day 50
Automatic tests 850
Panoramic images 700.000
Map tiles 60.000.000
Hosting per month ± € 3000,-
License costs € 0,-

16. High velocity process
● Quickly go live
● Continuous Delivery
● Time and budget is set, not
deliverables
● With mandate
User needs
Usable
solutions
Building in one or more sprints
of two weeks
1 2 3

17. «Oh, we can develop
apps easily!»

18. 3. FIXXX Applications
● Solutions to actual problems
inside the organisation
● Often connected to the data but
not always
● Deals with similar progressive
disclosure issues
● Apps for the fire department, tour
bus operators, collaborative public
safety and more

19. 4. My Amsterdam
A citizen self-service portal
● One place where a citizen can see
what is happening all across the
City organisation with their cases
● Aggregating and showing data on
cases
● Leaving business logic with the
departments
● A new UI for citizens to deal with
the City

20. 5. Platform as a Service
● Amsterdam is developing more
applications
● These application need similar
services and a similar service level
● CI and Devops means rapid and
safe development
● Datapunt has this infrastructure
and ICT does not

21. Stack
● Mostly Open Source
● Closed source where it is a
community standard or in rare
cases lower costs

22. Amsterdam Open Source
Opening up more
● Sharing all our code
● Please use our things
● Please contribute back

23. amsterdam.github.io
Just started
● Comprehensive showcase of
products
● All the guides and policy we have
or know on Open Source

24. Collaborating and building standards together
● We want to collaborate
● We want to help set standards
where there are none
● We want to help build reference
implementations where there are
none

25. City of
Amsterdam
Amsterdam
Open Source
Amsterdam.GitHub.io
GitHub.com/amsterdam
Boris van Hoytema
boris@vanhoytema.com
@bvhme